Sep 10 22:58:07.712874 ip-10-0-138-139 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 22:58:08.136403 ip-10-0-138-139 kubenswrapper[2585]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:58:08.136403 ip-10-0-138-139 kubenswrapper[2585]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 22:58:08.136403 ip-10-0-138-139 kubenswrapper[2585]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:58:08.136403 ip-10-0-138-139 kubenswrapper[2585]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 22:58:08.136403 ip-10-0-138-139 kubenswrapper[2585]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:58:08.138473 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.138380    2585 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 22:58:08.143868 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143848    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:58:08.143868 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143865    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:58:08.143868 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143870    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143876    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143882    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143886    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143890    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143894    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143898    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143901    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143906    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143910    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143914    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143917    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143921    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143925    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143929    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143932    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143942    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143946    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143950    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143954    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:58:08.144072 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143958    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143962    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143966    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143969    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143973    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143979    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143985    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143989    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143994    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.143999    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144003    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144008    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144012    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144017    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144022    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144026    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144030    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144034    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144039    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144044    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:58:08.144907 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144048    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144052    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144057    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144061    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144068    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144072    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144076    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144080    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144087    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144092    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144097    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144102    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144107    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144111    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144116    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144120    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144125    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144130    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144134    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:58:08.145789 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144138    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144142    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144146    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144150    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144154    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144159    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144163    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144168    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144173    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144177    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144183    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144188    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144195    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144199    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144203    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144208    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144212    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144216    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144220    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144224    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:58:08.146673 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144228    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144233    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144237    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144241    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144246    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144250    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144254    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144258    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144262    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144267    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144271    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144276    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144280    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144284    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144288    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144292    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144296    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.144301    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145503    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145514    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:58:08.147515 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145520    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145525    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145529    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145534    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145538    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145542    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145547    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145551    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145555    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145577    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145581    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145585    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145591    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145596    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145602    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145606    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145611    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145615    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145619    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:58:08.148399 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145623    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145628    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145633    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145637    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145641    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145645    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145649    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145654    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145658    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145662    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145666    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145670    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145675    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145679    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145684    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145688    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145692    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145704    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145709    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:58:08.149043 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145713    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145718    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145722    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145726    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145730    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145734    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145738    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145742    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145746    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145751    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145755    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145760    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145764    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145768    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145772    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145776    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145781    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145784    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145788    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145792    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145796    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:58:08.149587 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145800    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145804    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145809    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145814    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145819    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145823    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145828    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145832    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145837    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145841    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145846    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145851    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145855    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145859    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145864    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145868    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145872    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145876    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145880    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:58:08.150152 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145885    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145889    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145894    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145898    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145906    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145913    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145918    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145922    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145927    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145931    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145935    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145939    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145943    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145948    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145955    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145961    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145966    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145972    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.145977    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:58:08.150675 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146652    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146663    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146668    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146672    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146678    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146682    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146686    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146691    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146695    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146700    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146704    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146708    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146715    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146721    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146726    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146730    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146735    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146739    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146743    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:58:08.151168 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146750    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146756    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146761    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146766    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146770    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146774    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146779    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146786    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146790    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146794    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146798    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146802    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146806    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146810    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146815    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146819    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146823    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146829    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146834    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146839    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:58:08.151643 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146843    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146847    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146851    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146856    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146860    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146864    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146868    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146872    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146877    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146881    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146885    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146889    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146894    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146898    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146902    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146906    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146910    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146915    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146919    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146925    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:58:08.152164 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146929    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146933    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146937    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146941    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146946    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146949    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146954    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146958    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146962    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146968    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146972    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146977    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146981    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146985    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146989    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146993    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.146998    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147002    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147010    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:58:08.152709 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147016    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147021    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147025    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147030    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147034    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147039    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147044    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147048    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147053    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147058    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147062    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147066    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147071    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147075    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147079    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147084    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147088    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147092    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147096    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147100    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:58:08.153390 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.147104    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147205    2585 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147254    2585 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147266    2585 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147272    2585 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147280    2585 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147286    2585 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147292    2585 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147299    2585 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147304    2585 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147309    2585 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147315    2585 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147320    2585 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147325    2585 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147330    2585 flags.go:64] FLAG: --cgroup-root=""
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147335    2585 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147340    2585 flags.go:64] FLAG: --client-ca-file=""
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147345    2585 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147349    2585 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147355    2585 flags.go:64] FLAG: --cluster-domain=""
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147360    2585 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147365    2585 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147370    2585 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147376    2585 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 22:58:08.153991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147385    2585 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147390    2585 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147395    2585 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147401    2585 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147405    2585 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147410    2585 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147415    2585 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147420    2585 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147425    2585 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147432    2585 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147440    2585 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147445    2585 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147449    2585 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147455    2585 flags.go:64] FLAG: --enable-server="true"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147461    2585 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147469    2585 flags.go:64] FLAG: --event-burst="100"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147473    2585 flags.go:64] FLAG: --event-qps="50"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147478    2585 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147484    2585 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147489    2585 flags.go:64] FLAG: --eviction-hard=""
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147495    2585 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147499    2585 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147504    2585 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147509    2585 flags.go:64] FLAG: --eviction-soft=""
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147514    2585 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 22:58:08.154620 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147518    2585 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147523    2585 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147528    2585 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147533    2585 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147537    2585 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147542    2585 flags.go:64] FLAG: --feature-gates=""
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147549    2585 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147573    2585 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147579    2585 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147584    2585 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147589    2585 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147594    2585 flags.go:64] FLAG: --help="false"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147599    2585 flags.go:64] FLAG: --hostname-override="ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147604    2585 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147609    2585 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147613    2585 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147619    2585 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147626    2585 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147630    2585 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147635    2585 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147640    2585 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147645    2585 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147651    2585 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147656    2585 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 22:58:08.155349 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147661    2585 flags.go:64] FLAG: --kube-reserved=""
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147666    2585 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147670    2585 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147675    2585 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147680    2585 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147684    2585 flags.go:64] FLAG: --lock-file=""
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147689    2585 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147693    2585 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147699    2585 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147708    2585 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147713    2585 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147718    2585 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147722    2585 flags.go:64] FLAG: --logging-format="text"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147728    2585 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147733    2585 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147740    2585 flags.go:64] FLAG: --manifest-url=""
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147745    2585 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147752    2585 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147757    2585 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147764    2585 flags.go:64] FLAG: --max-pods="110"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147768    2585 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147773    2585 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147778    2585 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147783    2585 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147788    2585 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 22:58:08.155994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147793    2585 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147798    2585 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147809    2585 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147814    2585 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147819    2585 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147824    2585 flags.go:64] FLAG: --pod-cidr=""
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147830    2585 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147840    2585 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147844    2585 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147849    2585 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147854    2585 flags.go:64] FLAG: --port="10250"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147858    2585 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147863    2585 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-040f95f1efab3b9ec"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147868    2585 flags.go:64] FLAG: --qos-reserved=""
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147873    2585 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147878    2585 flags.go:64] FLAG: --register-node="true"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147883    2585 flags.go:64] FLAG: --register-with-taints=""
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147889    2585 flags.go:64] FLAG: --registry-burst="10"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147893    2585 flags.go:64] FLAG: --registry-qps="5"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147898    2585 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147903    2585 flags.go:64] FLAG: --reserved-memory=""
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147909    2585 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147914    2585 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147920    2585 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147926    2585 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 22:58:08.156686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147930    2585 flags.go:64] FLAG: --runonce="false"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147935    2585 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147941    2585 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147946    2585 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147950    2585 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147955    2585 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147960    2585 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147965    2585 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147970    2585 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147974    2585 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147979    2585 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147984    2585 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147989    2585 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147994    2585 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.147999    2585 flags.go:64] FLAG: --system-cgroups=""
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148004    2585 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148013    2585 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148018    2585 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148022    2585 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148029    2585 flags.go:64] FLAG: --tls-min-version=""
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148033    2585 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148038    2585 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148042    2585 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148048    2585 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148053    2585 flags.go:64] FLAG: --v="2"
Sep 10 22:58:08.157316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148059    2585 flags.go:64] FLAG: --version="false"
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148066    2585 flags.go:64] FLAG: --vmodule=""
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148072    2585 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.148077    2585 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148259    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148267    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148272    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148276    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148280    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148285    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148289    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148293    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148297    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148302    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148306    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148311    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148315    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148319    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148324    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148328    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:58:08.158023 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148332    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148336    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148341    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148345    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148349    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148354    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148358    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148362    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148367    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148371    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148377    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148381    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148385    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148390    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148394    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148398    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148402    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148408    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148413    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:58:08.158546 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148419    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148424    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148429    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148433    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148437    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148442    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148446    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148450    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148455    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148459    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148463    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148467    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148471    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148476    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148480    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148484    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148489    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148493    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148498    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148502    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148506    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:58:08.159090 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148510    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148514    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148520    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148524    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148529    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148533    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148538    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148542    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148546    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148553    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148572    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148577    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148581    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148585    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148589    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148593    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148598    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148602    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148606    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148610    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:58:08.159623 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148614    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148620    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148626    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148631    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148636    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148640    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148645    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148649    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148655    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148659    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148665    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148669    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148673    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148678    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148683    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148688    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148694    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148700    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:58:08.160136 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148705    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148710    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148714    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148720    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.148725    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.149503    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.159233    2585 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.159247    2585 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.160150    2585 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.160158    2585 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160215    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160220    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160224    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160227    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160230    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:58:08.160604 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160233    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160236    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160239    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160241    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160245    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160249    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160252    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160255    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160258    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160261    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160264    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160267    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160270    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160273    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160275    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160278    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160281    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160284    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160286    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160289    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:58:08.160972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160292    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160294    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160297    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160300    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160304    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160307    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160310    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160313    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160316    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160319    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160321    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160324    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160327    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160329    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160332    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160335    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160337    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160340    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160343    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160345    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:58:08.161454 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160348    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160350    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160354    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160358    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160361    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160364    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160367    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160369    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160372    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160374    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160377    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160379    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160382    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160385    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160387    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160390    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160393    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160397    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160399    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:58:08.161967 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160402    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160405    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160407    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160410    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160412    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160415    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160418    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160420    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160423    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160425    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160428    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160431    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160434    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160436    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160439    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160441    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160444    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160447    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160450    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160452    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:58:08.162425 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160455    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160458    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160460    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160464    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160468    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160471    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160474    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160477    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160480    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160483    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160486    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160489    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160492    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160495    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:58:08.162928 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160497    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.160502    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160629    2585 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160636    2585 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160640    2585 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160643    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160645    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160648    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160652    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160654    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160658    2585 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160661    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160664    2585 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160668    2585 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:58:08.163280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160671    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160675    2585 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160678    2585 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160681    2585 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160683    2585 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160686    2585 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160689    2585 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160692    2585 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160695    2585 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160697    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160701    2585 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160705    2585 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160709    2585 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160713    2585 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160716    2585 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160718    2585 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160721    2585 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160724    2585 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160727    2585 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:58:08.163702 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160729    2585 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160732    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160735    2585 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160737    2585 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160740    2585 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160742    2585 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160745    2585 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160747    2585 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160750    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160752    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160755    2585 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160758    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160760    2585 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160762    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160765    2585 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160768    2585 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160770    2585 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160773    2585 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160775    2585 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:58:08.164170 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160778    2585 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160780    2585 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160783    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160785    2585 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160787    2585 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160790    2585 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160793    2585 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160796    2585 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160798    2585 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160801    2585 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160804    2585 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160807    2585 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160809    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160812    2585 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160814    2585 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160817    2585 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160820    2585 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160822    2585 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160825    2585 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160827    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:58:08.164739 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160830    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160832    2585 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160835    2585 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160837    2585 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160840    2585 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160842    2585 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160845    2585 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160847    2585 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160850    2585 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160853    2585 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160855    2585 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160858    2585 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160860    2585 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160883    2585 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160886    2585 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160890    2585 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160893    2585 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160896    2585 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160899    2585 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160902    2585 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:58:08.165222 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160905    2585 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160907    2585 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160910    2585 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160913    2585 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160917    2585 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160919    2585 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160922    2585 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160925    2585 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:08.160928    2585 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.160933    2585 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.161043    2585 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.163426    2585 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.164512    2585 server.go:1019] "Starting client certificate rotation"
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.164610    2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 22:58:08.165733 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.165422    2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 22:58:08.167393 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.167378    2585 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 22:58:08.171653 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.171524    2585 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 22:58:08.180720 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.180703    2585 log.go:25] "Validated CRI v1 runtime API"
Sep 10 22:58:08.185309 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.185292    2585 log.go:25] "Validated CRI v1 image API"
Sep 10 22:58:08.186139 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.186113    2585 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 22:58:08.193664 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.193643    2585 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 98e726da-0e4a-465c-806b-39abb6495187:/dev/nvme0n1p3 a2d8204c-0926-4f16-b29c-55fb72eea374:/dev/nvme0n1p4]
Sep 10 22:58:08.193749 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.193663    2585 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 22:58:08.198867 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.198755    2585 manager.go:216] Machine: {Timestamp:2026-09-10 22:58:08.19727963 +0000 UTC m=+0.376150584 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099675 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26c1d1ba8ea6aabd5af5f6bcad06b0 SystemUUID:ec26c1d1-ba8e-a6aa-bd5a-f5f6bcad06b0 BootID:9301ead2-44a7-4488-b205-a40ba83adaee Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:22:d8:3d:c8:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:22:d8:3d:c8:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:25:be:e9:e4:44 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 22:58:08.198867 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.198856    2585 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 22:58:08.198998 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.198934    2585 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 22:58:08.202538 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.202507    2585 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 22:58:08.202720 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.202542    2585 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 22:58:08.203293 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.203277    2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 22:58:08.203456 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.203443    2585 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 22:58:08.203515 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.203462    2585 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 22:58:08.203515 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.203474    2585 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 22:58:08.204280 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.204268    2585 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 22:58:08.205515 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.205502    2585 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 22:58:08.210296 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.210282    2585 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 22:58:08.210441 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.210430    2585 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 22:58:08.210498 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.210469    2585 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 22:58:08.210498 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.210488    2585 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 22:58:08.210615 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.210511    2585 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 22:58:08.210615 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.210527    2585 kubelet.go:398] "Adding apiserver pod source"
Sep 10 22:58:08.210615 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.210555    2585 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 22:58:08.210968 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.210955    2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 22:58:08.211049 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.210977    2585 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 22:58:08.213527 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.213512    2585 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 22:58:08.216571 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.216548    2585 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 22:58:08.216627 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.216591    2585 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 22:58:08.218590 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.218555    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 22:58:08.218666 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.218596    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 22:58:08.218666 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.218604    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 22:58:08.218666 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.218612    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 22:58:08.218666 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.218625    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 22:58:08.218666 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.218632    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 22:58:08.218666 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.218656    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 22:58:08.218666 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.218662    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 22:58:08.218666 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.218671    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 22:58:08.218882 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.218676    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 22:58:08.218882 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.218685    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 22:58:08.218882 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.218690    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 22:58:08.219791 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.219763    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 22:58:08.219855 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.219799    2585 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 22:58:08.222528 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.222507    2585 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 22:58:08.222662 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.222643    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 22:58:08.222713 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.222644    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 22:58:08.224825 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.224810    2585 server.go:1268] "Started kubelet"
Sep 10 22:58:08.224921 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.224879    2585 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 22:58:08.224958 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.224889    2585 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 22:58:08.224997 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.224962    2585 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 22:58:08.225682 ip-10-0-138-139 systemd[1]: Started Kubernetes Kubelet.
Sep 10 22:58:08.228116 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.227303    2585 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 22:58:08.228116 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.227611    2585 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 22:58:08.231743 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.231717    2585 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 22:58:08.232345 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.231177    2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-139.ec2.internal.18d417c55201daa3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-139.ec2.internal,UID:ip-10-0-138-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-139.ec2.internal,},FirstTimestamp:2026-09-10 22:58:08.224778915 +0000 UTC m=+0.403649869,LastTimestamp:2026-09-10 22:58:08.224778915 +0000 UTC m=+0.403649869,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-139.ec2.internal,}"
Sep 10 22:58:08.233922 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.233903    2585 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 22:58:08.234641 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.234626    2585 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 22:58:08.234759 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.234738    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found"
Sep 10 22:58:08.235448 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.235431    2585 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 22:58:08.235539 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.235431    2585 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 22:58:08.235539 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.235477    2585 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 22:58:08.235652 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.235586    2585 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 22:58:08.235652 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.235597    2585 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 22:58:08.235761 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.235749    2585 factory.go:55] Registering systemd factory
Sep 10 22:58:08.235803 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.235788    2585 factory.go:223] Registration of the systemd container factory successfully
Sep 10 22:58:08.236045 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.236033    2585 factory.go:153] Registering CRI-O factory
Sep 10 22:58:08.236113 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.236049    2585 factory.go:223] Registration of the crio container factory successfully
Sep 10 22:58:08.236113 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.236100    2585 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 22:58:08.236190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.236117    2585 factory.go:103] Registering Raw factory
Sep 10 22:58:08.236190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.236135    2585 manager.go:1196] Started watching for new ooms in manager
Sep 10 22:58:08.236190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.236142    2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xfbtv"
Sep 10 22:58:08.236651 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.236629    2585 manager.go:349] Starting recovery of all containers
Sep 10 22:58:08.244937 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.244903    2585 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 22:58:08.244937 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.244916    2585 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 22:58:08.247079 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.247035    2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xfbtv"
Sep 10 22:58:08.248235 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.248214    2585 manager.go:354] Recovery completed
Sep 10 22:58:08.254100 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.254086    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:58:08.256816 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.256794    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:58:08.256975 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.256828    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:58:08.256975 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.256842    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:58:08.257537 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.257521    2585 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 22:58:08.257537 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.257532    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:58:08.257687 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.257536    2585 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 22:58:08.257687 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.257606    2585 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 22:58:08.258822 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.258761    2585 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-139.ec2.internal.18d417c553eaa946  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-139.ec2.internal,UID:ip-10-0-138-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-139.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-139.ec2.internal,},FirstTimestamp:2026-09-10 22:58:08.256813382 +0000 UTC m=+0.435684347,LastTimestamp:2026-09-10 22:58:08.256813382 +0000 UTC m=+0.435684347,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-139.ec2.internal,}"
Sep 10 22:58:08.259798 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.259785    2585 policy_none.go:49] "None policy: Start"
Sep 10 22:58:08.259872 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.259803    2585 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 22:58:08.259872 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.259817    2585 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 22:58:08.260399 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.260381    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:58:08.260448 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.260411    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:58:08.260448 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.260423    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:58:08.261908 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.261894    2585 policy_none.go:47] "Start"
Sep 10 22:58:08.292622 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.292271    2585 manager.go:337] "Starting Device Plugin manager"
Sep 10 22:58:08.292622 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.292466    2585 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 22:58:08.292622 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.292479    2585 server.go:87] "Starting device plugin registration server"
Sep 10 22:58:08.312255 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.292744    2585 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 22:58:08.312255 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.292756    2585 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 22:58:08.312255 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.292859    2585 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 22:58:08.312255 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.292940    2585 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 22:58:08.312255 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.292948    2585 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 22:58:08.312255 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.293509    2585 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 22:58:08.312255 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.293577    2585 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-139.ec2.internal\" not found"
Sep 10 22:58:08.333602 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.333546    2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 22:58:08.334810 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.334793    2585 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 22:58:08.334891 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.334860    2585 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 22:58:08.334891 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.334888    2585 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 22:58:08.334977 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.334936    2585 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 22:58:08.337417 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.337397    2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:58:08.393657 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.393577    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:58:08.395018 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.395000    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:58:08.395113 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.395029    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:58:08.395113 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.395039    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:58:08.395113 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.395064    2585 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.406383 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.406365    2585 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.406478 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.406393    2585 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-139.ec2.internal\": node \"ip-10-0-138-139.ec2.internal\" not found"
Sep 10 22:58:08.426170 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.426143    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found"
Sep 10 22:58:08.435360 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.435328    2585 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal"]
Sep 10 22:58:08.435428 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.435408    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:58:08.435708 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.435692    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf335cd7b290e6c7b4dcfcf7665c5ecf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal\" (UID: \"bf335cd7b290e6c7b4dcfcf7665c5ecf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.435773 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.435716    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf335cd7b290e6c7b4dcfcf7665c5ecf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal\" (UID: \"bf335cd7b290e6c7b4dcfcf7665c5ecf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.436810 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.436794    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:58:08.436882 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.436824    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:58:08.436882 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.436838    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:58:08.439260 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.439247    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:58:08.439381 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.439367    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.439433 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.439396    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:58:08.441706 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.441691    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:58:08.441797 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.441714    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:58:08.441797 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.441720    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:58:08.441797 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.441736    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:58:08.441797 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.441748    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:58:08.441797 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.441760    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:58:08.444042 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.444028    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.444128 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.444055    2585 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:58:08.444883 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.444868    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:58:08.444975 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.444900    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:58:08.444975 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.444912    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:58:08.467159 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.467132    2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-139.ec2.internal\" not found" node="ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.471367 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.471351    2585 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-139.ec2.internal\" not found" node="ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.527025 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.526997    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found"
Sep 10 22:58:08.536262 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.536245    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf335cd7b290e6c7b4dcfcf7665c5ecf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal\" (UID: \"bf335cd7b290e6c7b4dcfcf7665c5ecf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.536336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.536268    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf335cd7b290e6c7b4dcfcf7665c5ecf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal\" (UID: \"bf335cd7b290e6c7b4dcfcf7665c5ecf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.536336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.536332    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf335cd7b290e6c7b4dcfcf7665c5ecf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal\" (UID: \"bf335cd7b290e6c7b4dcfcf7665c5ecf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.536400 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.536362    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf335cd7b290e6c7b4dcfcf7665c5ecf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal\" (UID: \"bf335cd7b290e6c7b4dcfcf7665c5ecf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.627679 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.627650    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found"
Sep 10 22:58:08.636935 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.636897    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22eaeaa462a93868d0fc1004d0e57ae7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-139.ec2.internal\" (UID: \"22eaeaa462a93868d0fc1004d0e57ae7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.728409 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.728326    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found"
Sep 10 22:58:08.737647 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.737624    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22eaeaa462a93868d0fc1004d0e57ae7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-139.ec2.internal\" (UID: \"22eaeaa462a93868d0fc1004d0e57ae7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.737706 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.737659    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/22eaeaa462a93868d0fc1004d0e57ae7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-139.ec2.internal\" (UID: \"22eaeaa462a93868d0fc1004d0e57ae7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.769768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.769747    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.775225 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:08.774808    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:08.828480 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.828436    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found"
Sep 10 22:58:08.929141 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:08.929098    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found"
Sep 10 22:58:09.036899 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.036791    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found"
Sep 10 22:58:09.056618 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.056592    2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:58:09.137638 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.137610    2585 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-139.ec2.internal\" not found"
Sep 10 22:58:09.143794 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.143767    2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:58:09.164746 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.164723    2585 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 22:58:09.164869 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.164852    2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 22:58:09.164920 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.164895    2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 22:58:09.164957 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.164895    2585 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 22:58:09.211102 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.211080    2585 apiserver.go:52] "Watching apiserver"
Sep 10 22:58:09.234313 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.234290    2585 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 22:58:09.235480 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.235460    2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:09.237412 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.237390    2585 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 22:58:09.237825 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.237801    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-mddq4","openshift-ovn-kubernetes/ovnkube-node-48wjr","kube-system/global-pull-secret-syncer-4466q","kube-system/konnectivity-agent-w6hsh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt","openshift-cluster-node-tuning-operator/tuned-gpfz2","openshift-multus/multus-additional-cni-plugins-dptvg","openshift-multus/multus-bs529","openshift-network-operator/iptables-alerter-pfk49","openshift-dns/node-resolver-fkrjd","openshift-image-registry/node-ca-2gkn6","openshift-multus/network-metrics-daemon-gk7qs"]
Sep 10 22:58:09.240669 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.240646    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:09.240778 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.240743    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:09.244727 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.244348    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.247044 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.247006    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:09.247149 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.247102    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:09.247287 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.247268    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 22:58:09.247465 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.247448    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 22:58:09.247943 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.247929    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 22:58:09.249044 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.249026    2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 22:58:09.249179 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.249100    2585 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal"
Sep 10 22:58:09.249259 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.249235    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 22:58:09.249259 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.249247    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 22:58:09.249394 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.249247    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s2kkf\""
Sep 10 22:58:09.249394 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.249306    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 22:58:09.249490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.249472    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w6hsh"
Sep 10 22:58:09.251906 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.251886    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.252040 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.251924    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 22:58:09.252159 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.252134    2585 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 22:58:09.252228 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.252193    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c5h8h\""
Sep 10 22:58:09.252228 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.252214    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 22:58:09.253226 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.253204    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 22:53:08 +0000 UTC" deadline="2028-05-07 00:20:17.565897535 +0000 UTC"
Sep 10 22:58:09.253226 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.253225    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14497h22m8.312675352s"
Sep 10 22:58:09.254100 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.254083    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 22:58:09.254317 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.254301    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c6r7l\""
Sep 10 22:58:09.254411 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.254344    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.255017 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.255000    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 22:58:09.255094 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.255080    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 22:58:09.256694 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.256675    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:58:09.256807 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.256765    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 22:58:09.256938 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.256920    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vsqtb\""
Sep 10 22:58:09.256991 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.256957    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.259129 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.259106    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 22:58:09.259449 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.259416    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 22:58:09.259449 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.259425    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 22:58:09.259605 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.259458    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4lz8c\""
Sep 10 22:58:09.259605 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.259509    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 22:58:09.259605 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.259532    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.259768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.259727    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 22:58:09.262023 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.262005    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 22:58:09.262161 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.262145    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2fl7x\""
Sep 10 22:58:09.262539 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.262522    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pfk49"
Sep 10 22:58:09.263271 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.263252    2585 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 22:58:09.264815 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.264792    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:58:09.264879 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.264814    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7w5h7\""
Sep 10 22:58:09.264940 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.264925    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 22:58:09.265712 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.265699    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fkrjd"
Sep 10 22:58:09.265959 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.265944    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 22:58:09.268158 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.268139    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2gkn6"
Sep 10 22:58:09.271433 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.271416    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal"]
Sep 10 22:58:09.271519 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.271443    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal"]
Sep 10 22:58:09.271560 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.271524    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:09.271609 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.271586    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:09.272799 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.272775    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 22:58:09.272799 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.272787    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 22:58:09.272955 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.272819    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 22:58:09.272955 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.272857    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dbfr7\""
Sep 10 22:58:09.272955 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.272909    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 22:58:09.274727 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.274708    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 22:58:09.274792 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.274710    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7mrt8\""
Sep 10 22:58:09.275686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.275664    2585 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mkcwj"
Sep 10 22:58:09.287251 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.287208    2585 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mkcwj"
Sep 10 22:58:09.337115 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.337098    2585 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 22:58:09.341316 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341298    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-kubelet\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.341400 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341321    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-cni-bin\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.341400 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341338    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-var-lib-cni-bin\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.341400 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341355    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e378e8e-e4df-467d-9818-b56e92facd83-cni-binary-copy\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.341400 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341373    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:09.341558 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341413    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.341558 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341440    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-modprobe-d\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.341558 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341459    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-var-lib-kubelet\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.341558 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341474    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-tmp\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.341558 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341491    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63b9e3c1-1e51-42d9-b125-fd13cbaaa329-iptables-alerter-script\") pod \"iptables-alerter-pfk49\" (UID: \"63b9e3c1-1e51-42d9-b125-fd13cbaaa329\") " pod="openshift-network-operator/iptables-alerter-pfk49"
Sep 10 22:58:09.341558 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341510    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-slash\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.341558 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341529    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-ovnkube-config\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.341558 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341543    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-socket-dir\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.341558 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341558    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-sysctl-d\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341572    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-lib-modules\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341598    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-multus-cni-dir\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341612    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b30ce23-27fa-474a-bc25-f0dc91a16892-cni-binary-copy\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341627    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-systemd-units\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341658    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msxvt\" (UniqueName: \"kubernetes.io/projected/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-kube-api-access-msxvt\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341675    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-run-netns\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341701    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-etc-kubernetes\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341724    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m54f\" (UniqueName: \"kubernetes.io/projected/7b30ce23-27fa-474a-bc25-f0dc91a16892-kube-api-access-7m54f\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341757    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwdpd\" (UniqueName: \"kubernetes.io/projected/63b9e3c1-1e51-42d9-b125-fd13cbaaa329-kube-api-access-cwdpd\") pod \"iptables-alerter-pfk49\" (UID: \"63b9e3c1-1e51-42d9-b125-fd13cbaaa329\") " pod="openshift-network-operator/iptables-alerter-pfk49"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341782    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdmzk\" (UniqueName: \"kubernetes.io/projected/54a85272-748c-47b2-9725-e51e37b82c38-kube-api-access-gdmzk\") pod \"node-ca-2gkn6\" (UID: \"54a85272-748c-47b2-9725-e51e37b82c38\") " pod="openshift-image-registry/node-ca-2gkn6"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341808    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06db9d0f-e643-4348-9df1-b54c26f693f3-kubelet-config\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341831    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-var-lib-openvswitch\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341857    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/51782331-1214-4d02-bab5-14943abb3cc9-agent-certs\") pod \"konnectivity-agent-w6hsh\" (UID: \"51782331-1214-4d02-bab5-14943abb3cc9\") " pod="kube-system/konnectivity-agent-w6hsh"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341877    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-ovnkube-script-lib\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341893    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-sysconfig\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.341904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341907    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06db9d0f-e643-4348-9df1-b54c26f693f3-dbus\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341928    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341950    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e378e8e-e4df-467d-9818-b56e92facd83-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341968    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf87s\" (UniqueName: \"kubernetes.io/projected/c681d59b-784f-4e80-94b7-95040c092c61-kube-api-access-kf87s\") pod \"node-resolver-fkrjd\" (UID: \"c681d59b-784f-4e80-94b7-95040c092c61\") " pod="openshift-dns/node-resolver-fkrjd"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.341983    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-run-ovn-kubernetes\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342000    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-cni-netd\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342032    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342054    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c681d59b-784f-4e80-94b7-95040c092c61-hosts-file\") pod \"node-resolver-fkrjd\" (UID: \"c681d59b-784f-4e80-94b7-95040c092c61\") " pod="openshift-dns/node-resolver-fkrjd"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342069    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c681d59b-784f-4e80-94b7-95040c092c61-tmp-dir\") pod \"node-resolver-fkrjd\" (UID: \"c681d59b-784f-4e80-94b7-95040c092c61\") " pod="openshift-dns/node-resolver-fkrjd"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342089    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/51782331-1214-4d02-bab5-14943abb3cc9-konnectivity-ca\") pod \"konnectivity-agent-w6hsh\" (UID: \"51782331-1214-4d02-bab5-14943abb3cc9\") " pod="kube-system/konnectivity-agent-w6hsh"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342112    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-host\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342129    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km5qs\" (UniqueName: \"kubernetes.io/projected/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-kube-api-access-km5qs\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342143    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-hostroot\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342157    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-run-multus-certs\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342177    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-node-log\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342214    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-run-systemd\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.342505 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342255    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-etc-openvswitch\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342281    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-ovn-node-metrics-cert\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342307    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342336    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-sys\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342354    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-var-lib-kubelet\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342368    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7b30ce23-27fa-474a-bc25-f0dc91a16892-multus-daemon-config\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342383    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-run-netns\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342397    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5gzx\" (UniqueName: \"kubernetes.io/projected/d9d6f944-f297-432d-9ae8-c834829345f9-kube-api-access-q5gzx\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342411    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-systemd\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342425    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-run\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342439    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-system-cni-dir\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342452    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54a85272-748c-47b2-9725-e51e37b82c38-host\") pod \"node-ca-2gkn6\" (UID: \"54a85272-748c-47b2-9725-e51e37b82c38\") " pod="openshift-image-registry/node-ca-2gkn6"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342473    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54a85272-748c-47b2-9725-e51e37b82c38-serviceca\") pod \"node-ca-2gkn6\" (UID: \"54a85272-748c-47b2-9725-e51e37b82c38\") " pod="openshift-image-registry/node-ca-2gkn6"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342488    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbbz9\" (UniqueName: \"kubernetes.io/projected/e9f71b5f-be1f-493b-8ae3-db948077c752-kube-api-access-cbbz9\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342516    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-run-ovn\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342542    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-device-dir\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342592    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-kubernetes\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.343267 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342617    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-tuned\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342641    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-run-openvswitch\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342667    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-sysctl-conf\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342692    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-log-socket\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342715    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-sys-fs\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342743    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-run-k8s-cni-cncf-io\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342778    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63b9e3c1-1e51-42d9-b125-fd13cbaaa329-host-slash\") pod \"iptables-alerter-pfk49\" (UID: \"63b9e3c1-1e51-42d9-b125-fd13cbaaa329\") " pod="openshift-network-operator/iptables-alerter-pfk49"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342800    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e378e8e-e4df-467d-9818-b56e92facd83-cnibin\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342844    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btwww\" (UniqueName: \"kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww\") pod \"network-check-target-mddq4\" (UID: \"10370cf5-b94e-4c16-83d2-c37d19fcbf44\") " pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342869    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-multus-socket-dir-parent\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342898    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-var-lib-cni-multus\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342926    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e378e8e-e4df-467d-9818-b56e92facd83-system-cni-dir\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342951    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-registration-dir\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342974    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-cnibin\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.342999    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e378e8e-e4df-467d-9818-b56e92facd83-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.343027    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkj67\" (UniqueName: \"kubernetes.io/projected/1e378e8e-e4df-467d-9818-b56e92facd83-kube-api-access-hkj67\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.343833 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.343060    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-env-overrides\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.344335 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.343085    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-multus-conf-dir\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.344335 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.343111    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e378e8e-e4df-467d-9818-b56e92facd83-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.350276 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.350257    2585 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:58:09.374002 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:09.373978    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf335cd7b290e6c7b4dcfcf7665c5ecf.slice/crio-cc42768ec20082acc52efe32e8fa68d5b849b0f60bd1a0de4da573f97cd1c758 WatchSource:0}: Error finding container cc42768ec20082acc52efe32e8fa68d5b849b0f60bd1a0de4da573f97cd1c758: Status 404 returned error can't find the container with id cc42768ec20082acc52efe32e8fa68d5b849b0f60bd1a0de4da573f97cd1c758
Sep 10 22:58:09.374321 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:09.374297    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22eaeaa462a93868d0fc1004d0e57ae7.slice/crio-b136761ab789fca3bb0d0352882767fab580e63f7316b7d4b65761c69421c536 WatchSource:0}: Error finding container b136761ab789fca3bb0d0352882767fab580e63f7316b7d4b65761c69421c536: Status 404 returned error can't find the container with id b136761ab789fca3bb0d0352882767fab580e63f7316b7d4b65761c69421c536
Sep 10 22:58:09.379243 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.379226    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:58:09.443387 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443353    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-slash\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.443387 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443393    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-ovnkube-config\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.443556 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443410    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-socket-dir\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.443556 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443426    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-sysctl-d\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.443556 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443440    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-lib-modules\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.443556 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443482    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-slash\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.443556 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443533    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-multus-cni-dir\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.443556 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443545    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-sysctl-d\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443562    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b30ce23-27fa-474a-bc25-f0dc91a16892-cni-binary-copy\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443604    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-systemd-units\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443623    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-multus-cni-dir\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443635    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-lib-modules\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443630    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msxvt\" (UniqueName: \"kubernetes.io/projected/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-kube-api-access-msxvt\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443701    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-run-netns\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443706    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-socket-dir\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443743    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-etc-kubernetes\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443748    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-run-netns\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443744    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-systemd-units\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443771    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m54f\" (UniqueName: \"kubernetes.io/projected/7b30ce23-27fa-474a-bc25-f0dc91a16892-kube-api-access-7m54f\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443797    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-etc-kubernetes\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443799    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwdpd\" (UniqueName: \"kubernetes.io/projected/63b9e3c1-1e51-42d9-b125-fd13cbaaa329-kube-api-access-cwdpd\") pod \"iptables-alerter-pfk49\" (UID: \"63b9e3c1-1e51-42d9-b125-fd13cbaaa329\") " pod="openshift-network-operator/iptables-alerter-pfk49"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443826    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdmzk\" (UniqueName: \"kubernetes.io/projected/54a85272-748c-47b2-9725-e51e37b82c38-kube-api-access-gdmzk\") pod \"node-ca-2gkn6\" (UID: \"54a85272-748c-47b2-9725-e51e37b82c38\") " pod="openshift-image-registry/node-ca-2gkn6"
Sep 10 22:58:09.443853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443851    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06db9d0f-e643-4348-9df1-b54c26f693f3-kubelet-config\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443875    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-var-lib-openvswitch\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443901    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/51782331-1214-4d02-bab5-14943abb3cc9-agent-certs\") pod \"konnectivity-agent-w6hsh\" (UID: \"51782331-1214-4d02-bab5-14943abb3cc9\") " pod="kube-system/konnectivity-agent-w6hsh"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443925    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-ovnkube-script-lib\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443953    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-sysconfig\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443965    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/06db9d0f-e643-4348-9df1-b54c26f693f3-kubelet-config\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.443979    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06db9d0f-e643-4348-9df1-b54c26f693f3-dbus\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444025    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444030    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-var-lib-openvswitch\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444066    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e378e8e-e4df-467d-9818-b56e92facd83-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444093    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-ovnkube-config\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.444123    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444036    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/06db9d0f-e643-4348-9df1-b54c26f693f3-dbus\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444138    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b30ce23-27fa-474a-bc25-f0dc91a16892-cni-binary-copy\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.444210    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret podName:06db9d0f-e643-4348-9df1-b54c26f693f3 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:09.944176303 +0000 UTC m=+2.123047251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret") pod "global-pull-secret-syncer-4466q" (UID: "06db9d0f-e643-4348-9df1-b54c26f693f3") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444205    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-sysconfig\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444230    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf87s\" (UniqueName: \"kubernetes.io/projected/c681d59b-784f-4e80-94b7-95040c092c61-kube-api-access-kf87s\") pod \"node-resolver-fkrjd\" (UID: \"c681d59b-784f-4e80-94b7-95040c092c61\") " pod="openshift-dns/node-resolver-fkrjd"
Sep 10 22:58:09.444598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444261    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-run-ovn-kubernetes\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444285    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-cni-netd\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444311    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444342    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-run-ovn-kubernetes\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444336    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c681d59b-784f-4e80-94b7-95040c092c61-hosts-file\") pod \"node-resolver-fkrjd\" (UID: \"c681d59b-784f-4e80-94b7-95040c092c61\") " pod="openshift-dns/node-resolver-fkrjd"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444371    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c681d59b-784f-4e80-94b7-95040c092c61-tmp-dir\") pod \"node-resolver-fkrjd\" (UID: \"c681d59b-784f-4e80-94b7-95040c092c61\") " pod="openshift-dns/node-resolver-fkrjd"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444389    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/51782331-1214-4d02-bab5-14943abb3cc9-konnectivity-ca\") pod \"konnectivity-agent-w6hsh\" (UID: \"51782331-1214-4d02-bab5-14943abb3cc9\") " pod="kube-system/konnectivity-agent-w6hsh"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444387    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c681d59b-784f-4e80-94b7-95040c092c61-hosts-file\") pod \"node-resolver-fkrjd\" (UID: \"c681d59b-784f-4e80-94b7-95040c092c61\") " pod="openshift-dns/node-resolver-fkrjd"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444406    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-host\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444309    2585 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444423    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km5qs\" (UniqueName: \"kubernetes.io/projected/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-kube-api-access-km5qs\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444438    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-hostroot\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444450    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-cni-netd\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444499    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-run-multus-certs\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444545    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-host\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444456    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-run-multus-certs\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444583    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-node-log\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444594    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-ovnkube-script-lib\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.445490 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444609    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-run-systemd\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444631    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1e378e8e-e4df-467d-9818-b56e92facd83-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444663    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-run-systemd\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444666    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-etc-openvswitch\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444681    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c681d59b-784f-4e80-94b7-95040c092c61-tmp-dir\") pod \"node-resolver-fkrjd\" (UID: \"c681d59b-784f-4e80-94b7-95040c092c61\") " pod="openshift-dns/node-resolver-fkrjd"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444696    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-ovn-node-metrics-cert\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444711    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-node-log\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444715    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-etc-openvswitch\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444723    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444732    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-hostroot\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444756    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-sys\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444771    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-etc-selinux\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444783    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-var-lib-kubelet\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444806    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-sys\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444810    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7b30ce23-27fa-474a-bc25-f0dc91a16892-multus-daemon-config\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444833    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-var-lib-kubelet\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444836    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-run-netns\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444867    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5gzx\" (UniqueName: \"kubernetes.io/projected/d9d6f944-f297-432d-9ae8-c834829345f9-kube-api-access-q5gzx\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.446482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444893    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-systemd\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444916    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-run\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444941    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-system-cni-dir\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444967    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54a85272-748c-47b2-9725-e51e37b82c38-host\") pod \"node-ca-2gkn6\" (UID: \"54a85272-748c-47b2-9725-e51e37b82c38\") " pod="openshift-image-registry/node-ca-2gkn6"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444986    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-systemd\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444992    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54a85272-748c-47b2-9725-e51e37b82c38-serviceca\") pod \"node-ca-2gkn6\" (UID: \"54a85272-748c-47b2-9725-e51e37b82c38\") " pod="openshift-image-registry/node-ca-2gkn6"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445019    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbbz9\" (UniqueName: \"kubernetes.io/projected/e9f71b5f-be1f-493b-8ae3-db948077c752-kube-api-access-cbbz9\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445033    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/51782331-1214-4d02-bab5-14943abb3cc9-konnectivity-ca\") pod \"konnectivity-agent-w6hsh\" (UID: \"51782331-1214-4d02-bab5-14943abb3cc9\") " pod="kube-system/konnectivity-agent-w6hsh"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445046    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-run-ovn\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444942    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-run-netns\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445085    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-device-dir\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445103    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-run-ovn\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445112    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-kubernetes\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445139    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-tuned\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445157    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/54a85272-748c-47b2-9725-e51e37b82c38-host\") pod \"node-ca-2gkn6\" (UID: \"54a85272-748c-47b2-9725-e51e37b82c38\") " pod="openshift-image-registry/node-ca-2gkn6"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445165    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-run-openvswitch\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445166    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7b30ce23-27fa-474a-bc25-f0dc91a16892-multus-daemon-config\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445216    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-run\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.447181 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445218    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-system-cni-dir\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445269    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-kubernetes\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445219    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-run-openvswitch\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445216    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-device-dir\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.444416    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445324    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-sysctl-conf\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445364    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-log-socket\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445386    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-sys-fs\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445407    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-run-k8s-cni-cncf-io\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445430    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63b9e3c1-1e51-42d9-b125-fd13cbaaa329-host-slash\") pod \"iptables-alerter-pfk49\" (UID: \"63b9e3c1-1e51-42d9-b125-fd13cbaaa329\") " pod="openshift-network-operator/iptables-alerter-pfk49"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445453    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e378e8e-e4df-467d-9818-b56e92facd83-cnibin\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445490    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwww\" (UniqueName: \"kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww\") pod \"network-check-target-mddq4\" (UID: \"10370cf5-b94e-4c16-83d2-c37d19fcbf44\") " pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445513    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-multus-socket-dir-parent\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445535    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-var-lib-cni-multus\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445556    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e378e8e-e4df-467d-9818-b56e92facd83-system-cni-dir\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445595    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-registration-dir\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445616    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-cnibin\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.447768 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445623    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/63b9e3c1-1e51-42d9-b125-fd13cbaaa329-host-slash\") pod \"iptables-alerter-pfk49\" (UID: \"63b9e3c1-1e51-42d9-b125-fd13cbaaa329\") " pod="openshift-network-operator/iptables-alerter-pfk49"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445639    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e378e8e-e4df-467d-9818-b56e92facd83-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445663    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/54a85272-748c-47b2-9725-e51e37b82c38-serviceca\") pod \"node-ca-2gkn6\" (UID: \"54a85272-748c-47b2-9725-e51e37b82c38\") " pod="openshift-image-registry/node-ca-2gkn6"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445687    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-var-lib-cni-multus\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445691    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkj67\" (UniqueName: \"kubernetes.io/projected/1e378e8e-e4df-467d-9818-b56e92facd83-kube-api-access-hkj67\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445713    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1e378e8e-e4df-467d-9818-b56e92facd83-cnibin\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445720    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-env-overrides\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445743    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-registration-dir\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445750    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-multus-conf-dir\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445778    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e378e8e-e4df-467d-9818-b56e92facd83-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445790    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-cnibin\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445804    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-kubelet\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445825    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-run-k8s-cni-cncf-io\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445831    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-cni-bin\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445863    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-var-lib-cni-bin\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445890    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e378e8e-e4df-467d-9818-b56e92facd83-cni-binary-copy\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445916    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:09.448336 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445914    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-sysctl-conf\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445945    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445970    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-kubelet\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445973    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-modprobe-d\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445991    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-multus-socket-dir-parent\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.445999    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-var-lib-kubelet\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446026    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-tmp\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446042    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-log-socket\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446054    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63b9e3c1-1e51-42d9-b125-fd13cbaaa329-iptables-alerter-script\") pod \"iptables-alerter-pfk49\" (UID: \"63b9e3c1-1e51-42d9-b125-fd13cbaaa329\") " pod="openshift-network-operator/iptables-alerter-pfk49"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446092    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d9d6f944-f297-432d-9ae8-c834829345f9-sys-fs\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446095    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1e378e8e-e4df-467d-9818-b56e92facd83-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446140    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1e378e8e-e4df-467d-9818-b56e92facd83-system-cni-dir\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446150    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-cni-bin\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446197    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446250    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-host-var-lib-cni-bin\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446330    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1e378e8e-e4df-467d-9818-b56e92facd83-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.446432    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:09.449190 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.446483    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs podName:e9f71b5f-be1f-493b-8ae3-db948077c752 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:09.946464807 +0000 UTC m=+2.125335768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs") pod "network-metrics-daemon-gk7qs" (UID: "e9f71b5f-be1f-493b-8ae3-db948077c752") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:09.449802 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446512    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-env-overrides\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.449802 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446567    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b30ce23-27fa-474a-bc25-f0dc91a16892-multus-conf-dir\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.449802 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446574    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-modprobe-d\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.449802 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446628    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-var-lib-kubelet\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.449802 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446733    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1e378e8e-e4df-467d-9818-b56e92facd83-cni-binary-copy\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.449802 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.446750    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/63b9e3c1-1e51-42d9-b125-fd13cbaaa329-iptables-alerter-script\") pod \"iptables-alerter-pfk49\" (UID: \"63b9e3c1-1e51-42d9-b125-fd13cbaaa329\") " pod="openshift-network-operator/iptables-alerter-pfk49"
Sep 10 22:58:09.449802 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.448442    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-ovn-node-metrics-cert\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.449802 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.448464    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-etc-tuned\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.449802 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.448554    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/51782331-1214-4d02-bab5-14943abb3cc9-agent-certs\") pod \"konnectivity-agent-w6hsh\" (UID: \"51782331-1214-4d02-bab5-14943abb3cc9\") " pod="kube-system/konnectivity-agent-w6hsh"
Sep 10 22:58:09.449802 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.448666    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-tmp\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.462330 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.462302    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m54f\" (UniqueName: \"kubernetes.io/projected/7b30ce23-27fa-474a-bc25-f0dc91a16892-kube-api-access-7m54f\") pod \"multus-bs529\" (UID: \"7b30ce23-27fa-474a-bc25-f0dc91a16892\") " pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.464401 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.464381    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwdpd\" (UniqueName: \"kubernetes.io/projected/63b9e3c1-1e51-42d9-b125-fd13cbaaa329-kube-api-access-cwdpd\") pod \"iptables-alerter-pfk49\" (UID: \"63b9e3c1-1e51-42d9-b125-fd13cbaaa329\") " pod="openshift-network-operator/iptables-alerter-pfk49"
Sep 10 22:58:09.464966 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.464949    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:58:09.465034 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.464967    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:58:09.465034 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.464981    2585 projected.go:196] Error preparing data for projected volume kube-api-access-btwww for pod openshift-network-diagnostics/network-check-target-mddq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:09.465034 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.465032    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww podName:10370cf5-b94e-4c16-83d2-c37d19fcbf44 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:09.965019886 +0000 UTC m=+2.143890843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-btwww" (UniqueName: "kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww") pod "network-check-target-mddq4" (UID: "10370cf5-b94e-4c16-83d2-c37d19fcbf44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:09.466445 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.466426    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5gzx\" (UniqueName: \"kubernetes.io/projected/d9d6f944-f297-432d-9ae8-c834829345f9-kube-api-access-q5gzx\") pod \"aws-ebs-csi-driver-node-8xkmt\" (UID: \"d9d6f944-f297-432d-9ae8-c834829345f9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.515516 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.515487    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf87s\" (UniqueName: \"kubernetes.io/projected/c681d59b-784f-4e80-94b7-95040c092c61-kube-api-access-kf87s\") pod \"node-resolver-fkrjd\" (UID: \"c681d59b-784f-4e80-94b7-95040c092c61\") " pod="openshift-dns/node-resolver-fkrjd"
Sep 10 22:58:09.515898 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.515876    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km5qs\" (UniqueName: \"kubernetes.io/projected/ec5bfab7-ffcf-4288-8c96-21f8fee22ab0-kube-api-access-km5qs\") pod \"tuned-gpfz2\" (UID: \"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0\") " pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.516280 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.516261    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdmzk\" (UniqueName: \"kubernetes.io/projected/54a85272-748c-47b2-9725-e51e37b82c38-kube-api-access-gdmzk\") pod \"node-ca-2gkn6\" (UID: \"54a85272-748c-47b2-9725-e51e37b82c38\") " pod="openshift-image-registry/node-ca-2gkn6"
Sep 10 22:58:09.516280 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.516275    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msxvt\" (UniqueName: \"kubernetes.io/projected/d0caf2e2-7da3-4afa-9086-8c4e6f351c39-kube-api-access-msxvt\") pod \"ovnkube-node-48wjr\" (UID: \"d0caf2e2-7da3-4afa-9086-8c4e6f351c39\") " pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.516398 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.516265    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkj67\" (UniqueName: \"kubernetes.io/projected/1e378e8e-e4df-467d-9818-b56e92facd83-kube-api-access-hkj67\") pod \"multus-additional-cni-plugins-dptvg\" (UID: \"1e378e8e-e4df-467d-9818-b56e92facd83\") " pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.516398 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.516347    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbbz9\" (UniqueName: \"kubernetes.io/projected/e9f71b5f-be1f-493b-8ae3-db948077c752-kube-api-access-cbbz9\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:09.578520 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.578454    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:09.589419 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:09.589396    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0caf2e2_7da3_4afa_9086_8c4e6f351c39.slice/crio-822d241db3ddf2394b5346a54dd07ee56c641e82ce4d01bf6947b1b34fe4b82e WatchSource:0}: Error finding container 822d241db3ddf2394b5346a54dd07ee56c641e82ce4d01bf6947b1b34fe4b82e: Status 404 returned error can't find the container with id 822d241db3ddf2394b5346a54dd07ee56c641e82ce4d01bf6947b1b34fe4b82e
Sep 10 22:58:09.594770 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.594748    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w6hsh"
Sep 10 22:58:09.602972 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:09.602946    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51782331_1214_4d02_bab5_14943abb3cc9.slice/crio-10bbe58df6197dff67b73bcaf3c06ef5e339956fe8056c847dfe24f1e291b37f WatchSource:0}: Error finding container 10bbe58df6197dff67b73bcaf3c06ef5e339956fe8056c847dfe24f1e291b37f: Status 404 returned error can't find the container with id 10bbe58df6197dff67b73bcaf3c06ef5e339956fe8056c847dfe24f1e291b37f
Sep 10 22:58:09.613742 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.613724    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt"
Sep 10 22:58:09.622226 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:09.622201    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d6f944_f297_432d_9ae8_c834829345f9.slice/crio-f1f3e7a2814b056b726795f783f5aa665a98a84a5ef0e1b9aae84cfab9f6d4e6 WatchSource:0}: Error finding container f1f3e7a2814b056b726795f783f5aa665a98a84a5ef0e1b9aae84cfab9f6d4e6: Status 404 returned error can't find the container with id f1f3e7a2814b056b726795f783f5aa665a98a84a5ef0e1b9aae84cfab9f6d4e6
Sep 10 22:58:09.630459 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.630440    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gpfz2"
Sep 10 22:58:09.640431 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:09.640408    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec5bfab7_ffcf_4288_8c96_21f8fee22ab0.slice/crio-5e526cddb7b348c1e20877539f1e0d144e55f66e69a03ee6e7da30985b630dce WatchSource:0}: Error finding container 5e526cddb7b348c1e20877539f1e0d144e55f66e69a03ee6e7da30985b630dce: Status 404 returned error can't find the container with id 5e526cddb7b348c1e20877539f1e0d144e55f66e69a03ee6e7da30985b630dce
Sep 10 22:58:09.653496 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.653472    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dptvg"
Sep 10 22:58:09.661888 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:09.661864    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e378e8e_e4df_467d_9818_b56e92facd83.slice/crio-a9535fd16102a5b66571ced98f9a8375a1587303c3d6c633e0534189897a59d0 WatchSource:0}: Error finding container a9535fd16102a5b66571ced98f9a8375a1587303c3d6c633e0534189897a59d0: Status 404 returned error can't find the container with id a9535fd16102a5b66571ced98f9a8375a1587303c3d6c633e0534189897a59d0
Sep 10 22:58:09.680524 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.680503    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bs529"
Sep 10 22:58:09.684686 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.684666    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pfk49"
Sep 10 22:58:09.689001 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:09.688971    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b30ce23_27fa_474a_bc25_f0dc91a16892.slice/crio-2b0678388570ec1cbae22d6a499a64504c4b1c37e09709b43c2d44c5381e8c58 WatchSource:0}: Error finding container 2b0678388570ec1cbae22d6a499a64504c4b1c37e09709b43c2d44c5381e8c58: Status 404 returned error can't find the container with id 2b0678388570ec1cbae22d6a499a64504c4b1c37e09709b43c2d44c5381e8c58
Sep 10 22:58:09.690598 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.690581    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fkrjd"
Sep 10 22:58:09.693530 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:09.693449    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b9e3c1_1e51_42d9_b125_fd13cbaaa329.slice/crio-fe534683259d2788feb7555c3f3561b4759b78646bd084250979c586db37c47d WatchSource:0}: Error finding container fe534683259d2788feb7555c3f3561b4759b78646bd084250979c586db37c47d: Status 404 returned error can't find the container with id fe534683259d2788feb7555c3f3561b4759b78646bd084250979c586db37c47d
Sep 10 22:58:09.695801 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.695766    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2gkn6"
Sep 10 22:58:09.699430 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:09.699405    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc681d59b_784f_4e80_94b7_95040c092c61.slice/crio-01db0d811f0106dd8ec57c317f47349a628dbbbb99f12a77b1bf4176d704443b WatchSource:0}: Error finding container 01db0d811f0106dd8ec57c317f47349a628dbbbb99f12a77b1bf4176d704443b: Status 404 returned error can't find the container with id 01db0d811f0106dd8ec57c317f47349a628dbbbb99f12a77b1bf4176d704443b
Sep 10 22:58:09.705589 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:09.705570    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a85272_748c_47b2_9725_e51e37b82c38.slice/crio-f6200cfdfd1be35d25bde2bf5ceaaabdd029be19f50f27d39d6354b118f0938b WatchSource:0}: Error finding container f6200cfdfd1be35d25bde2bf5ceaaabdd029be19f50f27d39d6354b118f0938b: Status 404 returned error can't find the container with id f6200cfdfd1be35d25bde2bf5ceaaabdd029be19f50f27d39d6354b118f0938b
Sep 10 22:58:09.950548 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.950444    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:09.950548 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:09.950514    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:09.950797 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.950663    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:09.950797 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.950726    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret podName:06db9d0f-e643-4348-9df1-b54c26f693f3 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:10.95070717 +0000 UTC m=+3.129578115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret") pod "global-pull-secret-syncer-4466q" (UID: "06db9d0f-e643-4348-9df1-b54c26f693f3") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:09.950797 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.950789    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:09.950965 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:09.950823    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs podName:e9f71b5f-be1f-493b-8ae3-db948077c752 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:10.950811606 +0000 UTC m=+3.129682563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs") pod "network-metrics-daemon-gk7qs" (UID: "e9f71b5f-be1f-493b-8ae3-db948077c752") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:10.052801 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.052124    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwww\" (UniqueName: \"kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww\") pod \"network-check-target-mddq4\" (UID: \"10370cf5-b94e-4c16-83d2-c37d19fcbf44\") " pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:10.052801 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:10.052339    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:58:10.052801 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:10.052364    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:58:10.052801 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:10.052377    2585 projected.go:196] Error preparing data for projected volume kube-api-access-btwww for pod openshift-network-diagnostics/network-check-target-mddq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:10.052801 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:10.052438    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww podName:10370cf5-b94e-4c16-83d2-c37d19fcbf44 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:11.052419172 +0000 UTC m=+3.231290128 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-btwww" (UniqueName: "kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww") pod "network-check-target-mddq4" (UID: "10370cf5-b94e-4c16-83d2-c37d19fcbf44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:10.290911 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.290809    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 22:53:09 +0000 UTC" deadline="2028-06-06 00:19:21.199324616 +0000 UTC"
Sep 10 22:58:10.290911 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.290858    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15217h21m10.908472441s"
Sep 10 22:58:10.368739 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.368675    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2gkn6" event={"ID":"54a85272-748c-47b2-9725-e51e37b82c38","Type":"ContainerStarted","Data":"f6200cfdfd1be35d25bde2bf5ceaaabdd029be19f50f27d39d6354b118f0938b"}
Sep 10 22:58:10.373820 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.373784    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pfk49" event={"ID":"63b9e3c1-1e51-42d9-b125-fd13cbaaa329","Type":"ContainerStarted","Data":"fe534683259d2788feb7555c3f3561b4759b78646bd084250979c586db37c47d"}
Sep 10 22:58:10.401557 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.401363    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bs529" event={"ID":"7b30ce23-27fa-474a-bc25-f0dc91a16892","Type":"ContainerStarted","Data":"2b0678388570ec1cbae22d6a499a64504c4b1c37e09709b43c2d44c5381e8c58"}
Sep 10 22:58:10.403575 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.403419    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dptvg" event={"ID":"1e378e8e-e4df-467d-9818-b56e92facd83","Type":"ContainerStarted","Data":"a9535fd16102a5b66571ced98f9a8375a1587303c3d6c633e0534189897a59d0"}
Sep 10 22:58:10.406268 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.406019    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gpfz2" event={"ID":"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0","Type":"ContainerStarted","Data":"5e526cddb7b348c1e20877539f1e0d144e55f66e69a03ee6e7da30985b630dce"}
Sep 10 22:58:10.408954 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.408871    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt" event={"ID":"d9d6f944-f297-432d-9ae8-c834829345f9","Type":"ContainerStarted","Data":"f1f3e7a2814b056b726795f783f5aa665a98a84a5ef0e1b9aae84cfab9f6d4e6"}
Sep 10 22:58:10.414682 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.414600    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w6hsh" event={"ID":"51782331-1214-4d02-bab5-14943abb3cc9","Type":"ContainerStarted","Data":"10bbe58df6197dff67b73bcaf3c06ef5e339956fe8056c847dfe24f1e291b37f"}
Sep 10 22:58:10.420735 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.420691    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fkrjd" event={"ID":"c681d59b-784f-4e80-94b7-95040c092c61","Type":"ContainerStarted","Data":"01db0d811f0106dd8ec57c317f47349a628dbbbb99f12a77b1bf4176d704443b"}
Sep 10 22:58:10.426829 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.426733    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr" event={"ID":"d0caf2e2-7da3-4afa-9086-8c4e6f351c39","Type":"ContainerStarted","Data":"822d241db3ddf2394b5346a54dd07ee56c641e82ce4d01bf6947b1b34fe4b82e"}
Sep 10 22:58:10.433739 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.433715    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" event={"ID":"bf335cd7b290e6c7b4dcfcf7665c5ecf","Type":"ContainerStarted","Data":"cc42768ec20082acc52efe32e8fa68d5b849b0f60bd1a0de4da573f97cd1c758"}
Sep 10 22:58:10.440474 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.440381    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal" event={"ID":"22eaeaa462a93868d0fc1004d0e57ae7","Type":"ContainerStarted","Data":"b136761ab789fca3bb0d0352882767fab580e63f7316b7d4b65761c69421c536"}
Sep 10 22:58:10.583179 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.583088    2585 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:58:10.813124 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.813088    2585 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:58:10.961692 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.960825    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:10.961692 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:10.960896    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:10.961692 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:10.961026    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:10.961692 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:10.961091    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret podName:06db9d0f-e643-4348-9df1-b54c26f693f3 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:12.961073214 +0000 UTC m=+5.139944164 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret") pod "global-pull-secret-syncer-4466q" (UID: "06db9d0f-e643-4348-9df1-b54c26f693f3") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:10.961692 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:10.961537    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:10.961692 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:10.961586    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs podName:e9f71b5f-be1f-493b-8ae3-db948077c752 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:12.961570863 +0000 UTC m=+5.140441812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs") pod "network-metrics-daemon-gk7qs" (UID: "e9f71b5f-be1f-493b-8ae3-db948077c752") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:11.062043 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:11.062002    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwww\" (UniqueName: \"kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww\") pod \"network-check-target-mddq4\" (UID: \"10370cf5-b94e-4c16-83d2-c37d19fcbf44\") " pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:11.062248 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:11.062162    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:58:11.062248 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:11.062189    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:58:11.062248 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:11.062204    2585 projected.go:196] Error preparing data for projected volume kube-api-access-btwww for pod openshift-network-diagnostics/network-check-target-mddq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:11.062416 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:11.062272    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww podName:10370cf5-b94e-4c16-83d2-c37d19fcbf44 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:13.062252048 +0000 UTC m=+5.241123005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-btwww" (UniqueName: "kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww") pod "network-check-target-mddq4" (UID: "10370cf5-b94e-4c16-83d2-c37d19fcbf44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:11.291508 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:11.291387    2585 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 22:53:09 +0000 UTC" deadline="2028-03-09 22:14:14.397596617 +0000 UTC"
Sep 10 22:58:11.291508 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:11.291455    2585 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13103h16m3.106146941s"
Sep 10 22:58:11.336120 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:11.336085    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:11.336315 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:11.336228    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:11.336690 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:11.336669    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:11.336799 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:11.336775    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:11.336872 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:11.336852    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:11.336967 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:11.336939    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:12.124053 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:12.124013    2585 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:58:12.980069 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:12.979983    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:12.980529 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:12.980082    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:12.980529 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:12.980199    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:12.980529 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:12.980213    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:12.980529 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:12.980279    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs podName:e9f71b5f-be1f-493b-8ae3-db948077c752 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:16.980259041 +0000 UTC m=+9.159129990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs") pod "network-metrics-daemon-gk7qs" (UID: "e9f71b5f-be1f-493b-8ae3-db948077c752") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:12.980529 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:12.980298    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret podName:06db9d0f-e643-4348-9df1-b54c26f693f3 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:16.980288313 +0000 UTC m=+9.159159261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret") pod "global-pull-secret-syncer-4466q" (UID: "06db9d0f-e643-4348-9df1-b54c26f693f3") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:13.081206 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:13.080514    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwww\" (UniqueName: \"kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww\") pod \"network-check-target-mddq4\" (UID: \"10370cf5-b94e-4c16-83d2-c37d19fcbf44\") " pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:13.081206 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:13.080726    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:58:13.081206 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:13.080755    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:58:13.081206 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:13.080769    2585 projected.go:196] Error preparing data for projected volume kube-api-access-btwww for pod openshift-network-diagnostics/network-check-target-mddq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:13.081206 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:13.080831    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww podName:10370cf5-b94e-4c16-83d2-c37d19fcbf44 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:17.080812226 +0000 UTC m=+9.259683184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-btwww" (UniqueName: "kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww") pod "network-check-target-mddq4" (UID: "10370cf5-b94e-4c16-83d2-c37d19fcbf44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:13.335657 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:13.335558    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:13.335872 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:13.335824    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:13.335872 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:13.335679    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:13.336023 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:13.335960    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:13.336023 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:13.335647    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:13.336125 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:13.336042    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:15.335512 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:15.335479    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:15.335975 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:15.335642    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:15.336068 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:15.336040    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:15.336177 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:15.336160    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:15.336250 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:15.336214    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:15.336311 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:15.336296    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:17.015954 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:17.015916    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:17.016395 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:17.015977    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:17.016395 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:17.016128    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:17.016395 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:17.016186    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret podName:06db9d0f-e643-4348-9df1-b54c26f693f3 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:25.016169191 +0000 UTC m=+17.195040146 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret") pod "global-pull-secret-syncer-4466q" (UID: "06db9d0f-e643-4348-9df1-b54c26f693f3") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:17.016654 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:17.016629    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:17.016789 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:17.016697    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs podName:e9f71b5f-be1f-493b-8ae3-db948077c752 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:25.016679719 +0000 UTC m=+17.195550675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs") pod "network-metrics-daemon-gk7qs" (UID: "e9f71b5f-be1f-493b-8ae3-db948077c752") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:17.117698 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:17.116989    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwww\" (UniqueName: \"kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww\") pod \"network-check-target-mddq4\" (UID: \"10370cf5-b94e-4c16-83d2-c37d19fcbf44\") " pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:17.117698 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:17.117207    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:58:17.117698 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:17.117229    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:58:17.117698 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:17.117241    2585 projected.go:196] Error preparing data for projected volume kube-api-access-btwww for pod openshift-network-diagnostics/network-check-target-mddq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:17.117698 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:17.117301    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww podName:10370cf5-b94e-4c16-83d2-c37d19fcbf44 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:25.117283236 +0000 UTC m=+17.296154192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-btwww" (UniqueName: "kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww") pod "network-check-target-mddq4" (UID: "10370cf5-b94e-4c16-83d2-c37d19fcbf44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:17.336001 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:17.335942    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:17.336179 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:17.335951    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:17.336179 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:17.336076    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:17.336179 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:17.336107    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:17.336328 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:17.336203    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:17.336328 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:17.336288    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:19.336217 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:19.335981    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:19.336659 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:19.335989    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:19.336659 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:19.336245    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:19.336659 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:19.336328    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:19.336659 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:19.336005    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:19.336659 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:19.336399    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:21.335621 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:21.335582    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:21.335621 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:21.335606    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:21.336115 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:21.335625    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:21.336115 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:21.335706    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:21.336115 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:21.335775    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:21.336115 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:21.335880    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:23.335519 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:23.335486    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:23.335937 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:23.335611    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:23.335937 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:23.335622    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:23.335937 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:23.335648    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:23.335937 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:23.335752    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:23.335937 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:23.335831    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:25.075525 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:25.075502    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:25.075889 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:25.075555    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:25.075889 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:25.075663    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:25.075889 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:25.075721    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs podName:e9f71b5f-be1f-493b-8ae3-db948077c752 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:41.075705914 +0000 UTC m=+33.254576856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs") pod "network-metrics-daemon-gk7qs" (UID: "e9f71b5f-be1f-493b-8ae3-db948077c752") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:25.075889 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:25.075663    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:25.075889 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:25.075838    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret podName:06db9d0f-e643-4348-9df1-b54c26f693f3 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:41.075814544 +0000 UTC m=+33.254685498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret") pod "global-pull-secret-syncer-4466q" (UID: "06db9d0f-e643-4348-9df1-b54c26f693f3") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:25.176781 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:25.176697    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwww\" (UniqueName: \"kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww\") pod \"network-check-target-mddq4\" (UID: \"10370cf5-b94e-4c16-83d2-c37d19fcbf44\") " pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:25.176931 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:25.176878    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:58:25.176931 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:25.176902    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:58:25.176931 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:25.176913    2585 projected.go:196] Error preparing data for projected volume kube-api-access-btwww for pod openshift-network-diagnostics/network-check-target-mddq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:25.177063 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:25.176973    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww podName:10370cf5-b94e-4c16-83d2-c37d19fcbf44 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:41.176958338 +0000 UTC m=+33.355829295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-btwww" (UniqueName: "kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww") pod "network-check-target-mddq4" (UID: "10370cf5-b94e-4c16-83d2-c37d19fcbf44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:25.335576 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:25.335528    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:25.335727 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:25.335589    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:25.335727 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:25.335589    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:25.335727 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:25.335666    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:25.335887 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:25.335807    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:25.335926 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:25.335893    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:27.336011 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:27.335975    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:27.336011 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:27.335994    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:27.336461 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:27.335990    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:27.336461 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:27.336091    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:27.336461 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:27.336196    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:27.336461 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:27.336288    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:29.335836 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.335547    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:29.335836 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.335820    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:29.336578 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:29.335924    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:29.336578 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:29.336061    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:29.336578 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.336122    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:29.336578 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:29.336215    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:29.489813 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.489228    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2gkn6" event={"ID":"54a85272-748c-47b2-9725-e51e37b82c38","Type":"ContainerStarted","Data":"5ff8c63858df8d2c376b11114e44eb8d4d8ad25bf2389be4156bcb6c7c1326ab"}
Sep 10 22:58:29.491712 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.491473    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bs529" event={"ID":"7b30ce23-27fa-474a-bc25-f0dc91a16892","Type":"ContainerStarted","Data":"a628d4042bc57ded4051add85ae09399bcfc62b6164a07f0135b5d02739aa33f"}
Sep 10 22:58:29.493495 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.493467    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dptvg" event={"ID":"1e378e8e-e4df-467d-9818-b56e92facd83","Type":"ContainerStarted","Data":"a5769c5a0ae6fdbb1550fcb8d623b40a6d92170a80403acc954ce827b7039079"}
Sep 10 22:58:29.495881 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.495707    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gpfz2" event={"ID":"ec5bfab7-ffcf-4288-8c96-21f8fee22ab0","Type":"ContainerStarted","Data":"57709f7f8c2c30ead72c06107062a3b5fa3900998af4708d767e9f87dce68470"}
Sep 10 22:58:29.498586 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.498537    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt" event={"ID":"d9d6f944-f297-432d-9ae8-c834829345f9","Type":"ContainerStarted","Data":"ae9df863003fb964d67a80137b2e636b75a3c68d6b6ef0603c96e6c52766fcb9"}
Sep 10 22:58:29.501107 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.501080    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w6hsh" event={"ID":"51782331-1214-4d02-bab5-14943abb3cc9","Type":"ContainerStarted","Data":"bc168d55df232a73187ae0987972c4e5aa3049c1b0446a5be411e4f349132c62"}
Sep 10 22:58:29.503016 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.502987    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fkrjd" event={"ID":"c681d59b-784f-4e80-94b7-95040c092c61","Type":"ContainerStarted","Data":"57337a50cd348df7906db569e42c9075fbc04595d8e69a7f0f69b4cd4d10b723"}
Sep 10 22:58:29.511588 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.511532    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 22:58:29.511935 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.511911    2585 generic.go:356] "Generic (PLEG): container finished" podID="d0caf2e2-7da3-4afa-9086-8c4e6f351c39" containerID="b5229243f1ca4a019f9725b3fda3ee8f062f21d30611bc83df05692df9a15995" exitCode=1
Sep 10 22:58:29.512083 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.511982    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr" event={"ID":"d0caf2e2-7da3-4afa-9086-8c4e6f351c39","Type":"ContainerStarted","Data":"83b3711b763edbd685d66424c5c441a9ebc3802c8465a123f4df753ffaf90b24"}
Sep 10 22:58:29.512156 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.512101    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr" event={"ID":"d0caf2e2-7da3-4afa-9086-8c4e6f351c39","Type":"ContainerStarted","Data":"a4421821c79bd29248842ec12a417600c24a10721e18fda0d3f972b5f42cd414"}
Sep 10 22:58:29.512314 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.512296    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr" event={"ID":"d0caf2e2-7da3-4afa-9086-8c4e6f351c39","Type":"ContainerStarted","Data":"0386a7355ee6f7441ef7be4a2f476ec7a77fce126b3ef013e53148b72974cf9e"}
Sep 10 22:58:29.512376 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.512351    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr" event={"ID":"d0caf2e2-7da3-4afa-9086-8c4e6f351c39","Type":"ContainerStarted","Data":"cd14c3d089f630da43869e5a7b5c7da679c207af869a8542b9a7604b7c3bd182"}
Sep 10 22:58:29.512429 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.512398    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr" event={"ID":"d0caf2e2-7da3-4afa-9086-8c4e6f351c39","Type":"ContainerDied","Data":"b5229243f1ca4a019f9725b3fda3ee8f062f21d30611bc83df05692df9a15995"}
Sep 10 22:58:29.512479 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.512457    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr" event={"ID":"d0caf2e2-7da3-4afa-9086-8c4e6f351c39","Type":"ContainerStarted","Data":"52818d6f89cd1610f7ecf249aba9005a4a682b46defcb83d961dfdbc832e3131"}
Sep 10 22:58:29.513713 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.513686    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" event={"ID":"bf335cd7b290e6c7b4dcfcf7665c5ecf","Type":"ContainerStarted","Data":"d0327e0e48b99a6fa967690833f50019b4f35085dfdf75c26a7d554c6cae4594"}
Sep 10 22:58:29.515587 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.515551    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal" event={"ID":"22eaeaa462a93868d0fc1004d0e57ae7","Type":"ContainerStarted","Data":"15eb265b9ed3916dc58e5df690fbbd86eaeb525ec547aeafb16ac1c692972023"}
Sep 10 22:58:29.527872 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.527828    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fkrjd" podStartSLOduration=2.6657745889999998 podStartE2EDuration="21.527815126s" totalImagesPullingTime="18.862040537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:58:29.527496471 +0000 UTC m=+21.706367434" watchObservedRunningTime="2026-09-10 22:58:29.527815126 +0000 UTC m=+21.706686090"
Sep 10 22:58:29.527963 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.527908    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2gkn6" podStartSLOduration=2.676419292 podStartE2EDuration="21.527901011s" totalImagesPullingTime="18.851481719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:58:29.51327854 +0000 UTC m=+21.692149504" watchObservedRunningTime="2026-09-10 22:58:29.527901011 +0000 UTC m=+21.706771975"
Sep 10 22:58:29.550113 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.550075    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bs529" podStartSLOduration=2.202075155 podStartE2EDuration="21.550061168s" totalImagesPullingTime="19.347986013s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:58:29.549863833 +0000 UTC m=+21.728734797" watchObservedRunningTime="2026-09-10 22:58:29.550061168 +0000 UTC m=+21.728932131"
Sep 10 22:58:29.599876 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.599822    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w6hsh" podStartSLOduration=2.645814789 podStartE2EDuration="21.59980498s" totalImagesPullingTime="18.953990191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:58:29.572204258 +0000 UTC m=+21.751075221" watchObservedRunningTime="2026-09-10 22:58:29.59980498 +0000 UTC m=+21.778675997"
Sep 10 22:58:29.600006 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.599953    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gpfz2" podStartSLOduration=2.681635098 podStartE2EDuration="21.599948454s" totalImagesPullingTime="18.918313356s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:58:29.599467496 +0000 UTC m=+21.778338459" watchObservedRunningTime="2026-09-10 22:58:29.599948454 +0000 UTC m=+21.778819417"
Sep 10 22:58:29.661998 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:29.661951    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-139.ec2.internal" podStartSLOduration=20.661936763 podStartE2EDuration="20.661936763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:58:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:58:29.661882439 +0000 UTC m=+21.840753402" watchObservedRunningTime="2026-09-10 22:58:29.661936763 +0000 UTC m=+21.840807726"
Sep 10 22:58:30.519026 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:30.518955    2585 generic.go:356] "Generic (PLEG): container finished" podID="1e378e8e-e4df-467d-9818-b56e92facd83" containerID="a5769c5a0ae6fdbb1550fcb8d623b40a6d92170a80403acc954ce827b7039079" exitCode=0
Sep 10 22:58:30.519748 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:30.519033    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dptvg" event={"ID":"1e378e8e-e4df-467d-9818-b56e92facd83","Type":"ContainerDied","Data":"a5769c5a0ae6fdbb1550fcb8d623b40a6d92170a80403acc954ce827b7039079"}
Sep 10 22:58:30.520970 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:30.520951    2585 generic.go:356] "Generic (PLEG): container finished" podID="bf335cd7b290e6c7b4dcfcf7665c5ecf" containerID="d0327e0e48b99a6fa967690833f50019b4f35085dfdf75c26a7d554c6cae4594" exitCode=0
Sep 10 22:58:30.521077 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:30.521054    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" event={"ID":"bf335cd7b290e6c7b4dcfcf7665c5ecf","Type":"ContainerDied","Data":"d0327e0e48b99a6fa967690833f50019b4f35085dfdf75c26a7d554c6cae4594"}
Sep 10 22:58:30.522673 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:30.522652    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pfk49" event={"ID":"63b9e3c1-1e51-42d9-b125-fd13cbaaa329","Type":"ContainerStarted","Data":"5f9b1c77b9b1f63d210d5d6a9ec2bfe442465da949ddd46fef0530c805827988"}
Sep 10 22:58:30.949783 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:30.949761    2585 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 22:58:31.303734 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:31.303574    2585 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T22:58:30.949779303Z","UUID":"744870c4-5681-46f8-8d2a-44c662849b52","Handler":null,"Name":"","Endpoint":""}
Sep 10 22:58:31.305284 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:31.305260    2585 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 22:58:31.305405 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:31.305297    2585 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 22:58:31.335884 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:31.335853    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:31.336019 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:31.335971    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:31.336019 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:31.335983    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:31.336019 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:31.335995    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:31.336177 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:31.336089    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:31.336177 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:31.336152    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:31.531084 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:31.531058    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 22:58:31.531635 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:31.531532    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr" event={"ID":"d0caf2e2-7da3-4afa-9086-8c4e6f351c39","Type":"ContainerStarted","Data":"e87f433ebea185d2fc1f99846add53b6e1486685c61593e3c66f2639d91dce3f"}
Sep 10 22:58:31.536054 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:31.535363    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" event={"ID":"bf335cd7b290e6c7b4dcfcf7665c5ecf","Type":"ContainerStarted","Data":"80c2edd2c777bf3140cf18289f17e5e039457f6c81c6b816a0b3c26dfa739281"}
Sep 10 22:58:31.539210 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:31.539182    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt" event={"ID":"d9d6f944-f297-432d-9ae8-c834829345f9","Type":"ContainerStarted","Data":"cc8e1f80b54ae9717c1cf9038350982e2f965b92528a77d0fa5fe80599b66054"}
Sep 10 22:58:31.555428 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:31.555336    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pfk49" podStartSLOduration=4.6912692929999995 podStartE2EDuration="23.555299259s" totalImagesPullingTime="18.864029966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:58:30.584392274 +0000 UTC m=+22.763263237" watchObservedRunningTime="2026-09-10 22:58:31.555299259 +0000 UTC m=+23.734170224"
Sep 10 22:58:32.544516 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:32.544166    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt" event={"ID":"d9d6f944-f297-432d-9ae8-c834829345f9","Type":"ContainerStarted","Data":"0405aad1df3b16f4d904664fe9f14709c0a1d1705468581e9c1b5d714dd56f27"}
Sep 10 22:58:32.566341 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:32.565554    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-139.ec2.internal" podStartSLOduration=23.565532029 podStartE2EDuration="23.565532029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:58:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:58:31.555690136 +0000 UTC m=+23.734561099" watchObservedRunningTime="2026-09-10 22:58:32.565532029 +0000 UTC m=+24.744403005"
Sep 10 22:58:32.804090 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:32.804004    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w6hsh"
Sep 10 22:58:32.804658 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:32.804629    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w6hsh"
Sep 10 22:58:32.823198 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:32.823151    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xkmt" podStartSLOduration=3.353425132 podStartE2EDuration="24.823131607s" totalImagesPullingTime="21.469706475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:58:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:58:32.566094069 +0000 UTC m=+24.744965024" watchObservedRunningTime="2026-09-10 22:58:32.823131607 +0000 UTC m=+25.002002569"
Sep 10 22:58:33.335654 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:33.335607    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:33.335823 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:33.335663    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:33.335823 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:33.335617    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:33.335823 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:33.335737    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:33.336012 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:33.335831    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:33.336012 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:33.335910    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:33.546754 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:33.546681    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w6hsh"
Sep 10 22:58:33.547201 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:33.547077    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w6hsh"
Sep 10 22:58:35.335393 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:35.335360    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:35.335854 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:35.335457    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:35.335854 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:35.335464    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:35.335854 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:35.335486    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:35.335854 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:35.335594    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:35.335854 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:35.335669    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:35.552241 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:35.552060    2585 generic.go:356] "Generic (PLEG): container finished" podID="1e378e8e-e4df-467d-9818-b56e92facd83" containerID="fc5580e5455a07bc92991a7afd245af31d85a76c877eaca3f08409172b6d4a24" exitCode=0
Sep 10 22:58:35.552404 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:35.552151    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dptvg" event={"ID":"1e378e8e-e4df-467d-9818-b56e92facd83","Type":"ContainerDied","Data":"fc5580e5455a07bc92991a7afd245af31d85a76c877eaca3f08409172b6d4a24"}
Sep 10 22:58:35.556038 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:35.556023    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 22:58:35.556379 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:35.556356    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr" event={"ID":"d0caf2e2-7da3-4afa-9086-8c4e6f351c39","Type":"ContainerStarted","Data":"2cfd7524e1ef5c6b76cfaf1147ad5649219e47718ef336da5a78073511398d79"}
Sep 10 22:58:35.556805 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:35.556788    2585 scope.go:117] "RemoveContainer" containerID="b5229243f1ca4a019f9725b3fda3ee8f062f21d30611bc83df05692df9a15995"
Sep 10 22:58:36.562900 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:36.562822    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 22:58:36.563493 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:36.563251    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr" event={"ID":"d0caf2e2-7da3-4afa-9086-8c4e6f351c39","Type":"ContainerStarted","Data":"b8160a16d4a36999419d30ae7150c1627d84cb04c14f9a959f10eca8771b25c4"}
Sep 10 22:58:36.563737 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:36.563702    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:36.563853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:36.563788    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:36.563853 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:36.563842    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:36.565977 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:36.565954    2585 generic.go:356] "Generic (PLEG): container finished" podID="1e378e8e-e4df-467d-9818-b56e92facd83" containerID="80d3374c441ed20c5dd6a320c90e7871e8ebdf9f8de144e9a9d7bce8af6d472f" exitCode=0
Sep 10 22:58:36.566076 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:36.565999    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dptvg" event={"ID":"1e378e8e-e4df-467d-9818-b56e92facd83","Type":"ContainerDied","Data":"80d3374c441ed20c5dd6a320c90e7871e8ebdf9f8de144e9a9d7bce8af6d472f"}
Sep 10 22:58:36.579275 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:36.579257    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:36.579503 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:36.579482    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:58:36.599906 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:36.599843    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr" podStartSLOduration=9.415681873 podStartE2EDuration="28.599824096s" totalImagesPullingTime="19.184142223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:58:36.598473593 +0000 UTC m=+28.777344573" watchObservedRunningTime="2026-09-10 22:58:36.599824096 +0000 UTC m=+28.778695067"
Sep 10 22:58:37.100930 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:37.100877    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4466q"]
Sep 10 22:58:37.101131 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:37.101060    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:37.101207 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:37.101177    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:37.104037 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:37.103990    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mddq4"]
Sep 10 22:58:37.104149 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:37.104125    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:37.104233 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:37.104212    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:37.104709 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:37.104685    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gk7qs"]
Sep 10 22:58:37.104815 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:37.104794    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:37.104932 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:37.104907    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:37.571580 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:37.571346    2585 generic.go:356] "Generic (PLEG): container finished" podID="1e378e8e-e4df-467d-9818-b56e92facd83" containerID="ea28f3afc9a435b396e1c942b191d34a3adaf8ed41ebdcca3c82863229581b79" exitCode=0
Sep 10 22:58:37.571580 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:37.571422    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dptvg" event={"ID":"1e378e8e-e4df-467d-9818-b56e92facd83","Type":"ContainerDied","Data":"ea28f3afc9a435b396e1c942b191d34a3adaf8ed41ebdcca3c82863229581b79"}
Sep 10 22:58:38.335909 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:38.335864    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:38.336119 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:38.335981    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:38.336119 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:38.336035    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:38.336227 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:38.336144    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:39.335338 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:39.335258    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:39.335793 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:39.335383    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:40.335909 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:40.335814    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:40.335909 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:40.335844    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:40.336385 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:40.335970    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gk7qs" podUID="e9f71b5f-be1f-493b-8ae3-db948077c752"
Sep 10 22:58:40.336385 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:40.336067    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mddq4" podUID="10370cf5-b94e-4c16-83d2-c37d19fcbf44"
Sep 10 22:58:41.089706 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.089671    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:41.089911 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.089734    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:41.089911 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:41.089841    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:41.090011 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:41.089913    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs podName:e9f71b5f-be1f-493b-8ae3-db948077c752 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:13.089891417 +0000 UTC m=+65.268762374 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs") pod "network-metrics-daemon-gk7qs" (UID: "e9f71b5f-be1f-493b-8ae3-db948077c752") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:58:41.090011 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:41.089848    2585 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:41.090011 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:41.089987    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret podName:06db9d0f-e643-4348-9df1-b54c26f693f3 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:13.089969787 +0000 UTC m=+65.268840732 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret") pod "global-pull-secret-syncer-4466q" (UID: "06db9d0f-e643-4348-9df1-b54c26f693f3") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:58:41.190324 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.190280    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwww\" (UniqueName: \"kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww\") pod \"network-check-target-mddq4\" (UID: \"10370cf5-b94e-4c16-83d2-c37d19fcbf44\") " pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:41.190547 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:41.190436    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:58:41.190547 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:41.190459    2585 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:58:41.190547 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:41.190473    2585 projected.go:196] Error preparing data for projected volume kube-api-access-btwww for pod openshift-network-diagnostics/network-check-target-mddq4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:41.190547 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:41.190539    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww podName:10370cf5-b94e-4c16-83d2-c37d19fcbf44 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:13.190519776 +0000 UTC m=+65.369390732 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-btwww" (UniqueName: "kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww") pod "network-check-target-mddq4" (UID: "10370cf5-b94e-4c16-83d2-c37d19fcbf44") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:58:41.335755 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.335720    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:41.336062 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:41.335836    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4466q" podUID="06db9d0f-e643-4348-9df1-b54c26f693f3"
Sep 10 22:58:41.589521 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.589493    2585 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-139.ec2.internal" event="NodeReady"
Sep 10 22:58:41.589676 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.589668    2585 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 22:58:41.641550 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.641514    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xz27k"]
Sep 10 22:58:41.653477 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.653455    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ngpz6"]
Sep 10 22:58:41.653619 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.653601    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:41.656307 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.656287    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 22:58:41.656423 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.656287    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-677w4\""
Sep 10 22:58:41.656423 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.656293    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 22:58:41.669944 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.669920    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xz27k"]
Sep 10 22:58:41.670036 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.669969    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ngpz6"]
Sep 10 22:58:41.670075 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.670031    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ngpz6"
Sep 10 22:58:41.672426 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.672403    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 22:58:41.672540 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.672443    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 22:58:41.672740 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.672726    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2sqgd\""
Sep 10 22:58:41.672829 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.672811    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 22:58:41.795360 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.795274    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-config-volume\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:41.795360 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.795351    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8vtd\" (UniqueName: \"kubernetes.io/projected/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-kube-api-access-h8vtd\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:41.795532 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.795370    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-tmp-dir\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:41.795532 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.795385    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcb845f5-719b-4eaf-a17c-9e2d72f32635-cert\") pod \"ingress-canary-ngpz6\" (UID: \"dcb845f5-719b-4eaf-a17c-9e2d72f32635\") " pod="openshift-ingress-canary/ingress-canary-ngpz6"
Sep 10 22:58:41.795532 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.795407    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c8zz\" (UniqueName: \"kubernetes.io/projected/dcb845f5-719b-4eaf-a17c-9e2d72f32635-kube-api-access-2c8zz\") pod \"ingress-canary-ngpz6\" (UID: \"dcb845f5-719b-4eaf-a17c-9e2d72f32635\") " pod="openshift-ingress-canary/ingress-canary-ngpz6"
Sep 10 22:58:41.795532 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.795422    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:41.896684 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.896650    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8vtd\" (UniqueName: \"kubernetes.io/projected/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-kube-api-access-h8vtd\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:41.896684 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.896693    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-tmp-dir\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:41.896921 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.896718    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcb845f5-719b-4eaf-a17c-9e2d72f32635-cert\") pod \"ingress-canary-ngpz6\" (UID: \"dcb845f5-719b-4eaf-a17c-9e2d72f32635\") " pod="openshift-ingress-canary/ingress-canary-ngpz6"
Sep 10 22:58:41.896921 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.896868    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c8zz\" (UniqueName: \"kubernetes.io/projected/dcb845f5-719b-4eaf-a17c-9e2d72f32635-kube-api-access-2c8zz\") pod \"ingress-canary-ngpz6\" (UID: \"dcb845f5-719b-4eaf-a17c-9e2d72f32635\") " pod="openshift-ingress-canary/ingress-canary-ngpz6"
Sep 10 22:58:41.896921 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.896913    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:41.897060 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.896945    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-config-volume\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:41.897060 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.897029    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-tmp-dir\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:41.897141 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:41.897116    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:58:41.897187 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:41.897174    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls podName:37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:42.397154201 +0000 UTC m=+34.576025157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls") pod "dns-default-xz27k" (UID: "37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2") : secret "dns-default-metrics-tls" not found
Sep 10 22:58:41.897431 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.897411    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-config-volume\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:41.900951 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.900928    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dcb845f5-719b-4eaf-a17c-9e2d72f32635-cert\") pod \"ingress-canary-ngpz6\" (UID: \"dcb845f5-719b-4eaf-a17c-9e2d72f32635\") " pod="openshift-ingress-canary/ingress-canary-ngpz6"
Sep 10 22:58:41.907127 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.907105    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c8zz\" (UniqueName: \"kubernetes.io/projected/dcb845f5-719b-4eaf-a17c-9e2d72f32635-kube-api-access-2c8zz\") pod \"ingress-canary-ngpz6\" (UID: \"dcb845f5-719b-4eaf-a17c-9e2d72f32635\") " pod="openshift-ingress-canary/ingress-canary-ngpz6"
Sep 10 22:58:41.907795 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.907779    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8vtd\" (UniqueName: \"kubernetes.io/projected/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-kube-api-access-h8vtd\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:41.978533 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:41.978508    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ngpz6"
Sep 10 22:58:42.292249 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:42.292088    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ngpz6"]
Sep 10 22:58:42.295684 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:58:42.295655    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcb845f5_719b_4eaf_a17c_9e2d72f32635.slice/crio-3824504d999c2927a9e091a694ed3796bcc8348a717cea6c3ccb43039b57091e WatchSource:0}: Error finding container 3824504d999c2927a9e091a694ed3796bcc8348a717cea6c3ccb43039b57091e: Status 404 returned error can't find the container with id 3824504d999c2927a9e091a694ed3796bcc8348a717cea6c3ccb43039b57091e
Sep 10 22:58:42.336070 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:42.336038    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:58:42.336415 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:42.336076    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:58:42.339096 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:42.339078    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 22:58:42.339096 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:42.339092    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 22:58:42.339256 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:42.339131    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 22:58:42.339835 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:42.339818    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hw9xb\""
Sep 10 22:58:42.339885 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:42.339838    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xmnrw\""
Sep 10 22:58:42.401630 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:42.401597    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:42.401813 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:42.401768    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:58:42.401876 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:42.401841    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls podName:37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:43.401821051 +0000 UTC m=+35.580692004 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls") pod "dns-default-xz27k" (UID: "37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2") : secret "dns-default-metrics-tls" not found
Sep 10 22:58:42.585609 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:42.585510    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ngpz6" event={"ID":"dcb845f5-719b-4eaf-a17c-9e2d72f32635","Type":"ContainerStarted","Data":"3824504d999c2927a9e091a694ed3796bcc8348a717cea6c3ccb43039b57091e"}
Sep 10 22:58:42.588166 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:42.588143    2585 generic.go:356] "Generic (PLEG): container finished" podID="1e378e8e-e4df-467d-9818-b56e92facd83" containerID="524b030bdcd9d049e8d47a386f79901bd7359d3b63a356c1f3005a5bc3933b21" exitCode=0
Sep 10 22:58:42.588286 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:42.588187    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dptvg" event={"ID":"1e378e8e-e4df-467d-9818-b56e92facd83","Type":"ContainerDied","Data":"524b030bdcd9d049e8d47a386f79901bd7359d3b63a356c1f3005a5bc3933b21"}
Sep 10 22:58:43.335149 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:43.335067    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:58:43.338273 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:43.338247    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 22:58:43.411176 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:43.411143    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:43.411350 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:43.411277    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:58:43.411415 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:43.411359    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls podName:37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:45.411328571 +0000 UTC m=+37.590199518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls") pod "dns-default-xz27k" (UID: "37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2") : secret "dns-default-metrics-tls" not found
Sep 10 22:58:43.593819 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:43.593746    2585 generic.go:356] "Generic (PLEG): container finished" podID="1e378e8e-e4df-467d-9818-b56e92facd83" containerID="08cf55d582ae889ec8f7978f8b067780090f3c43842779bf631f29f71dc78578" exitCode=0
Sep 10 22:58:43.593819 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:43.593785    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dptvg" event={"ID":"1e378e8e-e4df-467d-9818-b56e92facd83","Type":"ContainerDied","Data":"08cf55d582ae889ec8f7978f8b067780090f3c43842779bf631f29f71dc78578"}
Sep 10 22:58:44.599292 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:44.599249    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dptvg" event={"ID":"1e378e8e-e4df-467d-9818-b56e92facd83","Type":"ContainerStarted","Data":"7dbe631257a88f7cb93fefa03ad7c6e567ea4c6ec476b39e2e23559f00af6a15"}
Sep 10 22:58:44.633935 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:44.633891    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dptvg" podStartSLOduration=7.977266664 podStartE2EDuration="36.633876561s" totalImagesPullingTime="28.656609897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:58:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:58:44.626338281 +0000 UTC m=+36.805209243" watchObservedRunningTime="2026-09-10 22:58:44.633876561 +0000 UTC m=+36.812747524"
Sep 10 22:58:45.427132 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:45.427090    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:45.427288 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:45.427221    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:58:45.427288 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:45.427277    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls podName:37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:49.427262296 +0000 UTC m=+41.606133254 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls") pod "dns-default-xz27k" (UID: "37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2") : secret "dns-default-metrics-tls" not found
Sep 10 22:58:45.603188 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:45.603148    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ngpz6" event={"ID":"dcb845f5-719b-4eaf-a17c-9e2d72f32635","Type":"ContainerStarted","Data":"3479621c1a6186425e4a2729e3cb0692ef8be2eb4bbc53e7c6db4c69791c19f8"}
Sep 10 22:58:45.620617 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:45.620554    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ngpz6" podStartSLOduration=2.123528309 podStartE2EDuration="4.620538817s" totalImagesPullingTime="2.497010508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:58:45.619998166 +0000 UTC m=+37.798869129" watchObservedRunningTime="2026-09-10 22:58:45.620538817 +0000 UTC m=+37.799409781"
Sep 10 22:58:49.457980 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:49.457936    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:49.458360 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:49.458086    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:58:49.458360 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:49.458153    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls podName:37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2 nodeName:}" failed. No retries permitted until 2026-09-10 22:58:57.458135881 +0000 UTC m=+49.637006821 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls") pod "dns-default-xz27k" (UID: "37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2") : secret "dns-default-metrics-tls" not found
Sep 10 22:58:57.512662 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:58:57.512628    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:58:57.513150 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:57.512730    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:58:57.513150 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:58:57.512783    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls podName:37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:13.512770606 +0000 UTC m=+65.691641561 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls") pod "dns-default-xz27k" (UID: "37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2") : secret "dns-default-metrics-tls" not found
Sep 10 22:59:08.584775 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:08.584747    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-48wjr"
Sep 10 22:59:13.121386 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.121346    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:59:13.121810 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.121422    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 22:59:13.124343 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.124326    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 22:59:13.124395 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.124352    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 22:59:13.131593 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:13.131571    2585 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 10 22:59:13.131683 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:13.131629    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs podName:e9f71b5f-be1f-493b-8ae3-db948077c752 nodeName:}" failed. No retries permitted until 2026-09-10 23:00:17.13161435 +0000 UTC m=+129.310485304 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs") pod "network-metrics-daemon-gk7qs" (UID: "e9f71b5f-be1f-493b-8ae3-db948077c752") : secret "metrics-daemon-secret" not found
Sep 10 22:59:13.134473 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.134450    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/06db9d0f-e643-4348-9df1-b54c26f693f3-original-pull-secret\") pod \"global-pull-secret-syncer-4466q\" (UID: \"06db9d0f-e643-4348-9df1-b54c26f693f3\") " pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:59:13.221843 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.221802    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btwww\" (UniqueName: \"kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww\") pod \"network-check-target-mddq4\" (UID: \"10370cf5-b94e-4c16-83d2-c37d19fcbf44\") " pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:59:13.225419 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.225402    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 22:59:13.235283 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.235263    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 22:59:13.245009 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.244988    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btwww\" (UniqueName: \"kubernetes.io/projected/10370cf5-b94e-4c16-83d2-c37d19fcbf44-kube-api-access-btwww\") pod \"network-check-target-mddq4\" (UID: \"10370cf5-b94e-4c16-83d2-c37d19fcbf44\") " pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:59:13.254300 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.254274    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xmnrw\""
Sep 10 22:59:13.261083 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.261064    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:59:13.347087 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.347064    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4466q"
Sep 10 22:59:13.416302 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.416274    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-dfl96"]
Sep 10 22:59:13.418705 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.418688    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.421116 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.421096    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 10 22:59:13.421906 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.421746    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 10 22:59:13.421906 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.421829    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 10 22:59:13.421906 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.421863    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-dplqh\""
Sep 10 22:59:13.422132 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.422025    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:59:13.427511 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.427494    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 10 22:59:13.436054 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.436028    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-dfl96"]
Sep 10 22:59:13.524175 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.524139    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc6adc43-c475-4abd-ba1a-5bba5d3f2235-serving-cert\") pod \"console-operator-696884fb9c-dfl96\" (UID: \"bc6adc43-c475-4abd-ba1a-5bba5d3f2235\") " pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.524175 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.524173    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bc6adc43-c475-4abd-ba1a-5bba5d3f2235-trusted-ca\") pod \"console-operator-696884fb9c-dfl96\" (UID: \"bc6adc43-c475-4abd-ba1a-5bba5d3f2235\") " pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.524424 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.524212    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc6adc43-c475-4abd-ba1a-5bba5d3f2235-config\") pod \"console-operator-696884fb9c-dfl96\" (UID: \"bc6adc43-c475-4abd-ba1a-5bba5d3f2235\") " pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.524424 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.524229    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ft875\" (UniqueName: \"kubernetes.io/projected/bc6adc43-c475-4abd-ba1a-5bba5d3f2235-kube-api-access-ft875\") pod \"console-operator-696884fb9c-dfl96\" (UID: \"bc6adc43-c475-4abd-ba1a-5bba5d3f2235\") " pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.524424 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.524279    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:59:13.524424 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:13.524389    2585 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:59:13.524649 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:13.524476    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls podName:37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:45.524453569 +0000 UTC m=+97.703324510 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls") pod "dns-default-xz27k" (UID: "37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2") : secret "dns-default-metrics-tls" not found
Sep 10 22:59:13.550378 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.550346    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mddq4"]
Sep 10 22:59:13.554275 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:59:13.554253    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10370cf5_b94e_4c16_83d2_c37d19fcbf44.slice/crio-b7091d8c1fcd6a3faf7de2feb479eb253d92a582935b3047c8a693deb7d738f9 WatchSource:0}: Error finding container b7091d8c1fcd6a3faf7de2feb479eb253d92a582935b3047c8a693deb7d738f9: Status 404 returned error can't find the container with id b7091d8c1fcd6a3faf7de2feb479eb253d92a582935b3047c8a693deb7d738f9
Sep 10 22:59:13.611103 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.611070    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-lg2tg"]
Sep 10 22:59:13.613326 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.613310    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5dbbc657dd-v7w6k"]
Sep 10 22:59:13.613439 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.613422    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.615430 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.615410    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.615723 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.615649    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 10 22:59:13.615978 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.615908    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 10 22:59:13.615978 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.615929    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 22:59:13.615978 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.615949    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 22:59:13.616156 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.616049    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nbth5\""
Sep 10 22:59:13.617600 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.617583    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 10 22:59:13.617698 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.617676    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 10 22:59:13.618051 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.618030    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 10 22:59:13.618286 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.618030    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 22:59:13.618286 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.618278    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 22:59:13.618663 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.618348    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 10 22:59:13.618729 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.618663    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rqhkl\""
Sep 10 22:59:13.619632 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.619610    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4466q"]
Sep 10 22:59:13.621395 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.621116    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 10 22:59:13.623106 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:59:13.623075    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06db9d0f_e643_4348_9df1_b54c26f693f3.slice/crio-e31dcd5cfe1e1928929419ed5356e8afd33b69df30a350dbaa2618a5b08e3f07 WatchSource:0}: Error finding container e31dcd5cfe1e1928929419ed5356e8afd33b69df30a350dbaa2618a5b08e3f07: Status 404 returned error can't find the container with id e31dcd5cfe1e1928929419ed5356e8afd33b69df30a350dbaa2618a5b08e3f07
Sep 10 22:59:13.624256 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.624236    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-lg2tg"]
Sep 10 22:59:13.624697 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.624673    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc6adc43-c475-4abd-ba1a-5bba5d3f2235-config\") pod \"console-operator-696884fb9c-dfl96\" (UID: \"bc6adc43-c475-4abd-ba1a-5bba5d3f2235\") " pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.624791 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.624710    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ft875\" (UniqueName: \"kubernetes.io/projected/bc6adc43-c475-4abd-ba1a-5bba5d3f2235-kube-api-access-ft875\") pod \"console-operator-696884fb9c-dfl96\" (UID: \"bc6adc43-c475-4abd-ba1a-5bba5d3f2235\") " pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.624791 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.624772    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc6adc43-c475-4abd-ba1a-5bba5d3f2235-serving-cert\") pod \"console-operator-696884fb9c-dfl96\" (UID: \"bc6adc43-c475-4abd-ba1a-5bba5d3f2235\") " pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.624898 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.624796    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bc6adc43-c475-4abd-ba1a-5bba5d3f2235-trusted-ca\") pod \"console-operator-696884fb9c-dfl96\" (UID: \"bc6adc43-c475-4abd-ba1a-5bba5d3f2235\") " pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.625390 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.625372    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bc6adc43-c475-4abd-ba1a-5bba5d3f2235-config\") pod \"console-operator-696884fb9c-dfl96\" (UID: \"bc6adc43-c475-4abd-ba1a-5bba5d3f2235\") " pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.625611 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.625589    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bc6adc43-c475-4abd-ba1a-5bba5d3f2235-trusted-ca\") pod \"console-operator-696884fb9c-dfl96\" (UID: \"bc6adc43-c475-4abd-ba1a-5bba5d3f2235\") " pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.627649 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.627629    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dbbc657dd-v7w6k"]
Sep 10 22:59:13.628350 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.628331    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bc6adc43-c475-4abd-ba1a-5bba5d3f2235-serving-cert\") pod \"console-operator-696884fb9c-dfl96\" (UID: \"bc6adc43-c475-4abd-ba1a-5bba5d3f2235\") " pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.637277 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.637257    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ft875\" (UniqueName: \"kubernetes.io/projected/bc6adc43-c475-4abd-ba1a-5bba5d3f2235-kube-api-access-ft875\") pod \"console-operator-696884fb9c-dfl96\" (UID: \"bc6adc43-c475-4abd-ba1a-5bba5d3f2235\") " pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.668270 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.668186    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mddq4" event={"ID":"10370cf5-b94e-4c16-83d2-c37d19fcbf44","Type":"ContainerStarted","Data":"b7091d8c1fcd6a3faf7de2feb479eb253d92a582935b3047c8a693deb7d738f9"}
Sep 10 22:59:13.669331 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.669307    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4466q" event={"ID":"06db9d0f-e643-4348-9df1-b54c26f693f3","Type":"ContainerStarted","Data":"e31dcd5cfe1e1928929419ed5356e8afd33b69df30a350dbaa2618a5b08e3f07"}
Sep 10 22:59:13.725618 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.725583    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.725618 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.725620    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feb57e6c-d860-43e5-b331-5167bbef45fe-tmp\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.725791 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.725644    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-default-certificate\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.725791 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.725708    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7gvk\" (UniqueName: \"kubernetes.io/projected/feb57e6c-d860-43e5-b331-5167bbef45fe-kube-api-access-q7gvk\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.725791 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.725748    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msznx\" (UniqueName: \"kubernetes.io/projected/88dce041-58b1-456d-94ad-ac2f44a11c07-kube-api-access-msznx\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.725791 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.725780    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/feb57e6c-d860-43e5-b331-5167bbef45fe-snapshots\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.725916 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.725817    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb57e6c-d860-43e5-b331-5167bbef45fe-trusted-ca-bundle\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.725916 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.725845    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.725916 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.725903    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb57e6c-d860-43e5-b331-5167bbef45fe-service-ca-bundle\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.726002 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.725921    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/feb57e6c-d860-43e5-b331-5167bbef45fe-serving-cert\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.726002 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.725945    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-stats-auth\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.728588 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.728569    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:13.827011 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.826971    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feb57e6c-d860-43e5-b331-5167bbef45fe-tmp\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.827011 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.827012    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-default-certificate\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.827247 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.827031    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7gvk\" (UniqueName: \"kubernetes.io/projected/feb57e6c-d860-43e5-b331-5167bbef45fe-kube-api-access-q7gvk\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.827247 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.827047    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msznx\" (UniqueName: \"kubernetes.io/projected/88dce041-58b1-456d-94ad-ac2f44a11c07-kube-api-access-msznx\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.827247 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.827064    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/feb57e6c-d860-43e5-b331-5167bbef45fe-snapshots\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.827247 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.827196    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb57e6c-d860-43e5-b331-5167bbef45fe-trusted-ca-bundle\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.827482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.827383    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/feb57e6c-d860-43e5-b331-5167bbef45fe-tmp\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.827482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.827396    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.827482 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.827466    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb57e6c-d860-43e5-b331-5167bbef45fe-service-ca-bundle\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.827660 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:13.827468    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 22:59:13.827660 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.827497    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/feb57e6c-d860-43e5-b331-5167bbef45fe-serving-cert\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.827660 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.827529    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-stats-auth\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.827660 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:13.827549    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs podName:88dce041-58b1-456d-94ad-ac2f44a11c07 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:14.327528387 +0000 UTC m=+66.506399341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs") pod "router-default-5dbbc657dd-v7w6k" (UID: "88dce041-58b1-456d-94ad-ac2f44a11c07") : secret "router-metrics-certs-default" not found
Sep 10 22:59:13.827660 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.827635    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.827902 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:13.827791    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle podName:88dce041-58b1-456d-94ad-ac2f44a11c07 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:14.327775503 +0000 UTC m=+66.506646463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle") pod "router-default-5dbbc657dd-v7w6k" (UID: "88dce041-58b1-456d-94ad-ac2f44a11c07") : configmap references non-existent config key: service-ca.crt
Sep 10 22:59:13.827902 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.827801    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/feb57e6c-d860-43e5-b331-5167bbef45fe-snapshots\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.827998 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.827983    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb57e6c-d860-43e5-b331-5167bbef45fe-service-ca-bundle\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.828173 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.828151    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/feb57e6c-d860-43e5-b331-5167bbef45fe-trusted-ca-bundle\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.829626 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.829601    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-default-certificate\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.830400 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.830379    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/feb57e6c-d860-43e5-b331-5167bbef45fe-serving-cert\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.830499 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.830485    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-stats-auth\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.838054 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.838035    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msznx\" (UniqueName: \"kubernetes.io/projected/88dce041-58b1-456d-94ad-ac2f44a11c07-kube-api-access-msznx\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:13.838323 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.838306    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7gvk\" (UniqueName: \"kubernetes.io/projected/feb57e6c-d860-43e5-b331-5167bbef45fe-kube-api-access-q7gvk\") pod \"insights-operator-5844b856db-lg2tg\" (UID: \"feb57e6c-d860-43e5-b331-5167bbef45fe\") " pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:13.925005 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:13.924924    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-lg2tg"
Sep 10 22:59:14.000549 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:14.000470    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-dfl96"]
Sep 10 22:59:14.004287 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:59:14.004259    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc6adc43_c475_4abd_ba1a_5bba5d3f2235.slice/crio-80bc647e0a6b5517d17c03208ed2f15275777658865f167363b1bd9dd0464017 WatchSource:0}: Error finding container 80bc647e0a6b5517d17c03208ed2f15275777658865f167363b1bd9dd0464017: Status 404 returned error can't find the container with id 80bc647e0a6b5517d17c03208ed2f15275777658865f167363b1bd9dd0464017
Sep 10 22:59:14.205220 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:14.205143    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-lg2tg"]
Sep 10 22:59:14.208796 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:59:14.208756    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb57e6c_d860_43e5_b331_5167bbef45fe.slice/crio-cd8d7bc28baca94e37ac6430a68f66cf5050794de4b66bd42f11b5e27dd7e2ee WatchSource:0}: Error finding container cd8d7bc28baca94e37ac6430a68f66cf5050794de4b66bd42f11b5e27dd7e2ee: Status 404 returned error can't find the container with id cd8d7bc28baca94e37ac6430a68f66cf5050794de4b66bd42f11b5e27dd7e2ee
Sep 10 22:59:14.331281 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:14.331231    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:14.331479 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:14.331322    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:14.331479 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:14.331408    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 22:59:14.331479 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:14.331470    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle podName:88dce041-58b1-456d-94ad-ac2f44a11c07 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:15.331448828 +0000 UTC m=+67.510319771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle") pod "router-default-5dbbc657dd-v7w6k" (UID: "88dce041-58b1-456d-94ad-ac2f44a11c07") : configmap references non-existent config key: service-ca.crt
Sep 10 22:59:14.331684 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:14.331494    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs podName:88dce041-58b1-456d-94ad-ac2f44a11c07 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:15.331482837 +0000 UTC m=+67.510353784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs") pod "router-default-5dbbc657dd-v7w6k" (UID: "88dce041-58b1-456d-94ad-ac2f44a11c07") : secret "router-metrics-certs-default" not found
Sep 10 22:59:14.685744 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:14.685701    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dfl96" event={"ID":"bc6adc43-c475-4abd-ba1a-5bba5d3f2235","Type":"ContainerStarted","Data":"80bc647e0a6b5517d17c03208ed2f15275777658865f167363b1bd9dd0464017"}
Sep 10 22:59:14.687449 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:14.687385    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-lg2tg" event={"ID":"feb57e6c-d860-43e5-b331-5167bbef45fe","Type":"ContainerStarted","Data":"cd8d7bc28baca94e37ac6430a68f66cf5050794de4b66bd42f11b5e27dd7e2ee"}
Sep 10 22:59:15.341606 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:15.341545    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:15.342098 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:15.341661    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:15.342098 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:15.341797    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 22:59:15.342098 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:15.341859    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs podName:88dce041-58b1-456d-94ad-ac2f44a11c07 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:17.341840181 +0000 UTC m=+69.520711126 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs") pod "router-default-5dbbc657dd-v7w6k" (UID: "88dce041-58b1-456d-94ad-ac2f44a11c07") : secret "router-metrics-certs-default" not found
Sep 10 22:59:15.342314 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:15.342293    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle podName:88dce041-58b1-456d-94ad-ac2f44a11c07 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:17.34227664 +0000 UTC m=+69.521147594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle") pod "router-default-5dbbc657dd-v7w6k" (UID: "88dce041-58b1-456d-94ad-ac2f44a11c07") : configmap references non-existent config key: service-ca.crt
Sep 10 22:59:17.358757 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:17.358716    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:17.359237 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:17.358806    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:17.359237 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:17.358941    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle podName:88dce041-58b1-456d-94ad-ac2f44a11c07 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:21.358920595 +0000 UTC m=+73.537791551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle") pod "router-default-5dbbc657dd-v7w6k" (UID: "88dce041-58b1-456d-94ad-ac2f44a11c07") : configmap references non-existent config key: service-ca.crt
Sep 10 22:59:17.359237 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:17.358949    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 22:59:17.359237 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:17.358996    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs podName:88dce041-58b1-456d-94ad-ac2f44a11c07 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:21.358985238 +0000 UTC m=+73.537856190 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs") pod "router-default-5dbbc657dd-v7w6k" (UID: "88dce041-58b1-456d-94ad-ac2f44a11c07") : secret "router-metrics-certs-default" not found
Sep 10 22:59:19.703243 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:19.703189    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mddq4" event={"ID":"10370cf5-b94e-4c16-83d2-c37d19fcbf44","Type":"ContainerStarted","Data":"3fd9122defd91d025b73b1509b9cd9bbda244cc1bfd86295872de52a772588ba"}
Sep 10 22:59:19.703735 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:19.703303    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:59:19.704844 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:19.704813    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4466q" event={"ID":"06db9d0f-e643-4348-9df1-b54c26f693f3","Type":"ContainerStarted","Data":"7da1517563b7cfc3dc24d1b55c549112956c17686646f7a3971a7c63de70e6de"}
Sep 10 22:59:19.706285 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:19.706266    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/0.log"
Sep 10 22:59:19.706400 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:19.706298    2585 generic.go:356] "Generic (PLEG): container finished" podID="bc6adc43-c475-4abd-ba1a-5bba5d3f2235" containerID="7921847877dce2095be749ff7477c9501abfa902caceb7ebc3bdeab75071cfd9" exitCode=255
Sep 10 22:59:19.706400 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:19.706324    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dfl96" event={"ID":"bc6adc43-c475-4abd-ba1a-5bba5d3f2235","Type":"ContainerDied","Data":"7921847877dce2095be749ff7477c9501abfa902caceb7ebc3bdeab75071cfd9"}
Sep 10 22:59:19.706571 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:19.706540    2585 scope.go:117] "RemoveContainer" containerID="7921847877dce2095be749ff7477c9501abfa902caceb7ebc3bdeab75071cfd9"
Sep 10 22:59:19.707935 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:19.707917    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-lg2tg" event={"ID":"feb57e6c-d860-43e5-b331-5167bbef45fe","Type":"ContainerStarted","Data":"3325938a1c31fe0170dfe8a7d8fdce635494884002565efa3a39bc039d5a3570"}
Sep 10 22:59:19.720669 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:19.720613    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mddq4" podStartSLOduration=66.129455766 podStartE2EDuration="1m11.720597716s" totalImagesPullingTime="5.59114195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:59:19.720294623 +0000 UTC m=+71.899165586" watchObservedRunningTime="2026-09-10 22:59:19.720597716 +0000 UTC m=+71.899468681"
Sep 10 22:59:19.738023 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:19.737976    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4466q" podStartSLOduration=66.206332357 podStartE2EDuration="1m11.737962238s" totalImagesPullingTime="5.531629881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:59:19.737905013 +0000 UTC m=+71.916775976" watchObservedRunningTime="2026-09-10 22:59:19.737962238 +0000 UTC m=+71.916833198"
Sep 10 22:59:19.794038 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:19.793825    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-lg2tg" podStartSLOduration=1.858094077 podStartE2EDuration="6.793802959s" totalImagesPullingTime="4.935708882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:59:19.792745541 +0000 UTC m=+71.971616505" watchObservedRunningTime="2026-09-10 22:59:19.793802959 +0000 UTC m=+71.972673923"
Sep 10 22:59:20.242784 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.242748    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8x6kl"]
Sep 10 22:59:20.245868 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.245842    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.248238 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.248207    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 22:59:20.248238 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.248207    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9dvmk\""
Sep 10 22:59:20.248428 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.248261    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 22:59:20.261631 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.261601    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8x6kl"]
Sep 10 22:59:20.282023 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.281988    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ca85274-350b-496c-a38a-0cac6e0bd084-crio-socket\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.282023 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.282025    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ca85274-350b-496c-a38a-0cac6e0bd084-data-volume\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.282215 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.282053    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.282215 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.282072    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.282215 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.282120    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz2dp\" (UniqueName: \"kubernetes.io/projected/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-api-access-nz2dp\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.383191 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.383158    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.383348 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.383225    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz2dp\" (UniqueName: \"kubernetes.io/projected/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-api-access-nz2dp\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.383348 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.383271    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ca85274-350b-496c-a38a-0cac6e0bd084-crio-socket\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.383348 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:20.383287    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:59:20.383483 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.383291    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ca85274-350b-496c-a38a-0cac6e0bd084-data-volume\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.383483 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:20.383358    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm podName:1ca85274-350b-496c-a38a-0cac6e0bd084 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:20.883337052 +0000 UTC m=+73.062208008 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8x6kl" (UID: "1ca85274-350b-496c-a38a-0cac6e0bd084") : configmap "kube-rbac-proxy" not found
Sep 10 22:59:20.383483 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.383397    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ca85274-350b-496c-a38a-0cac6e0bd084-crio-socket\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.383483 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.383422    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.383656 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:20.383526    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:59:20.383656 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:20.383596    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls podName:1ca85274-350b-496c-a38a-0cac6e0bd084 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:20.883579285 +0000 UTC m=+73.062450238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8x6kl" (UID: "1ca85274-350b-496c-a38a-0cac6e0bd084") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:59:20.383656 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.383607    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ca85274-350b-496c-a38a-0cac6e0bd084-data-volume\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.396076 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.396049    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz2dp\" (UniqueName: \"kubernetes.io/projected/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-api-access-nz2dp\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.715671 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.715644    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/1.log"
Sep 10 22:59:20.716071 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.716057    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/0.log"
Sep 10 22:59:20.716111 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.716091    2585 generic.go:356] "Generic (PLEG): container finished" podID="bc6adc43-c475-4abd-ba1a-5bba5d3f2235" containerID="e2281af7a20c35329c4431c5c20704f793416b34a4238d5d703ab53046b94355" exitCode=255
Sep 10 22:59:20.716204 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.716124    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dfl96" event={"ID":"bc6adc43-c475-4abd-ba1a-5bba5d3f2235","Type":"ContainerDied","Data":"e2281af7a20c35329c4431c5c20704f793416b34a4238d5d703ab53046b94355"}
Sep 10 22:59:20.716236 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.716225    2585 scope.go:117] "RemoveContainer" containerID="7921847877dce2095be749ff7477c9501abfa902caceb7ebc3bdeab75071cfd9"
Sep 10 22:59:20.716397 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.716379    2585 scope.go:117] "RemoveContainer" containerID="e2281af7a20c35329c4431c5c20704f793416b34a4238d5d703ab53046b94355"
Sep 10 22:59:20.716571 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:20.716538    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-dfl96_openshift-console-operator(bc6adc43-c475-4abd-ba1a-5bba5d3f2235)\"" pod="openshift-console-operator/console-operator-696884fb9c-dfl96" podUID="bc6adc43-c475-4abd-ba1a-5bba5d3f2235"
Sep 10 22:59:20.887807 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.887764    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.887979 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:20.887889    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:59:20.887979 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:20.887902    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:20.887979 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:20.887956    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm podName:1ca85274-350b-496c-a38a-0cac6e0bd084 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:21.887937002 +0000 UTC m=+74.066807963 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8x6kl" (UID: "1ca85274-350b-496c-a38a-0cac6e0bd084") : configmap "kube-rbac-proxy" not found
Sep 10 22:59:20.888109 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:20.888006    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:59:20.888109 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:20.888043    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls podName:1ca85274-350b-496c-a38a-0cac6e0bd084 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:21.888034022 +0000 UTC m=+74.066904962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8x6kl" (UID: "1ca85274-350b-496c-a38a-0cac6e0bd084") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:59:21.392226 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:21.392195    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:21.392372 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:21.392250    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:21.392372 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:21.392342    2585 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 10 22:59:21.392461 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:21.392354    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle podName:88dce041-58b1-456d-94ad-ac2f44a11c07 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:29.392341083 +0000 UTC m=+81.571212024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle") pod "router-default-5dbbc657dd-v7w6k" (UID: "88dce041-58b1-456d-94ad-ac2f44a11c07") : configmap references non-existent config key: service-ca.crt
Sep 10 22:59:21.392461 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:21.392436    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs podName:88dce041-58b1-456d-94ad-ac2f44a11c07 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:29.392417266 +0000 UTC m=+81.571288211 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs") pod "router-default-5dbbc657dd-v7w6k" (UID: "88dce041-58b1-456d-94ad-ac2f44a11c07") : secret "router-metrics-certs-default" not found
Sep 10 22:59:21.720738 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:21.720662    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/1.log"
Sep 10 22:59:21.721142 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:21.720975    2585 scope.go:117] "RemoveContainer" containerID="e2281af7a20c35329c4431c5c20704f793416b34a4238d5d703ab53046b94355"
Sep 10 22:59:21.721142 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:21.721113    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-dfl96_openshift-console-operator(bc6adc43-c475-4abd-ba1a-5bba5d3f2235)\"" pod="openshift-console-operator/console-operator-696884fb9c-dfl96" podUID="bc6adc43-c475-4abd-ba1a-5bba5d3f2235"
Sep 10 22:59:21.896856 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:21.896817    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:21.896856 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:21.896859    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:21.897104 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:21.896951    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:59:21.897104 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:21.896974    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:59:21.897104 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:21.897019    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm podName:1ca85274-350b-496c-a38a-0cac6e0bd084 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:23.896998859 +0000 UTC m=+76.075869814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8x6kl" (UID: "1ca85274-350b-496c-a38a-0cac6e0bd084") : configmap "kube-rbac-proxy" not found
Sep 10 22:59:21.897104 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:21.897036    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls podName:1ca85274-350b-496c-a38a-0cac6e0bd084 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:23.897027949 +0000 UTC m=+76.075898891 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8x6kl" (UID: "1ca85274-350b-496c-a38a-0cac6e0bd084") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:59:22.951994 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:22.951964    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fkrjd_c681d59b-784f-4e80-94b7-95040c092c61/dns-node-resolver/0.log"
Sep 10 22:59:23.729530 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:23.729501    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:23.729713 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:23.729553    2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:23.729875 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:23.729863    2585 scope.go:117] "RemoveContainer" containerID="e2281af7a20c35329c4431c5c20704f793416b34a4238d5d703ab53046b94355"
Sep 10 22:59:23.730015 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:23.729999    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-dfl96_openshift-console-operator(bc6adc43-c475-4abd-ba1a-5bba5d3f2235)\"" pod="openshift-console-operator/console-operator-696884fb9c-dfl96" podUID="bc6adc43-c475-4abd-ba1a-5bba5d3f2235"
Sep 10 22:59:23.751402 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:23.751373    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2gkn6_54a85272-748c-47b2-9725-e51e37b82c38/node-ca/0.log"
Sep 10 22:59:23.912778 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:23.912735    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:23.912952 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:23.912849    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:59:23.912952 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:23.912862    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:23.912952 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:23.912912    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm podName:1ca85274-350b-496c-a38a-0cac6e0bd084 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:27.912897109 +0000 UTC m=+80.091768050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8x6kl" (UID: "1ca85274-350b-496c-a38a-0cac6e0bd084") : configmap "kube-rbac-proxy" not found
Sep 10 22:59:23.913058 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:23.912960    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:59:23.913058 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:23.913013    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls podName:1ca85274-350b-496c-a38a-0cac6e0bd084 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:27.913002745 +0000 UTC m=+80.091873685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8x6kl" (UID: "1ca85274-350b-496c-a38a-0cac6e0bd084") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:59:24.752208 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:24.752180    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ngpz6_dcb845f5-719b-4eaf-a17c-9e2d72f32635/serve-healthcheck-canary/0.log"
Sep 10 22:59:27.942859 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:27.942818    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:27.943297 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:27.942864    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:27.943297 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:27.942944    2585 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:59:27.943297 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:27.942982    2585 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:59:27.943297 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:27.943019    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm podName:1ca85274-350b-496c-a38a-0cac6e0bd084 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:35.942996984 +0000 UTC m=+88.121867939 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8x6kl" (UID: "1ca85274-350b-496c-a38a-0cac6e0bd084") : configmap "kube-rbac-proxy" not found
Sep 10 22:59:27.943297 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:27.943040    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls podName:1ca85274-350b-496c-a38a-0cac6e0bd084 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:35.943031711 +0000 UTC m=+88.121902653 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8x6kl" (UID: "1ca85274-350b-496c-a38a-0cac6e0bd084") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:59:29.454730 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:29.454697    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:29.455180 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:29.454897    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle podName:88dce041-58b1-456d-94ad-ac2f44a11c07 nodeName:}" failed. No retries permitted until 2026-09-10 22:59:45.454876522 +0000 UTC m=+97.633747483 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle") pod "router-default-5dbbc657dd-v7w6k" (UID: "88dce041-58b1-456d-94ad-ac2f44a11c07") : configmap references non-existent config key: service-ca.crt
Sep 10 22:59:29.455180 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:29.454921    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:29.457239 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:29.457210    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/88dce041-58b1-456d-94ad-ac2f44a11c07-metrics-certs\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:36.005969 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:36.005819    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:36.005969 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:36.005859    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:36.006451 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:36.006347    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ca85274-350b-496c-a38a-0cac6e0bd084-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:36.008111 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:36.008090    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ca85274-350b-496c-a38a-0cac6e0bd084-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8x6kl\" (UID: \"1ca85274-350b-496c-a38a-0cac6e0bd084\") " pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:36.156764 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:36.156729    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8x6kl"
Sep 10 22:59:36.427729 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:36.427600    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8x6kl"]
Sep 10 22:59:36.430280 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:59:36.430253    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca85274_350b_496c_a38a_0cac6e0bd084.slice/crio-8a20039493453c7257d284960a1df3b74b2d475c4a38a2a5f4301916ea8ef7bd WatchSource:0}: Error finding container 8a20039493453c7257d284960a1df3b74b2d475c4a38a2a5f4301916ea8ef7bd: Status 404 returned error can't find the container with id 8a20039493453c7257d284960a1df3b74b2d475c4a38a2a5f4301916ea8ef7bd
Sep 10 22:59:36.766186 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:36.766094    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8x6kl" event={"ID":"1ca85274-350b-496c-a38a-0cac6e0bd084","Type":"ContainerStarted","Data":"80b0349671403dec816549b4e65c337696de1d9798accf8132d939f537197c62"}
Sep 10 22:59:36.766186 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:36.766156    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8x6kl" event={"ID":"1ca85274-350b-496c-a38a-0cac6e0bd084","Type":"ContainerStarted","Data":"8a20039493453c7257d284960a1df3b74b2d475c4a38a2a5f4301916ea8ef7bd"}
Sep 10 22:59:37.771525 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:37.771480    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8x6kl" event={"ID":"1ca85274-350b-496c-a38a-0cac6e0bd084","Type":"ContainerStarted","Data":"9342d1338c94f3906b76dfcd1ea964721f9b01f1b2b79624fdcb8bc9110e29a0"}
Sep 10 22:59:38.593272 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.593246    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"]
Sep 10 22:59:38.596145 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.596129    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"
Sep 10 22:59:38.600106 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.600086    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 22:59:38.600676 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.600658    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 10 22:59:38.620479 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.620447    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 22:59:38.620635 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.620620    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 22:59:38.626606 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.626583    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9kdx\" (UniqueName: \"kubernetes.io/projected/26297930-dd15-4583-8e01-56064c7173a6-kube-api-access-x9kdx\") pod \"klusterlet-addon-workmgr-869f4c4c54-2w77s\" (UID: \"26297930-dd15-4583-8e01-56064c7173a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"
Sep 10 22:59:38.626697 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.626655    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/26297930-dd15-4583-8e01-56064c7173a6-klusterlet-config\") pod \"klusterlet-addon-workmgr-869f4c4c54-2w77s\" (UID: \"26297930-dd15-4583-8e01-56064c7173a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"
Sep 10 22:59:38.626697 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.626679    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26297930-dd15-4583-8e01-56064c7173a6-tmp\") pod \"klusterlet-addon-workmgr-869f4c4c54-2w77s\" (UID: \"26297930-dd15-4583-8e01-56064c7173a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"
Sep 10 22:59:38.690160 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.690124    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"]
Sep 10 22:59:38.720731 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.720696    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bbd5b85b-kpfvl"]
Sep 10 22:59:38.723628 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.723610    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.726263 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.726241    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 10 22:59:38.726263 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.726242    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vnj2j\""
Sep 10 22:59:38.726424 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.726320    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 10 22:59:38.726424 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.726345    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 10 22:59:38.727327 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.727289    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/26297930-dd15-4583-8e01-56064c7173a6-klusterlet-config\") pod \"klusterlet-addon-workmgr-869f4c4c54-2w77s\" (UID: \"26297930-dd15-4583-8e01-56064c7173a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"
Sep 10 22:59:38.727429 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.727332    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26297930-dd15-4583-8e01-56064c7173a6-tmp\") pod \"klusterlet-addon-workmgr-869f4c4c54-2w77s\" (UID: \"26297930-dd15-4583-8e01-56064c7173a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"
Sep 10 22:59:38.727429 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.727372    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9kdx\" (UniqueName: \"kubernetes.io/projected/26297930-dd15-4583-8e01-56064c7173a6-kube-api-access-x9kdx\") pod \"klusterlet-addon-workmgr-869f4c4c54-2w77s\" (UID: \"26297930-dd15-4583-8e01-56064c7173a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"
Sep 10 22:59:38.727788 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.727767    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26297930-dd15-4583-8e01-56064c7173a6-tmp\") pod \"klusterlet-addon-workmgr-869f4c4c54-2w77s\" (UID: \"26297930-dd15-4583-8e01-56064c7173a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"
Sep 10 22:59:38.730096 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.730051    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/26297930-dd15-4583-8e01-56064c7173a6-klusterlet-config\") pod \"klusterlet-addon-workmgr-869f4c4c54-2w77s\" (UID: \"26297930-dd15-4583-8e01-56064c7173a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"
Sep 10 22:59:38.731811 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.731794    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 10 22:59:38.739232 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.739209    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bbd5b85b-kpfvl"]
Sep 10 22:59:38.746145 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.746124    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9kdx\" (UniqueName: \"kubernetes.io/projected/26297930-dd15-4583-8e01-56064c7173a6-kube-api-access-x9kdx\") pod \"klusterlet-addon-workmgr-869f4c4c54-2w77s\" (UID: \"26297930-dd15-4583-8e01-56064c7173a6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"
Sep 10 22:59:38.776465 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.776426    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8x6kl" event={"ID":"1ca85274-350b-496c-a38a-0cac6e0bd084","Type":"ContainerStarted","Data":"db4ed820391ae2d20f2e6865c987fdf31050f7408408fe8a5e754c65affc4fcc"}
Sep 10 22:59:38.802378 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.802326    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8x6kl" podStartSLOduration=16.756398409 podStartE2EDuration="18.802288872s" totalImagesPullingTime="2.045890463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:59:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:59:38.801185373 +0000 UTC m=+90.980056336" watchObservedRunningTime="2026-09-10 22:59:38.802288872 +0000 UTC m=+90.981159835"
Sep 10 22:59:38.827963 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.827931    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a406887-a0f4-4e85-93e8-e365cee0e920-image-registry-private-configuration\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.828100 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.827967    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a406887-a0f4-4e85-93e8-e365cee0e920-registry-certificates\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.828100 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.827987    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht7lk\" (UniqueName: \"kubernetes.io/projected/8a406887-a0f4-4e85-93e8-e365cee0e920-kube-api-access-ht7lk\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.828100 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.828059    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a406887-a0f4-4e85-93e8-e365cee0e920-trusted-ca\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.828258 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.828123    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a406887-a0f4-4e85-93e8-e365cee0e920-installation-pull-secrets\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.828258 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.828195    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a406887-a0f4-4e85-93e8-e365cee0e920-ca-trust-extracted\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.828353 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.828291    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a406887-a0f4-4e85-93e8-e365cee0e920-registry-tls\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.828353 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.828347    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a406887-a0f4-4e85-93e8-e365cee0e920-bound-sa-token\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.919974 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.919895    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"
Sep 10 22:59:38.929635 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.929537    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a406887-a0f4-4e85-93e8-e365cee0e920-installation-pull-secrets\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.929635 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.929584    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a406887-a0f4-4e85-93e8-e365cee0e920-ca-trust-extracted\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.929757 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.929740    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a406887-a0f4-4e85-93e8-e365cee0e920-registry-tls\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.929813 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.929787    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a406887-a0f4-4e85-93e8-e365cee0e920-bound-sa-token\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.929866 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.929853    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a406887-a0f4-4e85-93e8-e365cee0e920-image-registry-private-configuration\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.929919 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.929864    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8a406887-a0f4-4e85-93e8-e365cee0e920-ca-trust-extracted\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.929919 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.929882    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a406887-a0f4-4e85-93e8-e365cee0e920-registry-certificates\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.929919 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.929913    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht7lk\" (UniqueName: \"kubernetes.io/projected/8a406887-a0f4-4e85-93e8-e365cee0e920-kube-api-access-ht7lk\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.930126 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.929943    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a406887-a0f4-4e85-93e8-e365cee0e920-trusted-ca\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.930803 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.930776    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8a406887-a0f4-4e85-93e8-e365cee0e920-registry-certificates\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.930880 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.930802    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a406887-a0f4-4e85-93e8-e365cee0e920-trusted-ca\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.932385 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.932363    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8a406887-a0f4-4e85-93e8-e365cee0e920-installation-pull-secrets\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.932469 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.932450    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8a406887-a0f4-4e85-93e8-e365cee0e920-image-registry-private-configuration\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.933317 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.933292    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8a406887-a0f4-4e85-93e8-e365cee0e920-registry-tls\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.941263 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.941241    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a406887-a0f4-4e85-93e8-e365cee0e920-bound-sa-token\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:38.941370 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:38.941350    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht7lk\" (UniqueName: \"kubernetes.io/projected/8a406887-a0f4-4e85-93e8-e365cee0e920-kube-api-access-ht7lk\") pod \"image-registry-7bbd5b85b-kpfvl\" (UID: \"8a406887-a0f4-4e85-93e8-e365cee0e920\") " pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:39.037023 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.036982    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:39.188377 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.188351    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"]
Sep 10 22:59:39.190531 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:59:39.190501    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26297930_dd15_4583_8e01_56064c7173a6.slice/crio-28d0c26e1a3075bf18866a008011f37c5d8f16b77ee458c78cb15dc23878f163 WatchSource:0}: Error finding container 28d0c26e1a3075bf18866a008011f37c5d8f16b77ee458c78cb15dc23878f163: Status 404 returned error can't find the container with id 28d0c26e1a3075bf18866a008011f37c5d8f16b77ee458c78cb15dc23878f163
Sep 10 22:59:39.307617 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.307587    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bbd5b85b-kpfvl"]
Sep 10 22:59:39.310303 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:59:39.310260    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a406887_a0f4_4e85_93e8_e365cee0e920.slice/crio-9ba18409a196c393a50965b3d09ed6acc0af1ede6cc8199cda8b5ad89302f822 WatchSource:0}: Error finding container 9ba18409a196c393a50965b3d09ed6acc0af1ede6cc8199cda8b5ad89302f822: Status 404 returned error can't find the container with id 9ba18409a196c393a50965b3d09ed6acc0af1ede6cc8199cda8b5ad89302f822
Sep 10 22:59:39.335939 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.335917    2585 scope.go:117] "RemoveContainer" containerID="e2281af7a20c35329c4431c5c20704f793416b34a4238d5d703ab53046b94355"
Sep 10 22:59:39.780904 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.780875    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 22:59:39.781397 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.781305    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/1.log"
Sep 10 22:59:39.781397 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.781336    2585 generic.go:356] "Generic (PLEG): container finished" podID="bc6adc43-c475-4abd-ba1a-5bba5d3f2235" containerID="db00374d6a0addc900c17d61d8c0baae46cce94421b86bad7da8bb5d16e2e81c" exitCode=255
Sep 10 22:59:39.781488 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.781412    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dfl96" event={"ID":"bc6adc43-c475-4abd-ba1a-5bba5d3f2235","Type":"ContainerDied","Data":"db00374d6a0addc900c17d61d8c0baae46cce94421b86bad7da8bb5d16e2e81c"}
Sep 10 22:59:39.781542 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.781495    2585 scope.go:117] "RemoveContainer" containerID="e2281af7a20c35329c4431c5c20704f793416b34a4238d5d703ab53046b94355"
Sep 10 22:59:39.781843 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.781823    2585 scope.go:117] "RemoveContainer" containerID="db00374d6a0addc900c17d61d8c0baae46cce94421b86bad7da8bb5d16e2e81c"
Sep 10 22:59:39.782020 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:39.781999    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-dfl96_openshift-console-operator(bc6adc43-c475-4abd-ba1a-5bba5d3f2235)\"" pod="openshift-console-operator/console-operator-696884fb9c-dfl96" podUID="bc6adc43-c475-4abd-ba1a-5bba5d3f2235"
Sep 10 22:59:39.782958 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.782677    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s" event={"ID":"26297930-dd15-4583-8e01-56064c7173a6","Type":"ContainerStarted","Data":"28d0c26e1a3075bf18866a008011f37c5d8f16b77ee458c78cb15dc23878f163"}
Sep 10 22:59:39.784174 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.784155    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl" event={"ID":"8a406887-a0f4-4e85-93e8-e365cee0e920","Type":"ContainerStarted","Data":"a3f4246f5f4db35d3a5636d68374192e3a0eb4b1e40febb2552e34fd49989685"}
Sep 10 22:59:39.784260 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.784186    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl" event={"ID":"8a406887-a0f4-4e85-93e8-e365cee0e920","Type":"ContainerStarted","Data":"9ba18409a196c393a50965b3d09ed6acc0af1ede6cc8199cda8b5ad89302f822"}
Sep 10 22:59:39.784443 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.784425    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 22:59:39.817252 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:39.817194    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl" podStartSLOduration=1.817179662 podStartE2EDuration="1.817179662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:59:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:59:39.816238911 +0000 UTC m=+91.995109873" watchObservedRunningTime="2026-09-10 22:59:39.817179662 +0000 UTC m=+91.996050624"
Sep 10 22:59:40.790281 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:40.790250    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 22:59:43.729167 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:43.729073    2585 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:43.729167 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:43.729132    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 22:59:43.729592 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:43.729436    2585 scope.go:117] "RemoveContainer" containerID="db00374d6a0addc900c17d61d8c0baae46cce94421b86bad7da8bb5d16e2e81c"
Sep 10 22:59:43.729643 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:43.729609    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-dfl96_openshift-console-operator(bc6adc43-c475-4abd-ba1a-5bba5d3f2235)\"" pod="openshift-console-operator/console-operator-696884fb9c-dfl96" podUID="bc6adc43-c475-4abd-ba1a-5bba5d3f2235"
Sep 10 22:59:43.802703 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:43.802665    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s" event={"ID":"26297930-dd15-4583-8e01-56064c7173a6","Type":"ContainerStarted","Data":"b8139aef6f825dff1863bf4762211a5feae455f5c04eb8235aa63045c8e1ccf4"}
Sep 10 22:59:43.802882 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:43.802861    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"
Sep 10 22:59:43.807794 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:43.804776    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s"
Sep 10 22:59:43.821266 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:43.821220    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-869f4c4c54-2w77s" podStartSLOduration=1.660504336 podStartE2EDuration="5.821205386s" totalImagesPullingTime="4.16070105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:59:43.821001592 +0000 UTC m=+95.999872555" watchObservedRunningTime="2026-09-10 22:59:43.821205386 +0000 UTC m=+96.000076351"
Sep 10 22:59:45.485344 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:45.485302    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:45.485939 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:45.485918    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88dce041-58b1-456d-94ad-ac2f44a11c07-service-ca-bundle\") pod \"router-default-5dbbc657dd-v7w6k\" (UID: \"88dce041-58b1-456d-94ad-ac2f44a11c07\") " pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:45.586243 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:45.586208    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:59:45.588492 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:45.588472    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2-metrics-tls\") pod \"dns-default-xz27k\" (UID: \"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2\") " pod="openshift-dns/dns-default-xz27k"
Sep 10 22:59:45.731729 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:45.731687    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:45.868024 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:45.867987    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-677w4\""
Sep 10 22:59:45.875794 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:45.875771    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xz27k"
Sep 10 22:59:46.001965 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:46.001892    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5dbbc657dd-v7w6k"]
Sep 10 22:59:46.004450 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:59:46.004428    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88dce041_58b1_456d_94ad_ac2f44a11c07.slice/crio-0740865628c5d4a31d8e012173a8d6422347c69b5bf6eb85eba58032ce1217a5 WatchSource:0}: Error finding container 0740865628c5d4a31d8e012173a8d6422347c69b5bf6eb85eba58032ce1217a5: Status 404 returned error can't find the container with id 0740865628c5d4a31d8e012173a8d6422347c69b5bf6eb85eba58032ce1217a5
Sep 10 22:59:46.162957 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:46.162925    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xz27k"]
Sep 10 22:59:46.166194 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:59:46.166171    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a4bbac_29ef_41a5_b1e6_9b56e2af3fc2.slice/crio-8680223dc06912482c2ac9ee143e753e08b034e1c48964a46eb8c543740854de WatchSource:0}: Error finding container 8680223dc06912482c2ac9ee143e753e08b034e1c48964a46eb8c543740854de: Status 404 returned error can't find the container with id 8680223dc06912482c2ac9ee143e753e08b034e1c48964a46eb8c543740854de
Sep 10 22:59:46.813834 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:46.813796    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dbbc657dd-v7w6k" event={"ID":"88dce041-58b1-456d-94ad-ac2f44a11c07","Type":"ContainerStarted","Data":"1e96dd1526b8cf485593ba16cc4b8981d089244b5620e82d76ca2cbcad8ad87d"}
Sep 10 22:59:46.814325 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:46.813856    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5dbbc657dd-v7w6k" event={"ID":"88dce041-58b1-456d-94ad-ac2f44a11c07","Type":"ContainerStarted","Data":"0740865628c5d4a31d8e012173a8d6422347c69b5bf6eb85eba58032ce1217a5"}
Sep 10 22:59:46.815084 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:46.815060    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xz27k" event={"ID":"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2","Type":"ContainerStarted","Data":"8680223dc06912482c2ac9ee143e753e08b034e1c48964a46eb8c543740854de"}
Sep 10 22:59:46.834335 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:46.834289    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5dbbc657dd-v7w6k" podStartSLOduration=33.834272899 podStartE2EDuration="33.834272899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:59:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:59:46.833913394 +0000 UTC m=+99.012784355" watchObservedRunningTime="2026-09-10 22:59:46.834272899 +0000 UTC m=+99.013143861"
Sep 10 22:59:47.732905 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:47.732875    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:47.735355 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:47.735331    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:47.822217 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:47.822185    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xz27k" event={"ID":"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2","Type":"ContainerStarted","Data":"2ebeb290e52a8705bab1fabaa94d87b279a54ae70a4999d0c7b1fab526385689"}
Sep 10 22:59:47.822700 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:47.822652    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:47.823951 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:47.823904    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5dbbc657dd-v7w6k"
Sep 10 22:59:48.827633 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:48.827596    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xz27k" event={"ID":"37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2","Type":"ContainerStarted","Data":"4d3a1a19010a4f319409dd88b400e9c2b3e466c684aa7753fa04f91f69e3fdb6"}
Sep 10 22:59:48.828107 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:48.827938    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xz27k"
Sep 10 22:59:48.848183 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:48.848135    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xz27k" podStartSLOduration=66.32875041 podStartE2EDuration="1m7.848117693s" totalImagesPullingTime="1.519367283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:59:48.847378495 +0000 UTC m=+101.026249457" watchObservedRunningTime="2026-09-10 22:59:48.848117693 +0000 UTC m=+101.026988657"
Sep 10 22:59:50.719734 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:50.719707    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mddq4"
Sep 10 22:59:50.980906 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:50.980828    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"]
Sep 10 22:59:51.013272 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.013243    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"]
Sep 10 22:59:51.013421 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.013363    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.016073 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.016050    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 22:59:51.016212 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.016053    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 22:59:51.016212 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.016050    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 10 22:59:51.017008 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.016988    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 22:59:51.017008 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.017003    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 10 22:59:51.017125 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.017039    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ctqgq\""
Sep 10 22:59:51.134277 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.134240    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkm6l\" (UniqueName: \"kubernetes.io/projected/b83a5035-8413-4717-85c4-a311d5d35588-kube-api-access-gkm6l\") pod \"prometheus-operator-68bcd7f987-t64mb\" (UID: \"b83a5035-8413-4717-85c4-a311d5d35588\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.134444 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.134295    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b83a5035-8413-4717-85c4-a311d5d35588-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-t64mb\" (UID: \"b83a5035-8413-4717-85c4-a311d5d35588\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.134444 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.134324    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b83a5035-8413-4717-85c4-a311d5d35588-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-t64mb\" (UID: \"b83a5035-8413-4717-85c4-a311d5d35588\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.134444 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.134392    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b83a5035-8413-4717-85c4-a311d5d35588-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-t64mb\" (UID: \"b83a5035-8413-4717-85c4-a311d5d35588\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.234760 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.234679    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b83a5035-8413-4717-85c4-a311d5d35588-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-t64mb\" (UID: \"b83a5035-8413-4717-85c4-a311d5d35588\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.234760 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.234729    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b83a5035-8413-4717-85c4-a311d5d35588-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-t64mb\" (UID: \"b83a5035-8413-4717-85c4-a311d5d35588\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.234946 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.234851    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkm6l\" (UniqueName: \"kubernetes.io/projected/b83a5035-8413-4717-85c4-a311d5d35588-kube-api-access-gkm6l\") pod \"prometheus-operator-68bcd7f987-t64mb\" (UID: \"b83a5035-8413-4717-85c4-a311d5d35588\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.234946 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.234919    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b83a5035-8413-4717-85c4-a311d5d35588-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-t64mb\" (UID: \"b83a5035-8413-4717-85c4-a311d5d35588\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.235309 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.235290    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b83a5035-8413-4717-85c4-a311d5d35588-metrics-client-ca\") pod \"prometheus-operator-68bcd7f987-t64mb\" (UID: \"b83a5035-8413-4717-85c4-a311d5d35588\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.237111 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.237080    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b83a5035-8413-4717-85c4-a311d5d35588-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-68bcd7f987-t64mb\" (UID: \"b83a5035-8413-4717-85c4-a311d5d35588\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.237215 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.237150    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b83a5035-8413-4717-85c4-a311d5d35588-prometheus-operator-tls\") pod \"prometheus-operator-68bcd7f987-t64mb\" (UID: \"b83a5035-8413-4717-85c4-a311d5d35588\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.246585 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.246551    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkm6l\" (UniqueName: \"kubernetes.io/projected/b83a5035-8413-4717-85c4-a311d5d35588-kube-api-access-gkm6l\") pod \"prometheus-operator-68bcd7f987-t64mb\" (UID: \"b83a5035-8413-4717-85c4-a311d5d35588\") " pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.322048 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.322010    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"
Sep 10 22:59:51.633480 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.633448    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-68bcd7f987-t64mb"]
Sep 10 22:59:51.637082 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:59:51.637052    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83a5035_8413_4717_85c4_a311d5d35588.slice/crio-8bb5043f69da49c70527b0244cafbe36ae1c0b96d14c08b0938d94fa1ae66419 WatchSource:0}: Error finding container 8bb5043f69da49c70527b0244cafbe36ae1c0b96d14c08b0938d94fa1ae66419: Status 404 returned error can't find the container with id 8bb5043f69da49c70527b0244cafbe36ae1c0b96d14c08b0938d94fa1ae66419
Sep 10 22:59:51.841249 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:51.841215    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb" event={"ID":"b83a5035-8413-4717-85c4-a311d5d35588","Type":"ContainerStarted","Data":"8bb5043f69da49c70527b0244cafbe36ae1c0b96d14c08b0938d94fa1ae66419"}
Sep 10 22:59:53.849351 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:53.849318    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb" event={"ID":"b83a5035-8413-4717-85c4-a311d5d35588","Type":"ContainerStarted","Data":"1df229ccf429b0917c849998b7c65d723304b3fe69891539de2eaa6803c069b6"}
Sep 10 22:59:53.849850 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:53.849371    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb" event={"ID":"b83a5035-8413-4717-85c4-a311d5d35588","Type":"ContainerStarted","Data":"59c01fd145451cee7e1b247e48ce1adf030926bd72ea8ba8d7df2f5a28da4194"}
Sep 10 22:59:53.867633 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:53.867548    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-68bcd7f987-t64mb" podStartSLOduration=2.246232949 podStartE2EDuration="3.867532069s" totalImagesPullingTime="1.62129912s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:59:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:59:53.866687727 +0000 UTC m=+106.045558690" watchObservedRunningTime="2026-09-10 22:59:53.867532069 +0000 UTC m=+106.046403084"
Sep 10 22:59:55.359395 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.359359    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"]
Sep 10 22:59:55.376914 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.376888    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"]
Sep 10 22:59:55.377055 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.376987    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:55.379351 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.379329    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zzk4s\""
Sep 10 22:59:55.379351 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.379329    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 10 22:59:55.379515 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.379382    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 10 22:59:55.387998 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.387969    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"]
Sep 10 22:59:55.406874 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.406850    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7gjk9"]
Sep 10 22:59:55.407048 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.406960    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.409201 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.409176    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 10 22:59:55.409425 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.409410    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dc97r\""
Sep 10 22:59:55.409544 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.409526    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 10 22:59:55.409626 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.409618    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 10 22:59:55.429297 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.429268    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"]
Sep 10 22:59:55.429410 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.429389    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.431893 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.431870    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 22:59:55.432027 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.431980    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 22:59:55.432132 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.432111    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 22:59:55.432375 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.432351    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-22fhz\""
Sep 10 22:59:55.473748 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.473721    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/722999e9-86ba-4545-880d-dbd28eed011f-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-sgqpk\" (UID: \"722999e9-86ba-4545-880d-dbd28eed011f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:55.473886 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.473755    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8649af02-d941-4210-89d8-5d5d6298af5d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.473886 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.473773    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/722999e9-86ba-4545-880d-dbd28eed011f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-sgqpk\" (UID: \"722999e9-86ba-4545-880d-dbd28eed011f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:55.473886 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.473796    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8649af02-d941-4210-89d8-5d5d6298af5d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.473886 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.473812    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mkln\" (UniqueName: \"kubernetes.io/projected/8649af02-d941-4210-89d8-5d5d6298af5d-kube-api-access-6mkln\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.473886 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.473863    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/722999e9-86ba-4545-880d-dbd28eed011f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-sgqpk\" (UID: \"722999e9-86ba-4545-880d-dbd28eed011f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:55.474076 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.473901    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8649af02-d941-4210-89d8-5d5d6298af5d-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.474076 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.473934    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8649af02-d941-4210-89d8-5d5d6298af5d-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.474076 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.473983    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8649af02-d941-4210-89d8-5d5d6298af5d-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.474076 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.474029    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt2l9\" (UniqueName: \"kubernetes.io/projected/722999e9-86ba-4545-880d-dbd28eed011f-kube-api-access-vt2l9\") pod \"openshift-state-metrics-67dcf8c979-sgqpk\" (UID: \"722999e9-86ba-4545-880d-dbd28eed011f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:55.574835 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.574800    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/722999e9-86ba-4545-880d-dbd28eed011f-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-sgqpk\" (UID: \"722999e9-86ba-4545-880d-dbd28eed011f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:55.574835 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.574841    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8649af02-d941-4210-89d8-5d5d6298af5d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.575069 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.574861    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/722999e9-86ba-4545-880d-dbd28eed011f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-sgqpk\" (UID: \"722999e9-86ba-4545-880d-dbd28eed011f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:55.575069 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.574888    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48625286-6991-426a-bed9-47f7d187b6fe-sys\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.575069 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:55.574977    2585 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 10 22:59:55.575069 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575006    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8649af02-d941-4210-89d8-5d5d6298af5d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.575069 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575046    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkln\" (UniqueName: \"kubernetes.io/projected/8649af02-d941-4210-89d8-5d5d6298af5d-kube-api-access-6mkln\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.575069 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:55.575061    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/722999e9-86ba-4545-880d-dbd28eed011f-openshift-state-metrics-tls podName:722999e9-86ba-4545-880d-dbd28eed011f nodeName:}" failed. No retries permitted until 2026-09-10 22:59:56.075039674 +0000 UTC m=+108.253910621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/722999e9-86ba-4545-880d-dbd28eed011f-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-sgqpk" (UID: "722999e9-86ba-4545-880d-dbd28eed011f") : secret "openshift-state-metrics-tls" not found
Sep 10 22:59:55.575371 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575104    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/722999e9-86ba-4545-880d-dbd28eed011f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-sgqpk\" (UID: \"722999e9-86ba-4545-880d-dbd28eed011f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:55.575371 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575133    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-tls\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.575371 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575169    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8649af02-d941-4210-89d8-5d5d6298af5d-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.575371 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575201    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jfnb\" (UniqueName: \"kubernetes.io/projected/48625286-6991-426a-bed9-47f7d187b6fe-kube-api-access-5jfnb\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.575371 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575256    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48625286-6991-426a-bed9-47f7d187b6fe-root\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.575371 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575295    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8649af02-d941-4210-89d8-5d5d6298af5d-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.575371 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575323    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-textfile\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.575371 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575350    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48625286-6991-426a-bed9-47f7d187b6fe-metrics-client-ca\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.575785 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575503    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8649af02-d941-4210-89d8-5d5d6298af5d-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.575785 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575527    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8649af02-d941-4210-89d8-5d5d6298af5d-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.575785 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575617    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-wtmp\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.575785 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575643    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/722999e9-86ba-4545-880d-dbd28eed011f-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-sgqpk\" (UID: \"722999e9-86ba-4545-880d-dbd28eed011f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:55.575785 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575699    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.575785 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575774    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.576110 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575803    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt2l9\" (UniqueName: \"kubernetes.io/projected/722999e9-86ba-4545-880d-dbd28eed011f-kube-api-access-vt2l9\") pod \"openshift-state-metrics-67dcf8c979-sgqpk\" (UID: \"722999e9-86ba-4545-880d-dbd28eed011f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:55.576110 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.575815    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8649af02-d941-4210-89d8-5d5d6298af5d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.576209 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.576146    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8649af02-d941-4210-89d8-5d5d6298af5d-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.577480 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.577451    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8649af02-d941-4210-89d8-5d5d6298af5d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.577480 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.577471    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/722999e9-86ba-4545-880d-dbd28eed011f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-sgqpk\" (UID: \"722999e9-86ba-4545-880d-dbd28eed011f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:55.577749 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.577734    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8649af02-d941-4210-89d8-5d5d6298af5d-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.586486 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.586458    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt2l9\" (UniqueName: \"kubernetes.io/projected/722999e9-86ba-4545-880d-dbd28eed011f-kube-api-access-vt2l9\") pod \"openshift-state-metrics-67dcf8c979-sgqpk\" (UID: \"722999e9-86ba-4545-880d-dbd28eed011f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:55.586597 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.586508    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mkln\" (UniqueName: \"kubernetes.io/projected/8649af02-d941-4210-89d8-5d5d6298af5d-kube-api-access-6mkln\") pod \"kube-state-metrics-59fbdd77d-k6gll\" (UID: \"8649af02-d941-4210-89d8-5d5d6298af5d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.676427 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.676345    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48625286-6991-426a-bed9-47f7d187b6fe-root\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.676427 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.676394    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-textfile\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.676669 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.676427    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48625286-6991-426a-bed9-47f7d187b6fe-metrics-client-ca\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.676669 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.676460    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-wtmp\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.676669 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.676486    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.676669 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.676531    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/48625286-6991-426a-bed9-47f7d187b6fe-root\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.676669 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.676612    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.676669 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.676646    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-wtmp\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.676973 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.676695    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48625286-6991-426a-bed9-47f7d187b6fe-sys\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.676973 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.676743    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-tls\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.676973 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.676785    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/48625286-6991-426a-bed9-47f7d187b6fe-sys\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.676973 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.676787    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jfnb\" (UniqueName: \"kubernetes.io/projected/48625286-6991-426a-bed9-47f7d187b6fe-kube-api-access-5jfnb\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.676973 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.676743    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-textfile\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.677212 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.677160    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48625286-6991-426a-bed9-47f7d187b6fe-metrics-client-ca\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.677212 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.677172    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.679226 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.679202    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-tls\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.679399 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.679203    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/48625286-6991-426a-bed9-47f7d187b6fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.685765 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.685743    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jfnb\" (UniqueName: \"kubernetes.io/projected/48625286-6991-426a-bed9-47f7d187b6fe-kube-api-access-5jfnb\") pod \"node-exporter-7gjk9\" (UID: \"48625286-6991-426a-bed9-47f7d187b6fe\") " pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.718053 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.718020    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"
Sep 10 22:59:55.737658 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.737633    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7gjk9"
Sep 10 22:59:55.747713 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:59:55.747678    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48625286_6991_426a_bed9_47f7d187b6fe.slice/crio-1c36f322420c4dda0d64b299063f3ce9a7d87611d7459385a746680d1812e947 WatchSource:0}: Error finding container 1c36f322420c4dda0d64b299063f3ce9a7d87611d7459385a746680d1812e947: Status 404 returned error can't find the container with id 1c36f322420c4dda0d64b299063f3ce9a7d87611d7459385a746680d1812e947
Sep 10 22:59:55.856546 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.856506    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gjk9" event={"ID":"48625286-6991-426a-bed9-47f7d187b6fe","Type":"ContainerStarted","Data":"1c36f322420c4dda0d64b299063f3ce9a7d87611d7459385a746680d1812e947"}
Sep 10 22:59:55.999072 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:55.998997    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll"]
Sep 10 22:59:56.002734 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:59:56.002707    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8649af02_d941_4210_89d8_5d5d6298af5d.slice/crio-904aa915992d7221d3640d32c2079d40cee7212a05fed50752c825ffe86eec4e WatchSource:0}: Error finding container 904aa915992d7221d3640d32c2079d40cee7212a05fed50752c825ffe86eec4e: Status 404 returned error can't find the container with id 904aa915992d7221d3640d32c2079d40cee7212a05fed50752c825ffe86eec4e
Sep 10 22:59:56.080628 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:56.080594    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/722999e9-86ba-4545-880d-dbd28eed011f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-sgqpk\" (UID: \"722999e9-86ba-4545-880d-dbd28eed011f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:56.083010 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:56.082985    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/722999e9-86ba-4545-880d-dbd28eed011f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-sgqpk\" (UID: \"722999e9-86ba-4545-880d-dbd28eed011f\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:56.288161 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:56.288082    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"
Sep 10 22:59:56.335739 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:56.335637    2585 scope.go:117] "RemoveContainer" containerID="db00374d6a0addc900c17d61d8c0baae46cce94421b86bad7da8bb5d16e2e81c"
Sep 10 22:59:56.335914 ip-10-0-138-139 kubenswrapper[2585]: E0910 22:59:56.335851    2585 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-696884fb9c-dfl96_openshift-console-operator(bc6adc43-c475-4abd-ba1a-5bba5d3f2235)\"" pod="openshift-console-operator/console-operator-696884fb9c-dfl96" podUID="bc6adc43-c475-4abd-ba1a-5bba5d3f2235"
Sep 10 22:59:56.579971 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:56.579935    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk"]
Sep 10 22:59:56.715056 ip-10-0-138-139 kubenswrapper[2585]: W0910 22:59:56.715018    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod722999e9_86ba_4545_880d_dbd28eed011f.slice/crio-f0afa5f30831bf7b4f1b38233d524a9adb2236f4a2d09135427785e79f905195 WatchSource:0}: Error finding container f0afa5f30831bf7b4f1b38233d524a9adb2236f4a2d09135427785e79f905195: Status 404 returned error can't find the container with id f0afa5f30831bf7b4f1b38233d524a9adb2236f4a2d09135427785e79f905195
Sep 10 22:59:56.865405 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:56.865362    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk" event={"ID":"722999e9-86ba-4545-880d-dbd28eed011f","Type":"ContainerStarted","Data":"bb3512a0968d5acd75fb4ec1f9ad2f6d03fc795344b17c50759247ec5bfc0b84"}
Sep 10 22:59:56.865602 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:56.865448    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk" event={"ID":"722999e9-86ba-4545-880d-dbd28eed011f","Type":"ContainerStarted","Data":"260da49323ff4337318d2ff7cef3b9f9fb52be497d948870a5aa23d21db061f2"}
Sep 10 22:59:56.865602 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:56.865476    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk" event={"ID":"722999e9-86ba-4545-880d-dbd28eed011f","Type":"ContainerStarted","Data":"f0afa5f30831bf7b4f1b38233d524a9adb2236f4a2d09135427785e79f905195"}
Sep 10 22:59:56.867357 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:56.867252    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll" event={"ID":"8649af02-d941-4210-89d8-5d5d6298af5d","Type":"ContainerStarted","Data":"904aa915992d7221d3640d32c2079d40cee7212a05fed50752c825ffe86eec4e"}
Sep 10 22:59:56.869612 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:56.869582    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gjk9" event={"ID":"48625286-6991-426a-bed9-47f7d187b6fe","Type":"ContainerStarted","Data":"adc49dff5d21a5d209d4be4c0f10b45fc77191e7cec61b79178172013a3fb7a1"}
Sep 10 22:59:57.876387 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:57.876297    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll" event={"ID":"8649af02-d941-4210-89d8-5d5d6298af5d","Type":"ContainerStarted","Data":"da18b115401dd00287caa239a7347f88f21ca77be5a0439b3cb29841c1c63e22"}
Sep 10 22:59:57.876387 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:57.876367    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll" event={"ID":"8649af02-d941-4210-89d8-5d5d6298af5d","Type":"ContainerStarted","Data":"26bee961a76a220985a3726cb0df69a2ee2e6c4fcdb881e8f72cdd2c2365f0c4"}
Sep 10 22:59:57.876913 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:57.876395    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll" event={"ID":"8649af02-d941-4210-89d8-5d5d6298af5d","Type":"ContainerStarted","Data":"6012bafa3b43c133e2c139d2c6d4eec4ce10770cc213e0ba9101975972ad107c"}
Sep 10 22:59:57.878172 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:57.878141    2585 generic.go:356] "Generic (PLEG): container finished" podID="48625286-6991-426a-bed9-47f7d187b6fe" containerID="adc49dff5d21a5d209d4be4c0f10b45fc77191e7cec61b79178172013a3fb7a1" exitCode=0
Sep 10 22:59:57.878311 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:57.878202    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gjk9" event={"ID":"48625286-6991-426a-bed9-47f7d187b6fe","Type":"ContainerDied","Data":"adc49dff5d21a5d209d4be4c0f10b45fc77191e7cec61b79178172013a3fb7a1"}
Sep 10 22:59:57.897469 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:57.897421    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-k6gll" podStartSLOduration=1.5846958930000001 podStartE2EDuration="2.897405757s" totalImagesPullingTime="1.312709864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:59:57.895325554 +0000 UTC m=+110.074196530" watchObservedRunningTime="2026-09-10 22:59:57.897405757 +0000 UTC m=+110.076276719"
Sep 10 22:59:58.885256 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:58.885216    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gjk9" event={"ID":"48625286-6991-426a-bed9-47f7d187b6fe","Type":"ContainerStarted","Data":"f06755bffaaa746a5c1e4f8c5354319bebd5f1a7d2ab4356a781836940704b2a"}
Sep 10 22:59:58.885734 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:58.885280    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7gjk9" event={"ID":"48625286-6991-426a-bed9-47f7d187b6fe","Type":"ContainerStarted","Data":"08ac785e2eb631d961da387908bba40ac21ef141d4265bd17de84e8d94b22bba"}
Sep 10 22:59:58.887668 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:58.887634    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk" event={"ID":"722999e9-86ba-4545-880d-dbd28eed011f","Type":"ContainerStarted","Data":"ccd3a2f4a5b5de5c407f70deab63548e5085f8a509542cd994757c44f9ae3a77"}
Sep 10 22:59:58.923063 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:58.923018    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7gjk9" podStartSLOduration=2.836784749 podStartE2EDuration="3.923003561s" totalImagesPullingTime="1.015454335s" totalInitContainerRuntime="70.764477ms" isStatefulPod=true podCreationTimestamp="2026-09-10 22:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:59:58.922619822 +0000 UTC m=+111.101490786" watchObservedRunningTime="2026-09-10 22:59:58.923003561 +0000 UTC m=+111.101874523"
Sep 10 22:59:58.947527 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:58.947477    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sgqpk" podStartSLOduration=2.804082382 podStartE2EDuration="3.947460351s" totalImagesPullingTime="1.143377969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:59:58.946229457 +0000 UTC m=+111.125100424" watchObservedRunningTime="2026-09-10 22:59:58.947460351 +0000 UTC m=+111.126331312"
Sep 10 22:59:59.836252 ip-10-0-138-139 kubenswrapper[2585]: I0910 22:59:59.836219    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xz27k"
Sep 10 23:00:00.795392 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:00.795363    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bbd5b85b-kpfvl"
Sep 10 23:00:07.335858 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:07.335828    2585 scope.go:117] "RemoveContainer" containerID="db00374d6a0addc900c17d61d8c0baae46cce94421b86bad7da8bb5d16e2e81c"
Sep 10 23:00:07.840027 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:07.839992    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-ccgm8"]
Sep 10 23:00:07.843240 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:07.843221    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-ccgm8"
Sep 10 23:00:07.845672 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:07.845650    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 10 23:00:07.845789 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:07.845650    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9mk44\""
Sep 10 23:00:07.845789 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:07.845690    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 10 23:00:07.853140 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:07.853120    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-ccgm8"]
Sep 10 23:00:07.921639 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:07.921612    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:00:07.921802 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:07.921682    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-dfl96" event={"ID":"bc6adc43-c475-4abd-ba1a-5bba5d3f2235","Type":"ContainerStarted","Data":"8e235d4c844d280fe8d7061c0344f043486955247a543b954591f276b6d3e855"}
Sep 10 23:00:07.921978 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:07.921942    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 23:00:07.926534 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:07.926509    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-dfl96"
Sep 10 23:00:07.955438 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:07.955384    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-dfl96" podStartSLOduration=49.819240931 podStartE2EDuration="54.955365947s" totalImagesPullingTime="5.136125016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:59:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:00:07.955176297 +0000 UTC m=+120.134047279" watchObservedRunningTime="2026-09-10 23:00:07.955365947 +0000 UTC m=+120.134236911"
Sep 10 23:00:07.985617 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:07.982594    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7jlc\" (UniqueName: \"kubernetes.io/projected/2c708949-c6cf-477c-851c-1f9168f7fac9-kube-api-access-n7jlc\") pod \"downloads-76f99584f4-ccgm8\" (UID: \"2c708949-c6cf-477c-851c-1f9168f7fac9\") " pod="openshift-console/downloads-76f99584f4-ccgm8"
Sep 10 23:00:08.083697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:08.083659    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7jlc\" (UniqueName: \"kubernetes.io/projected/2c708949-c6cf-477c-851c-1f9168f7fac9-kube-api-access-n7jlc\") pod \"downloads-76f99584f4-ccgm8\" (UID: \"2c708949-c6cf-477c-851c-1f9168f7fac9\") " pod="openshift-console/downloads-76f99584f4-ccgm8"
Sep 10 23:00:08.094050 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:08.093988    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7jlc\" (UniqueName: \"kubernetes.io/projected/2c708949-c6cf-477c-851c-1f9168f7fac9-kube-api-access-n7jlc\") pod \"downloads-76f99584f4-ccgm8\" (UID: \"2c708949-c6cf-477c-851c-1f9168f7fac9\") " pod="openshift-console/downloads-76f99584f4-ccgm8"
Sep 10 23:00:08.152005 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:08.151968    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-ccgm8"
Sep 10 23:00:08.424194 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:08.424103    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-ccgm8"]
Sep 10 23:00:08.926079 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:08.926042    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-ccgm8" event={"ID":"2c708949-c6cf-477c-851c-1f9168f7fac9","Type":"ContainerStarted","Data":"7570afb5fdcb5a6c1901ab7d1aed74b79d48febf625e7d930af02c23eb18470c"}
Sep 10 23:00:17.159497 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:17.159454    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 23:00:17.162205 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:17.162181    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e9f71b5f-be1f-493b-8ae3-db948077c752-metrics-certs\") pod \"network-metrics-daemon-gk7qs\" (UID: \"e9f71b5f-be1f-493b-8ae3-db948077c752\") " pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 23:00:17.449018 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:17.448935    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hw9xb\""
Sep 10 23:00:17.457066 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:17.457027    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gk7qs"
Sep 10 23:00:21.158478 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.158441    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-98bd5ddc-shsmt"]
Sep 10 23:00:21.166081 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.166034    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.168451 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.168424    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 23:00:21.169641 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.169616    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 23:00:21.169901 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.169876    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 23:00:21.170033 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.170014    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 23:00:21.170106 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.170047    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 23:00:21.170163 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.170018    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-29xcp\""
Sep 10 23:00:21.172483 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.172306    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98bd5ddc-shsmt"]
Sep 10 23:00:21.174945 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.174479    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 23:00:21.194786 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.194756    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-trusted-ca-bundle\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.194924 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.194799    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-serving-cert\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.194924 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.194817    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-service-ca\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.195047 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.194927    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-oauth-config\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.195047 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.194980    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-config\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.195150 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.195045    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qxvg\" (UniqueName: \"kubernetes.io/projected/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-kube-api-access-9qxvg\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.195150 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.195083    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-oauth-serving-cert\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.295944 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.295911    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-serving-cert\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.296150 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.295948    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-service-ca\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.296150 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.296011    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-oauth-config\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.296150 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.296038    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-config\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.296150 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.296083    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qxvg\" (UniqueName: \"kubernetes.io/projected/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-kube-api-access-9qxvg\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.296150 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.296122    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-oauth-serving-cert\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.296415 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.296176    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-trusted-ca-bundle\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.296849 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.296819    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-service-ca\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.296994 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.296976    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-trusted-ca-bundle\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.297064 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.297021    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-config\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.297151 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.297125    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-oauth-serving-cert\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.298894 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.298873    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-serving-cert\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.299119 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.299096    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-oauth-config\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.306210 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.306127    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qxvg\" (UniqueName: \"kubernetes.io/projected/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-kube-api-access-9qxvg\") pod \"console-98bd5ddc-shsmt\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") " pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:21.477815 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:21.477724    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:24.648407 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:24.648320    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gk7qs"]
Sep 10 23:00:24.651465 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:24.651425    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98bd5ddc-shsmt"]
Sep 10 23:00:24.652050 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:00:24.652020    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f71b5f_be1f_493b_8ae3_db948077c752.slice/crio-a37cf7a13ce1d2eee35577c3e154a4c604dcdda01821c0f94cda05ddce972e81 WatchSource:0}: Error finding container a37cf7a13ce1d2eee35577c3e154a4c604dcdda01821c0f94cda05ddce972e81: Status 404 returned error can't find the container with id a37cf7a13ce1d2eee35577c3e154a4c604dcdda01821c0f94cda05ddce972e81
Sep 10 23:00:24.655446 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:00:24.655415    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a706aa_cb8d_407d_b822_5fbeafdc0ecc.slice/crio-d940417fd96591d0e489c2f0104fc4cd058472c8770335eb8632b4bab57307be WatchSource:0}: Error finding container d940417fd96591d0e489c2f0104fc4cd058472c8770335eb8632b4bab57307be: Status 404 returned error can't find the container with id d940417fd96591d0e489c2f0104fc4cd058472c8770335eb8632b4bab57307be
Sep 10 23:00:24.995033 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:24.994946    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-ccgm8" event={"ID":"2c708949-c6cf-477c-851c-1f9168f7fac9","Type":"ContainerStarted","Data":"f282d92e0fc8e242a2999e9e07135bf74e295cc56de53cd337de2f9034365d39"}
Sep 10 23:00:24.995199 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:24.995089    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-ccgm8"
Sep 10 23:00:25.002199 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:24.999005    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98bd5ddc-shsmt" event={"ID":"04a706aa-cb8d-407d-b822-5fbeafdc0ecc","Type":"ContainerStarted","Data":"d940417fd96591d0e489c2f0104fc4cd058472c8770335eb8632b4bab57307be"}
Sep 10 23:00:25.002199 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:24.999800    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-ccgm8"
Sep 10 23:00:25.002199 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:25.001124    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gk7qs" event={"ID":"e9f71b5f-be1f-493b-8ae3-db948077c752","Type":"ContainerStarted","Data":"a37cf7a13ce1d2eee35577c3e154a4c604dcdda01821c0f94cda05ddce972e81"}
Sep 10 23:00:25.013680 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:25.013633    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-ccgm8" podStartSLOduration=1.976094558 podStartE2EDuration="18.013615715s" totalImagesPullingTime="16.037521157s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:00:25.012182508 +0000 UTC m=+137.191053472" watchObservedRunningTime="2026-09-10 23:00:25.013615715 +0000 UTC m=+137.192486677"
Sep 10 23:00:27.013218 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:27.013171    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gk7qs" event={"ID":"e9f71b5f-be1f-493b-8ae3-db948077c752","Type":"ContainerStarted","Data":"252268f5e27b1044f1389999e2ca656f81d2e17737ce348a8dfa2cffb7d67fe6"}
Sep 10 23:00:27.013745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:27.013372    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gk7qs" event={"ID":"e9f71b5f-be1f-493b-8ae3-db948077c752","Type":"ContainerStarted","Data":"c1352d9a087c3fb91840d5db9f07bcfb1cddeb32b845863304d8d6c4e7185666"}
Sep 10 23:00:27.033545 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:27.033443    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gk7qs" podStartSLOduration=137.784526132 podStartE2EDuration="2m19.033422589s" totalImagesPullingTime="1.248896457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:00:27.031757013 +0000 UTC m=+139.210627976" watchObservedRunningTime="2026-09-10 23:00:27.033422589 +0000 UTC m=+139.212293553"
Sep 10 23:00:29.026461 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:29.026413    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98bd5ddc-shsmt" event={"ID":"04a706aa-cb8d-407d-b822-5fbeafdc0ecc","Type":"ContainerStarted","Data":"eede067c9c936175de8213214d5bcc0b734f998da412a2a9960ec8f4c7fa1951"}
Sep 10 23:00:29.044932 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:29.044890    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-98bd5ddc-shsmt" podStartSLOduration=4.229676369 podStartE2EDuration="8.044872972s" totalImagesPullingTime="3.815196603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:00:29.044059104 +0000 UTC m=+141.222930082" watchObservedRunningTime="2026-09-10 23:00:29.044872972 +0000 UTC m=+141.223743950"
Sep 10 23:00:31.478319 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:31.478277    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:31.478803 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:31.478354    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:31.484127 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:31.484094    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:32.051749 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:32.051709    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:00:40.071275 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:40.071241    2585 generic.go:356] "Generic (PLEG): container finished" podID="feb57e6c-d860-43e5-b331-5167bbef45fe" containerID="3325938a1c31fe0170dfe8a7d8fdce635494884002565efa3a39bc039d5a3570" exitCode=0
Sep 10 23:00:40.071768 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:40.071313    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-lg2tg" event={"ID":"feb57e6c-d860-43e5-b331-5167bbef45fe","Type":"ContainerDied","Data":"3325938a1c31fe0170dfe8a7d8fdce635494884002565efa3a39bc039d5a3570"}
Sep 10 23:00:40.071768 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:40.071679    2585 scope.go:117] "RemoveContainer" containerID="3325938a1c31fe0170dfe8a7d8fdce635494884002565efa3a39bc039d5a3570"
Sep 10 23:00:41.077228 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:00:41.077183    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-lg2tg" event={"ID":"feb57e6c-d860-43e5-b331-5167bbef45fe","Type":"ContainerStarted","Data":"75ff7b168b7480710826685c495c6cca2f11a30d02fbb71dcaa955b1913e4e26"}
Sep 10 23:01:23.375766 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.375506    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69b9cc5c7c-x49ml"]
Sep 10 23:01:23.378390 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.378368    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.389086 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.389059    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69b9cc5c7c-x49ml"]
Sep 10 23:01:23.527478 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.527436    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-service-ca\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.527478 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.527476    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-oauth-serving-cert\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.527713 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.527501    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9596467c-d73f-48c3-bc61-b251353bf37f-console-serving-cert\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.527713 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.527552    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-trusted-ca-bundle\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.527713 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.527649    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9596467c-d73f-48c3-bc61-b251353bf37f-console-oauth-config\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.527713 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.527687    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-console-config\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.527838 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.527721    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm84c\" (UniqueName: \"kubernetes.io/projected/9596467c-d73f-48c3-bc61-b251353bf37f-kube-api-access-qm84c\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.628388 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.628287    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-console-config\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.628388 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.628350    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm84c\" (UniqueName: \"kubernetes.io/projected/9596467c-d73f-48c3-bc61-b251353bf37f-kube-api-access-qm84c\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.628388 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.628387    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-service-ca\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.628721 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.628401    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-oauth-serving-cert\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.628721 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.628421    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9596467c-d73f-48c3-bc61-b251353bf37f-console-serving-cert\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.628721 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.628436    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-trusted-ca-bundle\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.628721 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.628462    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9596467c-d73f-48c3-bc61-b251353bf37f-console-oauth-config\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.629146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.629116    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-console-config\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.629332 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.629199    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-oauth-serving-cert\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.629332 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.629199    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-service-ca\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.629482 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.629370    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-trusted-ca-bundle\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.630897 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.630876    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9596467c-d73f-48c3-bc61-b251353bf37f-console-oauth-config\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.631009 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.630988    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9596467c-d73f-48c3-bc61-b251353bf37f-console-serving-cert\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.638860 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.638837    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm84c\" (UniqueName: \"kubernetes.io/projected/9596467c-d73f-48c3-bc61-b251353bf37f-kube-api-access-qm84c\") pod \"console-69b9cc5c7c-x49ml\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") " pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.690006 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.689964    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:23.961896 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:23.961808    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69b9cc5c7c-x49ml"]
Sep 10 23:01:24.242322 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:24.242228    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b9cc5c7c-x49ml" event={"ID":"9596467c-d73f-48c3-bc61-b251353bf37f","Type":"ContainerStarted","Data":"d6c228b9e4504623903d05b5471f2348a91b49b394d2e1a8a674c5ef9657b277"}
Sep 10 23:01:24.242498 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:24.242326    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b9cc5c7c-x49ml" event={"ID":"9596467c-d73f-48c3-bc61-b251353bf37f","Type":"ContainerStarted","Data":"ae527db0a7333848f112f28b4d33b051ee1b40732309780696170ae5b698bff7"}
Sep 10 23:01:24.278741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:24.278684    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69b9cc5c7c-x49ml" podStartSLOduration=1.278663886 podStartE2EDuration="1.278663886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:01:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:01:24.278052007 +0000 UTC m=+196.456922974" watchObservedRunningTime="2026-09-10 23:01:24.278663886 +0000 UTC m=+196.457534850"
Sep 10 23:01:33.691173 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:33.691131    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:33.691758 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:33.691204    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:33.695915 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:33.695887    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:34.284798 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:34.284766    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:01:34.341571 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:34.341528    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98bd5ddc-shsmt"]
Sep 10 23:01:59.363471 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.363403    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-98bd5ddc-shsmt" podUID="04a706aa-cb8d-407d-b822-5fbeafdc0ecc" containerName="console" containerID="cri-o://eede067c9c936175de8213214d5bcc0b734f998da412a2a9960ec8f4c7fa1951" gracePeriod=15
Sep 10 23:01:59.602461 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.602436    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:01:59.633176 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.633103    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-oauth-config\") pod \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") "
Sep 10 23:01:59.633176 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.633134    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-oauth-serving-cert\") pod \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") "
Sep 10 23:01:59.633176 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.633154    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-config\") pod \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") "
Sep 10 23:01:59.633490 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.633182    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qxvg\" (UniqueName: \"kubernetes.io/projected/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-kube-api-access-9qxvg\") pod \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") "
Sep 10 23:01:59.633490 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.633258    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-serving-cert\") pod \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") "
Sep 10 23:01:59.633490 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.633310    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-trusted-ca-bundle\") pod \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") "
Sep 10 23:01:59.633490 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.633343    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-service-ca\") pod \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\" (UID: \"04a706aa-cb8d-407d-b822-5fbeafdc0ecc\") "
Sep 10 23:01:59.633806 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.633580    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "04a706aa-cb8d-407d-b822-5fbeafdc0ecc" (UID: "04a706aa-cb8d-407d-b822-5fbeafdc0ecc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:01:59.633806 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.633596    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-config" (OuterVolumeSpecName: "console-config") pod "04a706aa-cb8d-407d-b822-5fbeafdc0ecc" (UID: "04a706aa-cb8d-407d-b822-5fbeafdc0ecc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:01:59.633919 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.633864    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-service-ca" (OuterVolumeSpecName: "service-ca") pod "04a706aa-cb8d-407d-b822-5fbeafdc0ecc" (UID: "04a706aa-cb8d-407d-b822-5fbeafdc0ecc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:01:59.634035 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.633998    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "04a706aa-cb8d-407d-b822-5fbeafdc0ecc" (UID: "04a706aa-cb8d-407d-b822-5fbeafdc0ecc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:01:59.635541 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.635509    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "04a706aa-cb8d-407d-b822-5fbeafdc0ecc" (UID: "04a706aa-cb8d-407d-b822-5fbeafdc0ecc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:01:59.635723 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.635689    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "04a706aa-cb8d-407d-b822-5fbeafdc0ecc" (UID: "04a706aa-cb8d-407d-b822-5fbeafdc0ecc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:01:59.635795 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.635698    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-kube-api-access-9qxvg" (OuterVolumeSpecName: "kube-api-access-9qxvg") pod "04a706aa-cb8d-407d-b822-5fbeafdc0ecc" (UID: "04a706aa-cb8d-407d-b822-5fbeafdc0ecc"). InnerVolumeSpecName "kube-api-access-9qxvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:01:59.734431 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.734396    2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-oauth-config\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:01:59.734431 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.734425    2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-oauth-serving-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:01:59.734431 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.734434    2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-config\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:01:59.734683 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.734443    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qxvg\" (UniqueName: \"kubernetes.io/projected/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-kube-api-access-9qxvg\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:01:59.734683 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.734452    2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-console-serving-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:01:59.734683 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.734460    2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-trusted-ca-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:01:59.734683 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:01:59.734468    2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/04a706aa-cb8d-407d-b822-5fbeafdc0ecc-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:02:00.376320 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:02:00.376292    2585 generic.go:356] "Generic (PLEG): container finished" podID="04a706aa-cb8d-407d-b822-5fbeafdc0ecc" containerID="eede067c9c936175de8213214d5bcc0b734f998da412a2a9960ec8f4c7fa1951" exitCode=0
Sep 10 23:02:00.376721 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:02:00.376331    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98bd5ddc-shsmt" event={"ID":"04a706aa-cb8d-407d-b822-5fbeafdc0ecc","Type":"ContainerDied","Data":"eede067c9c936175de8213214d5bcc0b734f998da412a2a9960ec8f4c7fa1951"}
Sep 10 23:02:00.376721 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:02:00.376338    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98bd5ddc-shsmt"
Sep 10 23:02:00.376721 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:02:00.376364    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98bd5ddc-shsmt" event={"ID":"04a706aa-cb8d-407d-b822-5fbeafdc0ecc","Type":"ContainerDied","Data":"d940417fd96591d0e489c2f0104fc4cd058472c8770335eb8632b4bab57307be"}
Sep 10 23:02:00.376721 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:02:00.376383    2585 scope.go:117] "RemoveContainer" containerID="eede067c9c936175de8213214d5bcc0b734f998da412a2a9960ec8f4c7fa1951"
Sep 10 23:02:00.384465 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:02:00.384448    2585 scope.go:117] "RemoveContainer" containerID="eede067c9c936175de8213214d5bcc0b734f998da412a2a9960ec8f4c7fa1951"
Sep 10 23:02:00.384780 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:02:00.384755    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eede067c9c936175de8213214d5bcc0b734f998da412a2a9960ec8f4c7fa1951\": container with ID starting with eede067c9c936175de8213214d5bcc0b734f998da412a2a9960ec8f4c7fa1951 not found: ID does not exist" containerID="eede067c9c936175de8213214d5bcc0b734f998da412a2a9960ec8f4c7fa1951"
Sep 10 23:02:00.384852 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:02:00.384784    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eede067c9c936175de8213214d5bcc0b734f998da412a2a9960ec8f4c7fa1951"} err="failed to get container status \"eede067c9c936175de8213214d5bcc0b734f998da412a2a9960ec8f4c7fa1951\": rpc error: code = NotFound desc = could not find container \"eede067c9c936175de8213214d5bcc0b734f998da412a2a9960ec8f4c7fa1951\": container with ID starting with eede067c9c936175de8213214d5bcc0b734f998da412a2a9960ec8f4c7fa1951 not found: ID does not exist"
Sep 10 23:02:00.394450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:02:00.394428    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98bd5ddc-shsmt"]
Sep 10 23:02:00.397092 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:02:00.397073    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-98bd5ddc-shsmt"]
Sep 10 23:02:02.340456 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:02:02.340423    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04a706aa-cb8d-407d-b822-5fbeafdc0ecc" path="/var/lib/kubelet/pods/04a706aa-cb8d-407d-b822-5fbeafdc0ecc/volumes"
Sep 10 23:02:50.330814 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:02:50.330779    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69b9cc5c7c-x49ml"]
Sep 10 23:03:08.244990 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:08.244961    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:03:08.247845 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:08.247825    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:03:08.252776 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:08.252753    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:03:08.255910 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:08.255892    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:03:08.256160 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:08.256138    2585 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 23:03:15.355787 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.355727    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69b9cc5c7c-x49ml" podUID="9596467c-d73f-48c3-bc61-b251353bf37f" containerName="console" containerID="cri-o://d6c228b9e4504623903d05b5471f2348a91b49b394d2e1a8a674c5ef9657b277" gracePeriod=15
Sep 10 23:03:15.590653 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.590624    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:03:15.650378 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.650305    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-service-ca\") pod \"9596467c-d73f-48c3-bc61-b251353bf37f\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") "
Sep 10 23:03:15.650378 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.650330    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-trusted-ca-bundle\") pod \"9596467c-d73f-48c3-bc61-b251353bf37f\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") "
Sep 10 23:03:15.650378 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.650352    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-console-config\") pod \"9596467c-d73f-48c3-bc61-b251353bf37f\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") "
Sep 10 23:03:15.650662 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.650397    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9596467c-d73f-48c3-bc61-b251353bf37f-console-oauth-config\") pod \"9596467c-d73f-48c3-bc61-b251353bf37f\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") "
Sep 10 23:03:15.650662 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.650539    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-oauth-serving-cert\") pod \"9596467c-d73f-48c3-bc61-b251353bf37f\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") "
Sep 10 23:03:15.650662 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.650626    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9596467c-d73f-48c3-bc61-b251353bf37f-console-serving-cert\") pod \"9596467c-d73f-48c3-bc61-b251353bf37f\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") "
Sep 10 23:03:15.650662 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.650659    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qm84c\" (UniqueName: \"kubernetes.io/projected/9596467c-d73f-48c3-bc61-b251353bf37f-kube-api-access-qm84c\") pod \"9596467c-d73f-48c3-bc61-b251353bf37f\" (UID: \"9596467c-d73f-48c3-bc61-b251353bf37f\") "
Sep 10 23:03:15.650869 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.650803    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9596467c-d73f-48c3-bc61-b251353bf37f" (UID: "9596467c-d73f-48c3-bc61-b251353bf37f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:03:15.650869 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.650815    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-service-ca" (OuterVolumeSpecName: "service-ca") pod "9596467c-d73f-48c3-bc61-b251353bf37f" (UID: "9596467c-d73f-48c3-bc61-b251353bf37f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:03:15.650869 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.650834    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-console-config" (OuterVolumeSpecName: "console-config") pod "9596467c-d73f-48c3-bc61-b251353bf37f" (UID: "9596467c-d73f-48c3-bc61-b251353bf37f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:03:15.651013 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.650914    2585 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:03:15.651013 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.650931    2585 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-trusted-ca-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:03:15.651013 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.650946    2585 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-console-config\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:03:15.651305 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.651272    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9596467c-d73f-48c3-bc61-b251353bf37f" (UID: "9596467c-d73f-48c3-bc61-b251353bf37f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:03:15.651931 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.651899    2585 generic.go:356] "Generic (PLEG): container finished" podID="9596467c-d73f-48c3-bc61-b251353bf37f" containerID="d6c228b9e4504623903d05b5471f2348a91b49b394d2e1a8a674c5ef9657b277" exitCode=0
Sep 10 23:03:15.652028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.651951    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b9cc5c7c-x49ml" event={"ID":"9596467c-d73f-48c3-bc61-b251353bf37f","Type":"ContainerDied","Data":"d6c228b9e4504623903d05b5471f2348a91b49b394d2e1a8a674c5ef9657b277"}
Sep 10 23:03:15.652028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.651962    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69b9cc5c7c-x49ml"
Sep 10 23:03:15.652028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.652004    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69b9cc5c7c-x49ml" event={"ID":"9596467c-d73f-48c3-bc61-b251353bf37f","Type":"ContainerDied","Data":"ae527db0a7333848f112f28b4d33b051ee1b40732309780696170ae5b698bff7"}
Sep 10 23:03:15.652169 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.652042    2585 scope.go:117] "RemoveContainer" containerID="d6c228b9e4504623903d05b5471f2348a91b49b394d2e1a8a674c5ef9657b277"
Sep 10 23:03:15.652988 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.652966    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9596467c-d73f-48c3-bc61-b251353bf37f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9596467c-d73f-48c3-bc61-b251353bf37f" (UID: "9596467c-d73f-48c3-bc61-b251353bf37f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:03:15.653085 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.652984    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9596467c-d73f-48c3-bc61-b251353bf37f-kube-api-access-qm84c" (OuterVolumeSpecName: "kube-api-access-qm84c") pod "9596467c-d73f-48c3-bc61-b251353bf37f" (UID: "9596467c-d73f-48c3-bc61-b251353bf37f"). InnerVolumeSpecName "kube-api-access-qm84c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:03:15.653085 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.652984    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9596467c-d73f-48c3-bc61-b251353bf37f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9596467c-d73f-48c3-bc61-b251353bf37f" (UID: "9596467c-d73f-48c3-bc61-b251353bf37f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:03:15.665863 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.665846    2585 scope.go:117] "RemoveContainer" containerID="d6c228b9e4504623903d05b5471f2348a91b49b394d2e1a8a674c5ef9657b277"
Sep 10 23:03:15.666121 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:03:15.666103    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6c228b9e4504623903d05b5471f2348a91b49b394d2e1a8a674c5ef9657b277\": container with ID starting with d6c228b9e4504623903d05b5471f2348a91b49b394d2e1a8a674c5ef9657b277 not found: ID does not exist" containerID="d6c228b9e4504623903d05b5471f2348a91b49b394d2e1a8a674c5ef9657b277"
Sep 10 23:03:15.666172 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.666130    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c228b9e4504623903d05b5471f2348a91b49b394d2e1a8a674c5ef9657b277"} err="failed to get container status \"d6c228b9e4504623903d05b5471f2348a91b49b394d2e1a8a674c5ef9657b277\": rpc error: code = NotFound desc = could not find container \"d6c228b9e4504623903d05b5471f2348a91b49b394d2e1a8a674c5ef9657b277\": container with ID starting with d6c228b9e4504623903d05b5471f2348a91b49b394d2e1a8a674c5ef9657b277 not found: ID does not exist"
Sep 10 23:03:15.751987 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.751955    2585 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9596467c-d73f-48c3-bc61-b251353bf37f-console-oauth-config\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:03:15.751987 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.751982    2585 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9596467c-d73f-48c3-bc61-b251353bf37f-oauth-serving-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:03:15.751987 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.751992    2585 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9596467c-d73f-48c3-bc61-b251353bf37f-console-serving-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:03:15.752198 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.752000    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qm84c\" (UniqueName: \"kubernetes.io/projected/9596467c-d73f-48c3-bc61-b251353bf37f-kube-api-access-qm84c\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:03:15.976130 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.976102    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69b9cc5c7c-x49ml"]
Sep 10 23:03:15.980975 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:15.980951    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69b9cc5c7c-x49ml"]
Sep 10 23:03:16.340160 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:16.340130    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9596467c-d73f-48c3-bc61-b251353bf37f" path="/var/lib/kubelet/pods/9596467c-d73f-48c3-bc61-b251353bf37f/volumes"
Sep 10 23:03:31.491733 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.491700    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"]
Sep 10 23:03:31.492146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.491977    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9596467c-d73f-48c3-bc61-b251353bf37f" containerName="console"
Sep 10 23:03:31.492146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.491988    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9596467c-d73f-48c3-bc61-b251353bf37f" containerName="console"
Sep 10 23:03:31.492146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.492001    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04a706aa-cb8d-407d-b822-5fbeafdc0ecc" containerName="console"
Sep 10 23:03:31.492146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.492006    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="04a706aa-cb8d-407d-b822-5fbeafdc0ecc" containerName="console"
Sep 10 23:03:31.492146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.492052    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="04a706aa-cb8d-407d-b822-5fbeafdc0ecc" containerName="console"
Sep 10 23:03:31.492146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.492061    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9596467c-d73f-48c3-bc61-b251353bf37f" containerName="console"
Sep 10 23:03:31.494911 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.494894    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"
Sep 10 23:03:31.497533 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.497509    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:03:31.497633 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.497547    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mvt47\""
Sep 10 23:03:31.497633 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.497518    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:03:31.509369 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.509344    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"]
Sep 10 23:03:31.576069 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.576037    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/379fd307-98a4-4373-b0a3-faf209e35cbf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl\" (UID: \"379fd307-98a4-4373-b0a3-faf209e35cbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"
Sep 10 23:03:31.576220 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.576095    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jllsm\" (UniqueName: \"kubernetes.io/projected/379fd307-98a4-4373-b0a3-faf209e35cbf-kube-api-access-jllsm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl\" (UID: \"379fd307-98a4-4373-b0a3-faf209e35cbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"
Sep 10 23:03:31.576220 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.576123    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/379fd307-98a4-4373-b0a3-faf209e35cbf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl\" (UID: \"379fd307-98a4-4373-b0a3-faf209e35cbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"
Sep 10 23:03:31.676470 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.676432    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jllsm\" (UniqueName: \"kubernetes.io/projected/379fd307-98a4-4373-b0a3-faf209e35cbf-kube-api-access-jllsm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl\" (UID: \"379fd307-98a4-4373-b0a3-faf209e35cbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"
Sep 10 23:03:31.676680 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.676486    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/379fd307-98a4-4373-b0a3-faf209e35cbf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl\" (UID: \"379fd307-98a4-4373-b0a3-faf209e35cbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"
Sep 10 23:03:31.676680 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.676528    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/379fd307-98a4-4373-b0a3-faf209e35cbf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl\" (UID: \"379fd307-98a4-4373-b0a3-faf209e35cbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"
Sep 10 23:03:31.676957 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.676925    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/379fd307-98a4-4373-b0a3-faf209e35cbf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl\" (UID: \"379fd307-98a4-4373-b0a3-faf209e35cbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"
Sep 10 23:03:31.676957 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.676942    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/379fd307-98a4-4373-b0a3-faf209e35cbf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl\" (UID: \"379fd307-98a4-4373-b0a3-faf209e35cbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"
Sep 10 23:03:31.686841 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.686813    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jllsm\" (UniqueName: \"kubernetes.io/projected/379fd307-98a4-4373-b0a3-faf209e35cbf-kube-api-access-jllsm\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl\" (UID: \"379fd307-98a4-4373-b0a3-faf209e35cbf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"
Sep 10 23:03:31.803498 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:31.803467    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"
Sep 10 23:03:32.077357 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:32.075824    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"]
Sep 10 23:03:32.080615 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:03:32.080586    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod379fd307_98a4_4373_b0a3_faf209e35cbf.slice/crio-dfce6c286a3d90310dde8135fee84f4291dc94f827858b594d4ad7ee9258aa7a WatchSource:0}: Error finding container dfce6c286a3d90310dde8135fee84f4291dc94f827858b594d4ad7ee9258aa7a: Status 404 returned error can't find the container with id dfce6c286a3d90310dde8135fee84f4291dc94f827858b594d4ad7ee9258aa7a
Sep 10 23:03:32.082349 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:32.082331    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:03:32.715138 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:32.715099    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl" event={"ID":"379fd307-98a4-4373-b0a3-faf209e35cbf","Type":"ContainerStarted","Data":"dfce6c286a3d90310dde8135fee84f4291dc94f827858b594d4ad7ee9258aa7a"}
Sep 10 23:03:38.748351 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:38.748309    2585 generic.go:356] "Generic (PLEG): container finished" podID="379fd307-98a4-4373-b0a3-faf209e35cbf" containerID="37eee4c783c3df8afef03db084b5a11abf4d08ffb3a2f0a1b911772823070dea" exitCode=0
Sep 10 23:03:38.748775 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:38.748395    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl" event={"ID":"379fd307-98a4-4373-b0a3-faf209e35cbf","Type":"ContainerDied","Data":"37eee4c783c3df8afef03db084b5a11abf4d08ffb3a2f0a1b911772823070dea"}
Sep 10 23:03:41.762413 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:41.762377    2585 generic.go:356] "Generic (PLEG): container finished" podID="379fd307-98a4-4373-b0a3-faf209e35cbf" containerID="e688b78427b8bc52d6617672055b235d7c66477f9f9fe285824969bd534c0a3e" exitCode=0
Sep 10 23:03:41.762955 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:41.762469    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl" event={"ID":"379fd307-98a4-4373-b0a3-faf209e35cbf","Type":"ContainerDied","Data":"e688b78427b8bc52d6617672055b235d7c66477f9f9fe285824969bd534c0a3e"}
Sep 10 23:03:48.794327 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:48.794289    2585 generic.go:356] "Generic (PLEG): container finished" podID="379fd307-98a4-4373-b0a3-faf209e35cbf" containerID="843fb9f0d2aa1fee006187e62409678f88f10d3cce005327ac758b821437ada6" exitCode=0
Sep 10 23:03:48.794731 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:48.794379    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl" event={"ID":"379fd307-98a4-4373-b0a3-faf209e35cbf","Type":"ContainerDied","Data":"843fb9f0d2aa1fee006187e62409678f88f10d3cce005327ac758b821437ada6"}
Sep 10 23:03:49.920407 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:49.920382    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"
Sep 10 23:03:49.931428 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:49.931406    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/379fd307-98a4-4373-b0a3-faf209e35cbf-bundle\") pod \"379fd307-98a4-4373-b0a3-faf209e35cbf\" (UID: \"379fd307-98a4-4373-b0a3-faf209e35cbf\") "
Sep 10 23:03:49.931554 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:49.931447    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/379fd307-98a4-4373-b0a3-faf209e35cbf-util\") pod \"379fd307-98a4-4373-b0a3-faf209e35cbf\" (UID: \"379fd307-98a4-4373-b0a3-faf209e35cbf\") "
Sep 10 23:03:49.931554 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:49.931476    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jllsm\" (UniqueName: \"kubernetes.io/projected/379fd307-98a4-4373-b0a3-faf209e35cbf-kube-api-access-jllsm\") pod \"379fd307-98a4-4373-b0a3-faf209e35cbf\" (UID: \"379fd307-98a4-4373-b0a3-faf209e35cbf\") "
Sep 10 23:03:49.932013 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:49.931989    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/379fd307-98a4-4373-b0a3-faf209e35cbf-bundle" (OuterVolumeSpecName: "bundle") pod "379fd307-98a4-4373-b0a3-faf209e35cbf" (UID: "379fd307-98a4-4373-b0a3-faf209e35cbf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:03:49.933508 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:49.933485    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/379fd307-98a4-4373-b0a3-faf209e35cbf-kube-api-access-jllsm" (OuterVolumeSpecName: "kube-api-access-jllsm") pod "379fd307-98a4-4373-b0a3-faf209e35cbf" (UID: "379fd307-98a4-4373-b0a3-faf209e35cbf"). InnerVolumeSpecName "kube-api-access-jllsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:03:49.938469 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:49.938441    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/379fd307-98a4-4373-b0a3-faf209e35cbf-util" (OuterVolumeSpecName: "util") pod "379fd307-98a4-4373-b0a3-faf209e35cbf" (UID: "379fd307-98a4-4373-b0a3-faf209e35cbf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:03:50.032576 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:50.032532    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/379fd307-98a4-4373-b0a3-faf209e35cbf-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:03:50.032576 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:50.032585    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/379fd307-98a4-4373-b0a3-faf209e35cbf-util\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:03:50.032781 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:50.032598    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jllsm\" (UniqueName: \"kubernetes.io/projected/379fd307-98a4-4373-b0a3-faf209e35cbf-kube-api-access-jllsm\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:03:50.803576 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:50.803541    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl"
Sep 10 23:03:50.803717 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:50.803578    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540986dl" event={"ID":"379fd307-98a4-4373-b0a3-faf209e35cbf","Type":"ContainerDied","Data":"dfce6c286a3d90310dde8135fee84f4291dc94f827858b594d4ad7ee9258aa7a"}
Sep 10 23:03:50.803717 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:50.803626    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dfce6c286a3d90310dde8135fee84f4291dc94f827858b594d4ad7ee9258aa7a"
Sep 10 23:03:54.209294 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.209248    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d"]
Sep 10 23:03:54.209699 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.209527    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="379fd307-98a4-4373-b0a3-faf209e35cbf" containerName="extract"
Sep 10 23:03:54.209699 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.209537    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="379fd307-98a4-4373-b0a3-faf209e35cbf" containerName="extract"
Sep 10 23:03:54.209699 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.209550    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="379fd307-98a4-4373-b0a3-faf209e35cbf" containerName="util"
Sep 10 23:03:54.209699 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.209556    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="379fd307-98a4-4373-b0a3-faf209e35cbf" containerName="util"
Sep 10 23:03:54.209699 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.209577    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="379fd307-98a4-4373-b0a3-faf209e35cbf" containerName="pull"
Sep 10 23:03:54.209699 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.209582    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="379fd307-98a4-4373-b0a3-faf209e35cbf" containerName="pull"
Sep 10 23:03:54.209699 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.209630    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="379fd307-98a4-4373-b0a3-faf209e35cbf" containerName="extract"
Sep 10 23:03:54.250438 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.250399    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d"]
Sep 10 23:03:54.250633 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.250533    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d"
Sep 10 23:03:54.253598 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.253572    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:03:54.253845 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.253828    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wtvtv\""
Sep 10 23:03:54.254262 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.254242    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 10 23:03:54.265064 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.265043    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsmnl\" (UniqueName: \"kubernetes.io/projected/61494077-d020-472b-83cc-ded768f06f27-kube-api-access-gsmnl\") pod \"cert-manager-operator-controller-manager-55c444bf86-fq42d\" (UID: \"61494077-d020-472b-83cc-ded768f06f27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d"
Sep 10 23:03:54.265146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.265082    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61494077-d020-472b-83cc-ded768f06f27-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fq42d\" (UID: \"61494077-d020-472b-83cc-ded768f06f27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d"
Sep 10 23:03:54.365984 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.365951    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsmnl\" (UniqueName: \"kubernetes.io/projected/61494077-d020-472b-83cc-ded768f06f27-kube-api-access-gsmnl\") pod \"cert-manager-operator-controller-manager-55c444bf86-fq42d\" (UID: \"61494077-d020-472b-83cc-ded768f06f27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d"
Sep 10 23:03:54.366135 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.365998    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61494077-d020-472b-83cc-ded768f06f27-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fq42d\" (UID: \"61494077-d020-472b-83cc-ded768f06f27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d"
Sep 10 23:03:54.366406 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.366389    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/61494077-d020-472b-83cc-ded768f06f27-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-fq42d\" (UID: \"61494077-d020-472b-83cc-ded768f06f27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d"
Sep 10 23:03:54.374828 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.374795    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsmnl\" (UniqueName: \"kubernetes.io/projected/61494077-d020-472b-83cc-ded768f06f27-kube-api-access-gsmnl\") pod \"cert-manager-operator-controller-manager-55c444bf86-fq42d\" (UID: \"61494077-d020-472b-83cc-ded768f06f27\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d"
Sep 10 23:03:54.559176 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.559143    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d"
Sep 10 23:03:54.863765 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:54.863741    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d"]
Sep 10 23:03:54.865499 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:03:54.865474    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61494077_d020_472b_83cc_ded768f06f27.slice/crio-a5c1161e88345056dcde4f66d80583106168d549463618af6cdb68929926ca8f WatchSource:0}: Error finding container a5c1161e88345056dcde4f66d80583106168d549463618af6cdb68929926ca8f: Status 404 returned error can't find the container with id a5c1161e88345056dcde4f66d80583106168d549463618af6cdb68929926ca8f
Sep 10 23:03:55.823873 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:55.823837    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d" event={"ID":"61494077-d020-472b-83cc-ded768f06f27","Type":"ContainerStarted","Data":"a5c1161e88345056dcde4f66d80583106168d549463618af6cdb68929926ca8f"}
Sep 10 23:03:57.835025 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:57.834986    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d" event={"ID":"61494077-d020-472b-83cc-ded768f06f27","Type":"ContainerStarted","Data":"0d9e85ab5aab5de018a688e6c5db38c698a98aaa7e662801c09419dc578944b8"}
Sep 10 23:03:57.856466 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:57.856419    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-fq42d" podStartSLOduration=1.866856131 podStartE2EDuration="3.856370338s" totalImagesPullingTime="1.989514207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:03:57.855964741 +0000 UTC m=+350.034835698" watchObservedRunningTime="2026-09-10 23:03:57.856370338 +0000 UTC m=+350.035241301"
Sep 10 23:03:58.771439 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.771400    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"]
Sep 10 23:03:58.775062 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.775042    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"
Sep 10 23:03:58.777311 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.777289    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:03:58.777417 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.777290    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mvt47\""
Sep 10 23:03:58.778023 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.778007    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:03:58.786077 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.786052    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"]
Sep 10 23:03:58.802737 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.802713    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69712fbb-539f-49e2-a2a8-c825999280ea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4\" (UID: \"69712fbb-539f-49e2-a2a8-c825999280ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"
Sep 10 23:03:58.802832 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.802755    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69712fbb-539f-49e2-a2a8-c825999280ea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4\" (UID: \"69712fbb-539f-49e2-a2a8-c825999280ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"
Sep 10 23:03:58.802832 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.802787    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpxfk\" (UniqueName: \"kubernetes.io/projected/69712fbb-539f-49e2-a2a8-c825999280ea-kube-api-access-bpxfk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4\" (UID: \"69712fbb-539f-49e2-a2a8-c825999280ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"
Sep 10 23:03:58.903350 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.903316    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69712fbb-539f-49e2-a2a8-c825999280ea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4\" (UID: \"69712fbb-539f-49e2-a2a8-c825999280ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"
Sep 10 23:03:58.903741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.903366    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpxfk\" (UniqueName: \"kubernetes.io/projected/69712fbb-539f-49e2-a2a8-c825999280ea-kube-api-access-bpxfk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4\" (UID: \"69712fbb-539f-49e2-a2a8-c825999280ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"
Sep 10 23:03:58.903741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.903443    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69712fbb-539f-49e2-a2a8-c825999280ea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4\" (UID: \"69712fbb-539f-49e2-a2a8-c825999280ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"
Sep 10 23:03:58.903830 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.903789    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69712fbb-539f-49e2-a2a8-c825999280ea-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4\" (UID: \"69712fbb-539f-49e2-a2a8-c825999280ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"
Sep 10 23:03:58.903864 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.903853    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69712fbb-539f-49e2-a2a8-c825999280ea-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4\" (UID: \"69712fbb-539f-49e2-a2a8-c825999280ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"
Sep 10 23:03:58.926332 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:58.926302    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpxfk\" (UniqueName: \"kubernetes.io/projected/69712fbb-539f-49e2-a2a8-c825999280ea-kube-api-access-bpxfk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4\" (UID: \"69712fbb-539f-49e2-a2a8-c825999280ea\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"
Sep 10 23:03:59.084279 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:59.084250    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"
Sep 10 23:03:59.362054 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:59.361977    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"]
Sep 10 23:03:59.364690 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:03:59.364662    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69712fbb_539f_49e2_a2a8_c825999280ea.slice/crio-d75dab1d3cf4d6de32e72c3ca6faaabc6d01796c65265e8256f6a4f3ec197c6b WatchSource:0}: Error finding container d75dab1d3cf4d6de32e72c3ca6faaabc6d01796c65265e8256f6a4f3ec197c6b: Status 404 returned error can't find the container with id d75dab1d3cf4d6de32e72c3ca6faaabc6d01796c65265e8256f6a4f3ec197c6b
Sep 10 23:03:59.843800 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:59.843768    2585 generic.go:356] "Generic (PLEG): container finished" podID="69712fbb-539f-49e2-a2a8-c825999280ea" containerID="fc3be666222e9db6a015de2e62c1883580e5104ecac7dc06159314d16c13e006" exitCode=0
Sep 10 23:03:59.843980 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:59.843807    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4" event={"ID":"69712fbb-539f-49e2-a2a8-c825999280ea","Type":"ContainerDied","Data":"fc3be666222e9db6a015de2e62c1883580e5104ecac7dc06159314d16c13e006"}
Sep 10 23:03:59.843980 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:03:59.843841    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4" event={"ID":"69712fbb-539f-49e2-a2a8-c825999280ea","Type":"ContainerStarted","Data":"d75dab1d3cf4d6de32e72c3ca6faaabc6d01796c65265e8256f6a4f3ec197c6b"}
Sep 10 23:04:02.858640 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:02.858603    2585 generic.go:356] "Generic (PLEG): container finished" podID="69712fbb-539f-49e2-a2a8-c825999280ea" containerID="0b3b654319695851d1fd569e21fa4d592a4c90388e9de6b8e00251b0ca055d44" exitCode=0
Sep 10 23:04:02.859007 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:02.858684    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4" event={"ID":"69712fbb-539f-49e2-a2a8-c825999280ea","Type":"ContainerDied","Data":"0b3b654319695851d1fd569e21fa4d592a4c90388e9de6b8e00251b0ca055d44"}
Sep 10 23:04:03.865037 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:03.864995    2585 generic.go:356] "Generic (PLEG): container finished" podID="69712fbb-539f-49e2-a2a8-c825999280ea" containerID="416feb1278861e912143c6e0f36bfdfd5d1332469b3339a1ffce1e4af4261771" exitCode=0
Sep 10 23:04:03.865404 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:03.865061    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4" event={"ID":"69712fbb-539f-49e2-a2a8-c825999280ea","Type":"ContainerDied","Data":"416feb1278861e912143c6e0f36bfdfd5d1332469b3339a1ffce1e4af4261771"}
Sep 10 23:04:04.994793 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:04.994768    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"
Sep 10 23:04:05.056136 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:05.056103    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69712fbb-539f-49e2-a2a8-c825999280ea-bundle\") pod \"69712fbb-539f-49e2-a2a8-c825999280ea\" (UID: \"69712fbb-539f-49e2-a2a8-c825999280ea\") "
Sep 10 23:04:05.056319 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:05.056156    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpxfk\" (UniqueName: \"kubernetes.io/projected/69712fbb-539f-49e2-a2a8-c825999280ea-kube-api-access-bpxfk\") pod \"69712fbb-539f-49e2-a2a8-c825999280ea\" (UID: \"69712fbb-539f-49e2-a2a8-c825999280ea\") "
Sep 10 23:04:05.056319 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:05.056206    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69712fbb-539f-49e2-a2a8-c825999280ea-util\") pod \"69712fbb-539f-49e2-a2a8-c825999280ea\" (UID: \"69712fbb-539f-49e2-a2a8-c825999280ea\") "
Sep 10 23:04:05.056586 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:05.056542    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69712fbb-539f-49e2-a2a8-c825999280ea-bundle" (OuterVolumeSpecName: "bundle") pod "69712fbb-539f-49e2-a2a8-c825999280ea" (UID: "69712fbb-539f-49e2-a2a8-c825999280ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:04:05.058198 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:05.058177    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69712fbb-539f-49e2-a2a8-c825999280ea-kube-api-access-bpxfk" (OuterVolumeSpecName: "kube-api-access-bpxfk") pod "69712fbb-539f-49e2-a2a8-c825999280ea" (UID: "69712fbb-539f-49e2-a2a8-c825999280ea"). InnerVolumeSpecName "kube-api-access-bpxfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:04:05.060746 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:05.060718    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69712fbb-539f-49e2-a2a8-c825999280ea-util" (OuterVolumeSpecName: "util") pod "69712fbb-539f-49e2-a2a8-c825999280ea" (UID: "69712fbb-539f-49e2-a2a8-c825999280ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:04:05.156928 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:05.156845    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/69712fbb-539f-49e2-a2a8-c825999280ea-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:04:05.156928 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:05.156878    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpxfk\" (UniqueName: \"kubernetes.io/projected/69712fbb-539f-49e2-a2a8-c825999280ea-kube-api-access-bpxfk\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:04:05.156928 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:05.156888    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/69712fbb-539f-49e2-a2a8-c825999280ea-util\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:04:05.875576 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:05.875531    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4" event={"ID":"69712fbb-539f-49e2-a2a8-c825999280ea","Type":"ContainerDied","Data":"d75dab1d3cf4d6de32e72c3ca6faaabc6d01796c65265e8256f6a4f3ec197c6b"}
Sep 10 23:04:05.875782 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:05.875590    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d75dab1d3cf4d6de32e72c3ca6faaabc6d01796c65265e8256f6a4f3ec197c6b"
Sep 10 23:04:05.875782 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:05.875595    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklpd4"
Sep 10 23:04:11.969466 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:11.969432    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b"]
Sep 10 23:04:11.969895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:11.969719    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69712fbb-539f-49e2-a2a8-c825999280ea" containerName="pull"
Sep 10 23:04:11.969895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:11.969755    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="69712fbb-539f-49e2-a2a8-c825999280ea" containerName="pull"
Sep 10 23:04:11.969895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:11.969769    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69712fbb-539f-49e2-a2a8-c825999280ea" containerName="extract"
Sep 10 23:04:11.969895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:11.969775    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="69712fbb-539f-49e2-a2a8-c825999280ea" containerName="extract"
Sep 10 23:04:11.969895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:11.969789    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69712fbb-539f-49e2-a2a8-c825999280ea" containerName="util"
Sep 10 23:04:11.969895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:11.969794    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="69712fbb-539f-49e2-a2a8-c825999280ea" containerName="util"
Sep 10 23:04:11.969895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:11.969841    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="69712fbb-539f-49e2-a2a8-c825999280ea" containerName="extract"
Sep 10 23:04:11.974941 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:11.974918    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b"
Sep 10 23:04:11.977167 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:11.977147    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 23:04:11.977167 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:11.977162    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-xpw65\""
Sep 10 23:04:11.977347 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:11.977202    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 23:04:11.981025 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:11.981002    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b"]
Sep 10 23:04:12.111055 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:12.111019    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e944a16-3f97-4009-8754-56cc12a37229-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9xp4b\" (UID: \"1e944a16-3f97-4009-8754-56cc12a37229\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b"
Sep 10 23:04:12.111244 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:12.111070    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfs8d\" (UniqueName: \"kubernetes.io/projected/1e944a16-3f97-4009-8754-56cc12a37229-kube-api-access-dfs8d\") pod \"openshift-lws-operator-fd8ccff4c-9xp4b\" (UID: \"1e944a16-3f97-4009-8754-56cc12a37229\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b"
Sep 10 23:04:12.211477 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:12.211430    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e944a16-3f97-4009-8754-56cc12a37229-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9xp4b\" (UID: \"1e944a16-3f97-4009-8754-56cc12a37229\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b"
Sep 10 23:04:12.211666 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:12.211507    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfs8d\" (UniqueName: \"kubernetes.io/projected/1e944a16-3f97-4009-8754-56cc12a37229-kube-api-access-dfs8d\") pod \"openshift-lws-operator-fd8ccff4c-9xp4b\" (UID: \"1e944a16-3f97-4009-8754-56cc12a37229\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b"
Sep 10 23:04:12.211840 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:12.211809    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e944a16-3f97-4009-8754-56cc12a37229-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9xp4b\" (UID: \"1e944a16-3f97-4009-8754-56cc12a37229\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b"
Sep 10 23:04:12.220337 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:12.220282    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfs8d\" (UniqueName: \"kubernetes.io/projected/1e944a16-3f97-4009-8754-56cc12a37229-kube-api-access-dfs8d\") pod \"openshift-lws-operator-fd8ccff4c-9xp4b\" (UID: \"1e944a16-3f97-4009-8754-56cc12a37229\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b"
Sep 10 23:04:12.294273 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:12.294239    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b"
Sep 10 23:04:12.582855 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:12.582814    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b"]
Sep 10 23:04:12.585875 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:04:12.585849    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e944a16_3f97_4009_8754_56cc12a37229.slice/crio-550efa8fa273c2919b46e3e6a4d6013b15b0dc5c1ef5f762fa0d131961e50980 WatchSource:0}: Error finding container 550efa8fa273c2919b46e3e6a4d6013b15b0dc5c1ef5f762fa0d131961e50980: Status 404 returned error can't find the container with id 550efa8fa273c2919b46e3e6a4d6013b15b0dc5c1ef5f762fa0d131961e50980
Sep 10 23:04:12.910719 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:12.910627    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b" event={"ID":"1e944a16-3f97-4009-8754-56cc12a37229","Type":"ContainerStarted","Data":"550efa8fa273c2919b46e3e6a4d6013b15b0dc5c1ef5f762fa0d131961e50980"}
Sep 10 23:04:14.921350 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:14.921312    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b" event={"ID":"1e944a16-3f97-4009-8754-56cc12a37229","Type":"ContainerStarted","Data":"5f9bd9f670827b8b3a10b7201598e2dc35a65e9ae56467682be0c49c6b01a17a"}
Sep 10 23:04:14.939427 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:14.939365    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9xp4b" podStartSLOduration=2.171080352 podStartE2EDuration="3.939344758s" totalImagesPullingTime="1.768264406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:04:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:04:14.938721577 +0000 UTC m=+367.117592541" watchObservedRunningTime="2026-09-10 23:04:14.939344758 +0000 UTC m=+367.118215722"
Sep 10 23:04:17.614477 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.614443    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"]
Sep 10 23:04:17.618366 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.618349    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"
Sep 10 23:04:17.620785 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.620762    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:04:17.620893 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.620767    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:04:17.621429 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.621409    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mvt47\""
Sep 10 23:04:17.627639 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.627615    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"]
Sep 10 23:04:17.756270 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.756230    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bced3d69-8d14-4ae0-975f-dc657b11020b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq\" (UID: \"bced3d69-8d14-4ae0-975f-dc657b11020b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"
Sep 10 23:04:17.756442 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.756292    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bced3d69-8d14-4ae0-975f-dc657b11020b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq\" (UID: \"bced3d69-8d14-4ae0-975f-dc657b11020b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"
Sep 10 23:04:17.756442 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.756329    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5mzf\" (UniqueName: \"kubernetes.io/projected/bced3d69-8d14-4ae0-975f-dc657b11020b-kube-api-access-c5mzf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq\" (UID: \"bced3d69-8d14-4ae0-975f-dc657b11020b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"
Sep 10 23:04:17.856981 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.856947    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5mzf\" (UniqueName: \"kubernetes.io/projected/bced3d69-8d14-4ae0-975f-dc657b11020b-kube-api-access-c5mzf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq\" (UID: \"bced3d69-8d14-4ae0-975f-dc657b11020b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"
Sep 10 23:04:17.857141 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.856995    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bced3d69-8d14-4ae0-975f-dc657b11020b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq\" (UID: \"bced3d69-8d14-4ae0-975f-dc657b11020b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"
Sep 10 23:04:17.857193 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.857157    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bced3d69-8d14-4ae0-975f-dc657b11020b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq\" (UID: \"bced3d69-8d14-4ae0-975f-dc657b11020b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"
Sep 10 23:04:17.857412 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.857393    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bced3d69-8d14-4ae0-975f-dc657b11020b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq\" (UID: \"bced3d69-8d14-4ae0-975f-dc657b11020b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"
Sep 10 23:04:17.857452 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.857434    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bced3d69-8d14-4ae0-975f-dc657b11020b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq\" (UID: \"bced3d69-8d14-4ae0-975f-dc657b11020b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"
Sep 10 23:04:17.869537 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.869486    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5mzf\" (UniqueName: \"kubernetes.io/projected/bced3d69-8d14-4ae0-975f-dc657b11020b-kube-api-access-c5mzf\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq\" (UID: \"bced3d69-8d14-4ae0-975f-dc657b11020b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"
Sep 10 23:04:17.928182 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:17.928153    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"
Sep 10 23:04:18.215294 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.215268    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"]
Sep 10 23:04:18.217684 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:04:18.217658    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbced3d69_8d14_4ae0_975f_dc657b11020b.slice/crio-50a9253814e0dafe8b0c2e94fed602a36c1d1e25067a52ca46b97a8e2790a6f3 WatchSource:0}: Error finding container 50a9253814e0dafe8b0c2e94fed602a36c1d1e25067a52ca46b97a8e2790a6f3: Status 404 returned error can't find the container with id 50a9253814e0dafe8b0c2e94fed602a36c1d1e25067a52ca46b97a8e2790a6f3
Sep 10 23:04:18.263253 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.263230    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-g8g55"]
Sep 10 23:04:18.285241 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.285215    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-g8g55"]
Sep 10 23:04:18.285350 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.285309    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-g8g55"
Sep 10 23:04:18.288200 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.288179    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 10 23:04:18.288326 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.288183    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 10 23:04:18.288326 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.288221    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-mcwx7\""
Sep 10 23:04:18.364400 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.364371    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79wpv\" (UniqueName: \"kubernetes.io/projected/cb901729-23d8-4cf1-8421-041d048659a9-kube-api-access-79wpv\") pod \"cert-manager-55b4d954d5-g8g55\" (UID: \"cb901729-23d8-4cf1-8421-041d048659a9\") " pod="cert-manager/cert-manager-55b4d954d5-g8g55"
Sep 10 23:04:18.364577 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.364441    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb901729-23d8-4cf1-8421-041d048659a9-bound-sa-token\") pod \"cert-manager-55b4d954d5-g8g55\" (UID: \"cb901729-23d8-4cf1-8421-041d048659a9\") " pod="cert-manager/cert-manager-55b4d954d5-g8g55"
Sep 10 23:04:18.465698 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.465611    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb901729-23d8-4cf1-8421-041d048659a9-bound-sa-token\") pod \"cert-manager-55b4d954d5-g8g55\" (UID: \"cb901729-23d8-4cf1-8421-041d048659a9\") " pod="cert-manager/cert-manager-55b4d954d5-g8g55"
Sep 10 23:04:18.465845 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.465710    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79wpv\" (UniqueName: \"kubernetes.io/projected/cb901729-23d8-4cf1-8421-041d048659a9-kube-api-access-79wpv\") pod \"cert-manager-55b4d954d5-g8g55\" (UID: \"cb901729-23d8-4cf1-8421-041d048659a9\") " pod="cert-manager/cert-manager-55b4d954d5-g8g55"
Sep 10 23:04:18.478459 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.478433    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cb901729-23d8-4cf1-8421-041d048659a9-bound-sa-token\") pod \"cert-manager-55b4d954d5-g8g55\" (UID: \"cb901729-23d8-4cf1-8421-041d048659a9\") " pod="cert-manager/cert-manager-55b4d954d5-g8g55"
Sep 10 23:04:18.478640 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.478622    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79wpv\" (UniqueName: \"kubernetes.io/projected/cb901729-23d8-4cf1-8421-041d048659a9-kube-api-access-79wpv\") pod \"cert-manager-55b4d954d5-g8g55\" (UID: \"cb901729-23d8-4cf1-8421-041d048659a9\") " pod="cert-manager/cert-manager-55b4d954d5-g8g55"
Sep 10 23:04:18.595551 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.595516    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-g8g55"
Sep 10 23:04:18.888250 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.888218    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-g8g55"]
Sep 10 23:04:18.893761 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:04:18.893672    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb901729_23d8_4cf1_8421_041d048659a9.slice/crio-8d69d8ae72ca03923caad5f065d48b572afe30f303fa36107b7533313d60884f WatchSource:0}: Error finding container 8d69d8ae72ca03923caad5f065d48b572afe30f303fa36107b7533313d60884f: Status 404 returned error can't find the container with id 8d69d8ae72ca03923caad5f065d48b572afe30f303fa36107b7533313d60884f
Sep 10 23:04:18.939057 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.939022    2585 generic.go:356] "Generic (PLEG): container finished" podID="bced3d69-8d14-4ae0-975f-dc657b11020b" containerID="e3a26e06cd51bbcdd4afcbe0d7cbcc24426358a63eb88a72e096110e53cabd9a" exitCode=0
Sep 10 23:04:18.939198 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.939113    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq" event={"ID":"bced3d69-8d14-4ae0-975f-dc657b11020b","Type":"ContainerDied","Data":"e3a26e06cd51bbcdd4afcbe0d7cbcc24426358a63eb88a72e096110e53cabd9a"}
Sep 10 23:04:18.939258 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.939202    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq" event={"ID":"bced3d69-8d14-4ae0-975f-dc657b11020b","Type":"ContainerStarted","Data":"50a9253814e0dafe8b0c2e94fed602a36c1d1e25067a52ca46b97a8e2790a6f3"}
Sep 10 23:04:18.940486 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:18.940465    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-g8g55" event={"ID":"cb901729-23d8-4cf1-8421-041d048659a9","Type":"ContainerStarted","Data":"8d69d8ae72ca03923caad5f065d48b572afe30f303fa36107b7533313d60884f"}
Sep 10 23:04:19.948431 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:19.948341    2585 generic.go:356] "Generic (PLEG): container finished" podID="bced3d69-8d14-4ae0-975f-dc657b11020b" containerID="953b56a935f933b3168f796dd4c29450726f2cc1020ed5f5133aab1ef421ea76" exitCode=0
Sep 10 23:04:19.948431 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:19.948417    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq" event={"ID":"bced3d69-8d14-4ae0-975f-dc657b11020b","Type":"ContainerDied","Data":"953b56a935f933b3168f796dd4c29450726f2cc1020ed5f5133aab1ef421ea76"}
Sep 10 23:04:20.956150 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:20.956118    2585 generic.go:356] "Generic (PLEG): container finished" podID="bced3d69-8d14-4ae0-975f-dc657b11020b" containerID="4c250937fa5fece35cb57b7902d712c77b91a96a17c01a85f93b68929587fc9d" exitCode=0
Sep 10 23:04:20.956530 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:20.956186    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq" event={"ID":"bced3d69-8d14-4ae0-975f-dc657b11020b","Type":"ContainerDied","Data":"4c250937fa5fece35cb57b7902d712c77b91a96a17c01a85f93b68929587fc9d"}
Sep 10 23:04:21.961913 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:21.961878    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-g8g55" event={"ID":"cb901729-23d8-4cf1-8421-041d048659a9","Type":"ContainerStarted","Data":"549d1e439f28a0dd9d72a04c8f51ceb4b01497de2234e13b8c49d12085e77bee"}
Sep 10 23:04:21.983493 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:21.983440    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-g8g55" podStartSLOduration=1.48094829 podStartE2EDuration="3.983422638s" totalImagesPullingTime="2.502474348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:04:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:04:21.982281113 +0000 UTC m=+374.161152079" watchObservedRunningTime="2026-09-10 23:04:21.983422638 +0000 UTC m=+374.162293602"
Sep 10 23:04:22.087897 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:22.087873    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"
Sep 10 23:04:22.199018 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:22.198981    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bced3d69-8d14-4ae0-975f-dc657b11020b-util\") pod \"bced3d69-8d14-4ae0-975f-dc657b11020b\" (UID: \"bced3d69-8d14-4ae0-975f-dc657b11020b\") "
Sep 10 23:04:22.199182 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:22.199044    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5mzf\" (UniqueName: \"kubernetes.io/projected/bced3d69-8d14-4ae0-975f-dc657b11020b-kube-api-access-c5mzf\") pod \"bced3d69-8d14-4ae0-975f-dc657b11020b\" (UID: \"bced3d69-8d14-4ae0-975f-dc657b11020b\") "
Sep 10 23:04:22.199182 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:22.199077    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bced3d69-8d14-4ae0-975f-dc657b11020b-bundle\") pod \"bced3d69-8d14-4ae0-975f-dc657b11020b\" (UID: \"bced3d69-8d14-4ae0-975f-dc657b11020b\") "
Sep 10 23:04:22.199866 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:22.199838    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bced3d69-8d14-4ae0-975f-dc657b11020b-bundle" (OuterVolumeSpecName: "bundle") pod "bced3d69-8d14-4ae0-975f-dc657b11020b" (UID: "bced3d69-8d14-4ae0-975f-dc657b11020b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:04:22.201154 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:22.201127    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bced3d69-8d14-4ae0-975f-dc657b11020b-kube-api-access-c5mzf" (OuterVolumeSpecName: "kube-api-access-c5mzf") pod "bced3d69-8d14-4ae0-975f-dc657b11020b" (UID: "bced3d69-8d14-4ae0-975f-dc657b11020b"). InnerVolumeSpecName "kube-api-access-c5mzf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:04:22.204057 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:22.204037    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bced3d69-8d14-4ae0-975f-dc657b11020b-util" (OuterVolumeSpecName: "util") pod "bced3d69-8d14-4ae0-975f-dc657b11020b" (UID: "bced3d69-8d14-4ae0-975f-dc657b11020b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:04:22.299815 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:22.299787    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bced3d69-8d14-4ae0-975f-dc657b11020b-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:04:22.299815 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:22.299813    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bced3d69-8d14-4ae0-975f-dc657b11020b-util\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:04:22.300006 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:22.299823    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5mzf\" (UniqueName: \"kubernetes.io/projected/bced3d69-8d14-4ae0-975f-dc657b11020b-kube-api-access-c5mzf\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:04:22.967722 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:22.967687    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq" event={"ID":"bced3d69-8d14-4ae0-975f-dc657b11020b","Type":"ContainerDied","Data":"50a9253814e0dafe8b0c2e94fed602a36c1d1e25067a52ca46b97a8e2790a6f3"}
Sep 10 23:04:22.968106 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:22.967726    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af67prq"
Sep 10 23:04:22.968106 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:22.967737    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50a9253814e0dafe8b0c2e94fed602a36c1d1e25067a52ca46b97a8e2790a6f3"
Sep 10 23:04:25.873776 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.873737    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"]
Sep 10 23:04:25.874135 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.874028    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bced3d69-8d14-4ae0-975f-dc657b11020b" containerName="pull"
Sep 10 23:04:25.874135 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.874039    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="bced3d69-8d14-4ae0-975f-dc657b11020b" containerName="pull"
Sep 10 23:04:25.874135 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.874049    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bced3d69-8d14-4ae0-975f-dc657b11020b" containerName="extract"
Sep 10 23:04:25.874135 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.874055    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="bced3d69-8d14-4ae0-975f-dc657b11020b" containerName="extract"
Sep 10 23:04:25.874135 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.874063    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bced3d69-8d14-4ae0-975f-dc657b11020b" containerName="util"
Sep 10 23:04:25.874135 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.874068    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="bced3d69-8d14-4ae0-975f-dc657b11020b" containerName="util"
Sep 10 23:04:25.874135 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.874119    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="bced3d69-8d14-4ae0-975f-dc657b11020b" containerName="extract"
Sep 10 23:04:25.877313 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.877291    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:25.881387 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.881365    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jdgl9\""
Sep 10 23:04:25.881504 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.881369    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 23:04:25.881504 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.881369    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 23:04:25.881504 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.881415    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 23:04:25.889107 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:25.889081    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"]
Sep 10 23:04:26.028262 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.028205    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a20d62e9-63d5-4642-aaff-2924b45cec31-cert\") pod \"lws-controller-manager-67777b886f-7m8zp\" (UID: \"a20d62e9-63d5-4642-aaff-2924b45cec31\") " pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:26.028262 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.028265    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a20d62e9-63d5-4642-aaff-2924b45cec31-manager-config\") pod \"lws-controller-manager-67777b886f-7m8zp\" (UID: \"a20d62e9-63d5-4642-aaff-2924b45cec31\") " pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:26.028489 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.028385    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a20d62e9-63d5-4642-aaff-2924b45cec31-metrics-cert\") pod \"lws-controller-manager-67777b886f-7m8zp\" (UID: \"a20d62e9-63d5-4642-aaff-2924b45cec31\") " pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:26.028489 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.028411    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h6sr\" (UniqueName: \"kubernetes.io/projected/a20d62e9-63d5-4642-aaff-2924b45cec31-kube-api-access-4h6sr\") pod \"lws-controller-manager-67777b886f-7m8zp\" (UID: \"a20d62e9-63d5-4642-aaff-2924b45cec31\") " pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:26.129746 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.129660    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a20d62e9-63d5-4642-aaff-2924b45cec31-metrics-cert\") pod \"lws-controller-manager-67777b886f-7m8zp\" (UID: \"a20d62e9-63d5-4642-aaff-2924b45cec31\") " pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:26.129746 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.129697    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h6sr\" (UniqueName: \"kubernetes.io/projected/a20d62e9-63d5-4642-aaff-2924b45cec31-kube-api-access-4h6sr\") pod \"lws-controller-manager-67777b886f-7m8zp\" (UID: \"a20d62e9-63d5-4642-aaff-2924b45cec31\") " pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:26.129746 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.129731    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a20d62e9-63d5-4642-aaff-2924b45cec31-cert\") pod \"lws-controller-manager-67777b886f-7m8zp\" (UID: \"a20d62e9-63d5-4642-aaff-2924b45cec31\") " pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:26.129746 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.129750    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a20d62e9-63d5-4642-aaff-2924b45cec31-manager-config\") pod \"lws-controller-manager-67777b886f-7m8zp\" (UID: \"a20d62e9-63d5-4642-aaff-2924b45cec31\") " pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:26.130439 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.130420    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a20d62e9-63d5-4642-aaff-2924b45cec31-manager-config\") pod \"lws-controller-manager-67777b886f-7m8zp\" (UID: \"a20d62e9-63d5-4642-aaff-2924b45cec31\") " pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:26.132123 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.132101    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a20d62e9-63d5-4642-aaff-2924b45cec31-metrics-cert\") pod \"lws-controller-manager-67777b886f-7m8zp\" (UID: \"a20d62e9-63d5-4642-aaff-2924b45cec31\") " pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:26.132204 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.132147    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a20d62e9-63d5-4642-aaff-2924b45cec31-cert\") pod \"lws-controller-manager-67777b886f-7m8zp\" (UID: \"a20d62e9-63d5-4642-aaff-2924b45cec31\") " pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:26.141159 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.141133    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h6sr\" (UniqueName: \"kubernetes.io/projected/a20d62e9-63d5-4642-aaff-2924b45cec31-kube-api-access-4h6sr\") pod \"lws-controller-manager-67777b886f-7m8zp\" (UID: \"a20d62e9-63d5-4642-aaff-2924b45cec31\") " pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:26.186354 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.186314    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:26.456750 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.456723    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"]
Sep 10 23:04:26.459299 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:04:26.459275    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda20d62e9_63d5_4642_aaff_2924b45cec31.slice/crio-f9b81845b15f2a46baa85bf68eac30f891be5a665a36a3fc42c36c60dbb03339 WatchSource:0}: Error finding container f9b81845b15f2a46baa85bf68eac30f891be5a665a36a3fc42c36c60dbb03339: Status 404 returned error can't find the container with id f9b81845b15f2a46baa85bf68eac30f891be5a665a36a3fc42c36c60dbb03339
Sep 10 23:04:26.985063 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:26.985028    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp" event={"ID":"a20d62e9-63d5-4642-aaff-2924b45cec31","Type":"ContainerStarted","Data":"f9b81845b15f2a46baa85bf68eac30f891be5a665a36a3fc42c36c60dbb03339"}
Sep 10 23:04:27.991323 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:27.991285    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp" event={"ID":"a20d62e9-63d5-4642-aaff-2924b45cec31","Type":"ContainerStarted","Data":"30261b74af4aa5735d580e743316ebf6ff943c3c816971f5ccfd0a89f09149a8"}
Sep 10 23:04:27.991766 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:27.991422    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:28.009081 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:28.009018    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp" podStartSLOduration=1.618686512 podStartE2EDuration="3.009001198s" totalImagesPullingTime="1.390314686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:04:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:04:28.007902618 +0000 UTC m=+380.186773580" watchObservedRunningTime="2026-09-10 23:04:28.009001198 +0000 UTC m=+380.187872181"
Sep 10 23:04:31.792583 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.792526    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"]
Sep 10 23:04:31.795877 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.795860    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"
Sep 10 23:04:31.798608 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.798586    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:04:31.799502 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.799484    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mvt47\""
Sep 10 23:04:31.799552 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.799488    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:04:31.808588 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.808545    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"]
Sep 10 23:04:31.882985 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.882952    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48b6191-d77a-4f53-94a9-2392b4f73a71-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6\" (UID: \"c48b6191-d77a-4f53-94a9-2392b4f73a71\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"
Sep 10 23:04:31.883148 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.882995    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48b6191-d77a-4f53-94a9-2392b4f73a71-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6\" (UID: \"c48b6191-d77a-4f53-94a9-2392b4f73a71\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"
Sep 10 23:04:31.883148 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.883018    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sldc9\" (UniqueName: \"kubernetes.io/projected/c48b6191-d77a-4f53-94a9-2392b4f73a71-kube-api-access-sldc9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6\" (UID: \"c48b6191-d77a-4f53-94a9-2392b4f73a71\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"
Sep 10 23:04:31.983905 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.983865    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48b6191-d77a-4f53-94a9-2392b4f73a71-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6\" (UID: \"c48b6191-d77a-4f53-94a9-2392b4f73a71\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"
Sep 10 23:04:31.984105 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.983916    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48b6191-d77a-4f53-94a9-2392b4f73a71-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6\" (UID: \"c48b6191-d77a-4f53-94a9-2392b4f73a71\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"
Sep 10 23:04:31.984105 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.984045    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sldc9\" (UniqueName: \"kubernetes.io/projected/c48b6191-d77a-4f53-94a9-2392b4f73a71-kube-api-access-sldc9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6\" (UID: \"c48b6191-d77a-4f53-94a9-2392b4f73a71\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"
Sep 10 23:04:31.984317 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.984297    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48b6191-d77a-4f53-94a9-2392b4f73a71-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6\" (UID: \"c48b6191-d77a-4f53-94a9-2392b4f73a71\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"
Sep 10 23:04:31.984358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.984306    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48b6191-d77a-4f53-94a9-2392b4f73a71-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6\" (UID: \"c48b6191-d77a-4f53-94a9-2392b4f73a71\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"
Sep 10 23:04:31.998130 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:31.998096    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sldc9\" (UniqueName: \"kubernetes.io/projected/c48b6191-d77a-4f53-94a9-2392b4f73a71-kube-api-access-sldc9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6\" (UID: \"c48b6191-d77a-4f53-94a9-2392b4f73a71\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"
Sep 10 23:04:32.105009 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:32.104916    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"
Sep 10 23:04:32.385994 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:32.385957    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"]
Sep 10 23:04:32.388264 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:04:32.388235    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc48b6191_d77a_4f53_94a9_2392b4f73a71.slice/crio-8be0bfae24b34d5d137263e694324d5b255bb781558c49e518f606037903c41e WatchSource:0}: Error finding container 8be0bfae24b34d5d137263e694324d5b255bb781558c49e518f606037903c41e: Status 404 returned error can't find the container with id 8be0bfae24b34d5d137263e694324d5b255bb781558c49e518f606037903c41e
Sep 10 23:04:33.014139 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.014105    2585 generic.go:356] "Generic (PLEG): container finished" podID="c48b6191-d77a-4f53-94a9-2392b4f73a71" containerID="0c98500d239da794b8289ae2ed80096354b3e1c84645ee54c8955307bc2d83b5" exitCode=0
Sep 10 23:04:33.014495 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.014182    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6" event={"ID":"c48b6191-d77a-4f53-94a9-2392b4f73a71","Type":"ContainerDied","Data":"0c98500d239da794b8289ae2ed80096354b3e1c84645ee54c8955307bc2d83b5"}
Sep 10 23:04:33.014495 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.014233    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6" event={"ID":"c48b6191-d77a-4f53-94a9-2392b4f73a71","Type":"ContainerStarted","Data":"8be0bfae24b34d5d137263e694324d5b255bb781558c49e518f606037903c41e"}
Sep 10 23:04:33.650395 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.650354    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"]
Sep 10 23:04:33.654092 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.654067    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.657006 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.656966    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 23:04:33.657135 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.656988    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 23:04:33.657135 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.657043    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 23:04:33.657135 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.657046    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dppfd\""
Sep 10 23:04:33.657680 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.657662    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 23:04:33.676592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.676549    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"]
Sep 10 23:04:33.798627 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.798592    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/326dd1a2-19d6-4c64-93c2-b823e685521d-webhook-cert\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.798795 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.798662    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/326dd1a2-19d6-4c64-93c2-b823e685521d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.798795 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.798685    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/326dd1a2-19d6-4c64-93c2-b823e685521d-tmp\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.798795 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.798703    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tg9l\" (UniqueName: \"kubernetes.io/projected/326dd1a2-19d6-4c64-93c2-b823e685521d-kube-api-access-6tg9l\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.798795 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.798726    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/326dd1a2-19d6-4c64-93c2-b823e685521d-manifests\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.899651 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.899611    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/326dd1a2-19d6-4c64-93c2-b823e685521d-webhook-cert\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.899819 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.899689    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/326dd1a2-19d6-4c64-93c2-b823e685521d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.899819 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.899715    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/326dd1a2-19d6-4c64-93c2-b823e685521d-tmp\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.899819 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.899740    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tg9l\" (UniqueName: \"kubernetes.io/projected/326dd1a2-19d6-4c64-93c2-b823e685521d-kube-api-access-6tg9l\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.899979 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.899871    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/326dd1a2-19d6-4c64-93c2-b823e685521d-manifests\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.900280 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.900259    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/326dd1a2-19d6-4c64-93c2-b823e685521d-manifests\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.902290 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.902221    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/326dd1a2-19d6-4c64-93c2-b823e685521d-tmp\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.902290 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.902260    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/326dd1a2-19d6-4c64-93c2-b823e685521d-webhook-cert\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.902432 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.902338    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/326dd1a2-19d6-4c64-93c2-b823e685521d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.918269 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.918245    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tg9l\" (UniqueName: \"kubernetes.io/projected/326dd1a2-19d6-4c64-93c2-b823e685521d-kube-api-access-6tg9l\") pod \"opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7\" (UID: \"326dd1a2-19d6-4c64-93c2-b823e685521d\") " pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:33.964248 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:33.964218    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:34.252990 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:34.252186    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"]
Sep 10 23:04:34.274706 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:04:34.274673    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod326dd1a2_19d6_4c64_93c2_b823e685521d.slice/crio-048464ca6db0c0ee81dfc177a8bd161b6cd95fed9174f5b73afc17b3acb54059 WatchSource:0}: Error finding container 048464ca6db0c0ee81dfc177a8bd161b6cd95fed9174f5b73afc17b3acb54059: Status 404 returned error can't find the container with id 048464ca6db0c0ee81dfc177a8bd161b6cd95fed9174f5b73afc17b3acb54059
Sep 10 23:04:35.031264 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:35.031211    2585 generic.go:356] "Generic (PLEG): container finished" podID="c48b6191-d77a-4f53-94a9-2392b4f73a71" containerID="41405f8370bb30dc72d99e92012d77d1bd19cd5988c04bcbd3b16d1814aee801" exitCode=0
Sep 10 23:04:35.031476 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:35.031450    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6" event={"ID":"c48b6191-d77a-4f53-94a9-2392b4f73a71","Type":"ContainerDied","Data":"41405f8370bb30dc72d99e92012d77d1bd19cd5988c04bcbd3b16d1814aee801"}
Sep 10 23:04:35.034468 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:35.034399    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7" event={"ID":"326dd1a2-19d6-4c64-93c2-b823e685521d","Type":"ContainerStarted","Data":"048464ca6db0c0ee81dfc177a8bd161b6cd95fed9174f5b73afc17b3acb54059"}
Sep 10 23:04:36.043811 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:36.043775    2585 generic.go:356] "Generic (PLEG): container finished" podID="c48b6191-d77a-4f53-94a9-2392b4f73a71" containerID="25efda0f0ecb63851f3039270da53b03e03af957e53beb19fd9b14152ebd9732" exitCode=0
Sep 10 23:04:36.043811 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:36.043814    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6" event={"ID":"c48b6191-d77a-4f53-94a9-2392b4f73a71","Type":"ContainerDied","Data":"25efda0f0ecb63851f3039270da53b03e03af957e53beb19fd9b14152ebd9732"}
Sep 10 23:04:37.227305 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:37.227281    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"
Sep 10 23:04:37.328127 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:37.328103    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48b6191-d77a-4f53-94a9-2392b4f73a71-util\") pod \"c48b6191-d77a-4f53-94a9-2392b4f73a71\" (UID: \"c48b6191-d77a-4f53-94a9-2392b4f73a71\") "
Sep 10 23:04:37.328235 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:37.328161    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48b6191-d77a-4f53-94a9-2392b4f73a71-bundle\") pod \"c48b6191-d77a-4f53-94a9-2392b4f73a71\" (UID: \"c48b6191-d77a-4f53-94a9-2392b4f73a71\") "
Sep 10 23:04:37.328235 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:37.328198    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sldc9\" (UniqueName: \"kubernetes.io/projected/c48b6191-d77a-4f53-94a9-2392b4f73a71-kube-api-access-sldc9\") pod \"c48b6191-d77a-4f53-94a9-2392b4f73a71\" (UID: \"c48b6191-d77a-4f53-94a9-2392b4f73a71\") "
Sep 10 23:04:37.329045 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:37.329016    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c48b6191-d77a-4f53-94a9-2392b4f73a71-bundle" (OuterVolumeSpecName: "bundle") pod "c48b6191-d77a-4f53-94a9-2392b4f73a71" (UID: "c48b6191-d77a-4f53-94a9-2392b4f73a71"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:04:37.330048 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:37.330023    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c48b6191-d77a-4f53-94a9-2392b4f73a71-kube-api-access-sldc9" (OuterVolumeSpecName: "kube-api-access-sldc9") pod "c48b6191-d77a-4f53-94a9-2392b4f73a71" (UID: "c48b6191-d77a-4f53-94a9-2392b4f73a71"). InnerVolumeSpecName "kube-api-access-sldc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:04:37.333929 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:37.333903    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c48b6191-d77a-4f53-94a9-2392b4f73a71-util" (OuterVolumeSpecName: "util") pod "c48b6191-d77a-4f53-94a9-2392b4f73a71" (UID: "c48b6191-d77a-4f53-94a9-2392b4f73a71"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:04:37.429238 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:37.429201    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sldc9\" (UniqueName: \"kubernetes.io/projected/c48b6191-d77a-4f53-94a9-2392b4f73a71-kube-api-access-sldc9\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:04:37.429238 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:37.429228    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c48b6191-d77a-4f53-94a9-2392b4f73a71-util\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:04:37.429238 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:37.429237    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c48b6191-d77a-4f53-94a9-2392b4f73a71-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:04:38.057449 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:38.057407    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7" event={"ID":"326dd1a2-19d6-4c64-93c2-b823e685521d","Type":"ContainerStarted","Data":"785de01f12a78485e0061e61ea8644694a234bf441698535dbc20976245e5d9a"}
Sep 10 23:04:38.059664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:38.059639    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6"
Sep 10 23:04:38.059784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:38.059618    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0wq4b6" event={"ID":"c48b6191-d77a-4f53-94a9-2392b4f73a71","Type":"ContainerDied","Data":"8be0bfae24b34d5d137263e694324d5b255bb781558c49e518f606037903c41e"}
Sep 10 23:04:38.059784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:38.059761    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8be0bfae24b34d5d137263e694324d5b255bb781558c49e518f606037903c41e"
Sep 10 23:04:38.998291 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:38.998260    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67777b886f-7m8zp"
Sep 10 23:04:39.068320 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:39.068280    2585 generic.go:356] "Generic (PLEG): container finished" podID="326dd1a2-19d6-4c64-93c2-b823e685521d" containerID="785de01f12a78485e0061e61ea8644694a234bf441698535dbc20976245e5d9a" exitCode=0
Sep 10 23:04:39.068503 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:39.068352    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7" event={"ID":"326dd1a2-19d6-4c64-93c2-b823e685521d","Type":"ContainerDied","Data":"785de01f12a78485e0061e61ea8644694a234bf441698535dbc20976245e5d9a"}
Sep 10 23:04:41.080581 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:41.080518    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7" event={"ID":"326dd1a2-19d6-4c64-93c2-b823e685521d","Type":"ContainerStarted","Data":"6a79c0e5999c442736cb9467b749274934ecfa393c9d5701b274c6a10d8cf0cb"}
Sep 10 23:04:41.081085 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:41.080681    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:04:41.107277 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:41.107207    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7" podStartSLOduration=2.967697711 podStartE2EDuration="8.107183919s" totalImagesPullingTime="4.064558715s" totalInitContainerRuntime="1.074927493s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:04:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:04:41.103856251 +0000 UTC m=+393.282727247" watchObservedRunningTime="2026-09-10 23:04:41.107183919 +0000 UTC m=+393.286054883"
Sep 10 23:04:52.087836 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:04:52.087803    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7"
Sep 10 23:05:04.752395 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.752363    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bl6kg"]
Sep 10 23:05:04.752884 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.752671    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c48b6191-d77a-4f53-94a9-2392b4f73a71" containerName="util"
Sep 10 23:05:04.752884 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.752682    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c48b6191-d77a-4f53-94a9-2392b4f73a71" containerName="util"
Sep 10 23:05:04.752884 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.752689    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c48b6191-d77a-4f53-94a9-2392b4f73a71" containerName="extract"
Sep 10 23:05:04.752884 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.752695    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c48b6191-d77a-4f53-94a9-2392b4f73a71" containerName="extract"
Sep 10 23:05:04.752884 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.752704    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c48b6191-d77a-4f53-94a9-2392b4f73a71" containerName="pull"
Sep 10 23:05:04.752884 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.752710    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c48b6191-d77a-4f53-94a9-2392b4f73a71" containerName="pull"
Sep 10 23:05:04.752884 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.752758    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c48b6191-d77a-4f53-94a9-2392b4f73a71" containerName="extract"
Sep 10 23:05:04.756714 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.756685    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg"
Sep 10 23:05:04.763441 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.763414    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 23:05:04.763606 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.763486    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-g4dcb\""
Sep 10 23:05:04.777213 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.777187    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bl6kg"]
Sep 10 23:05:04.839165 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.839125    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0be5071d-f955-441b-8b3e-c5855bdc69e7-cert\") pod \"odh-model-controller-7998c67dc4-bl6kg\" (UID: \"0be5071d-f955-441b-8b3e-c5855bdc69e7\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg"
Sep 10 23:05:04.839500 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.839171    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zgq2\" (UniqueName: \"kubernetes.io/projected/0be5071d-f955-441b-8b3e-c5855bdc69e7-kube-api-access-7zgq2\") pod \"odh-model-controller-7998c67dc4-bl6kg\" (UID: \"0be5071d-f955-441b-8b3e-c5855bdc69e7\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg"
Sep 10 23:05:04.940491 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.940451    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0be5071d-f955-441b-8b3e-c5855bdc69e7-cert\") pod \"odh-model-controller-7998c67dc4-bl6kg\" (UID: \"0be5071d-f955-441b-8b3e-c5855bdc69e7\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg"
Sep 10 23:05:04.940491 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.940492    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zgq2\" (UniqueName: \"kubernetes.io/projected/0be5071d-f955-441b-8b3e-c5855bdc69e7-kube-api-access-7zgq2\") pod \"odh-model-controller-7998c67dc4-bl6kg\" (UID: \"0be5071d-f955-441b-8b3e-c5855bdc69e7\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg"
Sep 10 23:05:04.940717 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:05:04.940629    2585 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 23:05:04.940717 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:05:04.940708    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0be5071d-f955-441b-8b3e-c5855bdc69e7-cert podName:0be5071d-f955-441b-8b3e-c5855bdc69e7 nodeName:}" failed. No retries permitted until 2026-09-10 23:05:05.440688075 +0000 UTC m=+417.619559035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0be5071d-f955-441b-8b3e-c5855bdc69e7-cert") pod "odh-model-controller-7998c67dc4-bl6kg" (UID: "0be5071d-f955-441b-8b3e-c5855bdc69e7") : secret "odh-model-controller-webhook-cert" not found
Sep 10 23:05:04.957212 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:04.957187    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zgq2\" (UniqueName: \"kubernetes.io/projected/0be5071d-f955-441b-8b3e-c5855bdc69e7-kube-api-access-7zgq2\") pod \"odh-model-controller-7998c67dc4-bl6kg\" (UID: \"0be5071d-f955-441b-8b3e-c5855bdc69e7\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg"
Sep 10 23:05:05.443427 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:05.443393    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0be5071d-f955-441b-8b3e-c5855bdc69e7-cert\") pod \"odh-model-controller-7998c67dc4-bl6kg\" (UID: \"0be5071d-f955-441b-8b3e-c5855bdc69e7\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg"
Sep 10 23:05:05.445848 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:05.445828    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0be5071d-f955-441b-8b3e-c5855bdc69e7-cert\") pod \"odh-model-controller-7998c67dc4-bl6kg\" (UID: \"0be5071d-f955-441b-8b3e-c5855bdc69e7\") " pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg"
Sep 10 23:05:05.668322 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:05.668289    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg"
Sep 10 23:05:05.941147 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:05.941124    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bl6kg"]
Sep 10 23:05:05.943006 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:05:05.942979    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be5071d_f955_441b_8b3e_c5855bdc69e7.slice/crio-fcd85e38fceceefc6b723dce1967501b6d8e4f73fccda0f358f532d771720797 WatchSource:0}: Error finding container fcd85e38fceceefc6b723dce1967501b6d8e4f73fccda0f358f532d771720797: Status 404 returned error can't find the container with id fcd85e38fceceefc6b723dce1967501b6d8e4f73fccda0f358f532d771720797
Sep 10 23:05:06.193597 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.193545    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg" event={"ID":"0be5071d-f955-441b-8b3e-c5855bdc69e7","Type":"ContainerStarted","Data":"fcd85e38fceceefc6b723dce1967501b6d8e4f73fccda0f358f532d771720797"}
Sep 10 23:05:06.811832 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.811790    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"]
Sep 10 23:05:06.815051 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.815029    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.818356 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.818327    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vqsl8\""
Sep 10 23:05:06.818502 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.818479    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 23:05:06.838459 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.838423    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"]
Sep 10 23:05:06.857731 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.857682    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.857989 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.857756    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.857989 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.857784    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtwgm\" (UniqueName: \"kubernetes.io/projected/d13acf5c-3a29-4bae-bb41-222232226508-kube-api-access-jtwgm\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.857989 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.857812    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.857989 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.857852    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.857989 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.857917    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d13acf5c-3a29-4bae-bb41-222232226508-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.857989 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.857942    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d13acf5c-3a29-4bae-bb41-222232226508-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.857989 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.857963    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d13acf5c-3a29-4bae-bb41-222232226508-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.858346 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.857992    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.959065 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.959018    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.959550 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.959093    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.959550 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.959123    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtwgm\" (UniqueName: \"kubernetes.io/projected/d13acf5c-3a29-4bae-bb41-222232226508-kube-api-access-jtwgm\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.959550 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.959186    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.959550 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.959236    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.959550 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.959275    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d13acf5c-3a29-4bae-bb41-222232226508-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.959550 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.959300    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d13acf5c-3a29-4bae-bb41-222232226508-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.959550 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.959325    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d13acf5c-3a29-4bae-bb41-222232226508-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.959550 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.959360    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.960029 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.959546    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.960029 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.959609    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.960029 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.959787    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.960029 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.960012    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.960249 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.960225    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d13acf5c-3a29-4bae-bb41-222232226508-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.962969 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.962911    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d13acf5c-3a29-4bae-bb41-222232226508-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.962969 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.962937    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d13acf5c-3a29-4bae-bb41-222232226508-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.978815 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.978780    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d13acf5c-3a29-4bae-bb41-222232226508-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:06.979015 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:06.978932    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtwgm\" (UniqueName: \"kubernetes.io/projected/d13acf5c-3a29-4bae-bb41-222232226508-kube-api-access-jtwgm\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr\" (UID: \"d13acf5c-3a29-4bae-bb41-222232226508\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:07.128533 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:07.128413    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:07.422497 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:07.422436    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"]
Sep 10 23:05:07.425552 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:05:07.425523    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13acf5c_3a29_4bae_bb41_222232226508.slice/crio-69145057a4bf68c182643f970f42982342f9561cc39e1b81355f70d89dcb19e0 WatchSource:0}: Error finding container 69145057a4bf68c182643f970f42982342f9561cc39e1b81355f70d89dcb19e0: Status 404 returned error can't find the container with id 69145057a4bf68c182643f970f42982342f9561cc39e1b81355f70d89dcb19e0
Sep 10 23:05:08.210668 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:08.210629    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr" event={"ID":"d13acf5c-3a29-4bae-bb41-222232226508","Type":"ContainerStarted","Data":"69145057a4bf68c182643f970f42982342f9561cc39e1b81355f70d89dcb19e0"}
Sep 10 23:05:09.219623 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:09.219526    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg" event={"ID":"0be5071d-f955-441b-8b3e-c5855bdc69e7","Type":"ContainerStarted","Data":"e193790d490865ae13af952a62cbc5cc9ccc31532df64654a1100e075628e214"}
Sep 10 23:05:09.220330 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:09.220308    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg"
Sep 10 23:05:09.240954 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:09.240890    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg" podStartSLOduration=2.279121688 podStartE2EDuration="5.240868304s" totalImagesPullingTime="2.961746616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:05:09.240018252 +0000 UTC m=+421.418889221" watchObservedRunningTime="2026-09-10 23:05:09.240868304 +0000 UTC m=+421.419739268"
Sep 10 23:05:12.342028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.341989    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:05:12.342335 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.342060    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:05:12.342335 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.342090    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:05:12.778592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.778487    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67c9888cd-xnchc"]
Sep 10 23:05:12.782843 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.782818    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:12.787927 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.787656    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 10 23:05:12.791511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.788673    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 10 23:05:12.791511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.788905    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-29xcp\""
Sep 10 23:05:12.791511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.789163    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 10 23:05:12.791511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.789365    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 10 23:05:12.791511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.789528    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 10 23:05:12.794204 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.794183    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 10 23:05:12.801605 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.801582    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c9888cd-xnchc"]
Sep 10 23:05:12.913458 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.913417    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zl24\" (UniqueName: \"kubernetes.io/projected/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-kube-api-access-5zl24\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:12.913458 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.913462    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-console-oauth-config\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:12.913727 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.913493    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-trusted-ca-bundle\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:12.913727 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.913626    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-service-ca\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:12.913727 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.913656    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-console-config\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:12.913727 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.913682    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-console-serving-cert\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:12.913727 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:12.913714    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-oauth-serving-cert\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.014425 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.014390    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-service-ca\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.014425 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.014430    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-console-config\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.014696 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.014449    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-console-serving-cert\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.014696 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.014468    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-oauth-serving-cert\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.014696 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.014598    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zl24\" (UniqueName: \"kubernetes.io/projected/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-kube-api-access-5zl24\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.014696 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.014633    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-console-oauth-config\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.014696 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.014661    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-trusted-ca-bundle\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.015264 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.015228    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-oauth-serving-cert\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.015363 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.015229    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-service-ca\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.015363 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.015343    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-console-config\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.015604 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.015588    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-trusted-ca-bundle\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.017056 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.017039    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-console-serving-cert\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.017144 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.017126    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-console-oauth-config\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.031473 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.031422    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zl24\" (UniqueName: \"kubernetes.io/projected/71c8f4d0-1dca-4e81-8cd6-3d13c6826477-kube-api-access-5zl24\") pod \"console-67c9888cd-xnchc\" (UID: \"71c8f4d0-1dca-4e81-8cd6-3d13c6826477\") " pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.099547 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.099512    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:13.241660 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.241619    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr" event={"ID":"d13acf5c-3a29-4bae-bb41-222232226508","Type":"ContainerStarted","Data":"f6d9a4b845cdccddaaf405b8fc35d3d796aeac8c33ba352e57d0cecd35be0592"}
Sep 10 23:05:13.285092 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.285006    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr" podStartSLOduration=2.371258898 podStartE2EDuration="7.284990822s" totalImagesPullingTime="4.913731924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:05:13.280955904 +0000 UTC m=+425.459826867" watchObservedRunningTime="2026-09-10 23:05:13.284990822 +0000 UTC m=+425.463861784"
Sep 10 23:05:13.393935 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:13.393631    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67c9888cd-xnchc"]
Sep 10 23:05:13.396453 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:05:13.396427    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c8f4d0_1dca_4e81_8cd6_3d13c6826477.slice/crio-c410a60ecb146d65d4eb7ad4bfe5c5ee75c40b343a08a151435f0b330bbe806a WatchSource:0}: Error finding container c410a60ecb146d65d4eb7ad4bfe5c5ee75c40b343a08a151435f0b330bbe806a: Status 404 returned error can't find the container with id c410a60ecb146d65d4eb7ad4bfe5c5ee75c40b343a08a151435f0b330bbe806a
Sep 10 23:05:14.129391 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:14.129350    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:14.134029 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:14.134005    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:14.247990 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:14.247957    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c9888cd-xnchc" event={"ID":"71c8f4d0-1dca-4e81-8cd6-3d13c6826477","Type":"ContainerStarted","Data":"832506d467acc94e41664b9939afc497e1bfff263673908addafcd11bdb1dcfe"}
Sep 10 23:05:14.248148 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:14.248013    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67c9888cd-xnchc" event={"ID":"71c8f4d0-1dca-4e81-8cd6-3d13c6826477","Type":"ContainerStarted","Data":"c410a60ecb146d65d4eb7ad4bfe5c5ee75c40b343a08a151435f0b330bbe806a"}
Sep 10 23:05:14.248292 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:14.248271    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:14.249158 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:14.249142    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr"
Sep 10 23:05:14.286747 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:14.286673    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67c9888cd-xnchc" podStartSLOduration=2.286650831 podStartE2EDuration="2.286650831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:05:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:05:14.286354402 +0000 UTC m=+426.465225366" watchObservedRunningTime="2026-09-10 23:05:14.286650831 +0000 UTC m=+426.465521795"
Sep 10 23:05:15.114278 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:15.114233    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"]
Sep 10 23:05:15.118342 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:15.118317    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"
Sep 10 23:05:15.121671 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:15.121652    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7zlsr\""
Sep 10 23:05:15.121939 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:15.121923    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 10 23:05:15.138291 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:15.138261    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"]
Sep 10 23:05:15.234512 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:15.234467    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba2bbdc1-7755-4055-becf-aa8567d0af73-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n64zt\" (UID: \"ba2bbdc1-7755-4055-becf-aa8567d0af73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"
Sep 10 23:05:15.234719 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:15.234539    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msdds\" (UniqueName: \"kubernetes.io/projected/ba2bbdc1-7755-4055-becf-aa8567d0af73-kube-api-access-msdds\") pod \"llmisvc-controller-manager-777c6bd7d5-n64zt\" (UID: \"ba2bbdc1-7755-4055-becf-aa8567d0af73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"
Sep 10 23:05:15.335502 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:15.335447    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba2bbdc1-7755-4055-becf-aa8567d0af73-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n64zt\" (UID: \"ba2bbdc1-7755-4055-becf-aa8567d0af73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"
Sep 10 23:05:15.335727 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:15.335555    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msdds\" (UniqueName: \"kubernetes.io/projected/ba2bbdc1-7755-4055-becf-aa8567d0af73-kube-api-access-msdds\") pod \"llmisvc-controller-manager-777c6bd7d5-n64zt\" (UID: \"ba2bbdc1-7755-4055-becf-aa8567d0af73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"
Sep 10 23:05:15.335727 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:05:15.335612    2585 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 10 23:05:15.335727 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:05:15.335704    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba2bbdc1-7755-4055-becf-aa8567d0af73-cert podName:ba2bbdc1-7755-4055-becf-aa8567d0af73 nodeName:}" failed. No retries permitted until 2026-09-10 23:05:15.8356822 +0000 UTC m=+428.014553156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ba2bbdc1-7755-4055-becf-aa8567d0af73-cert") pod "llmisvc-controller-manager-777c6bd7d5-n64zt" (UID: "ba2bbdc1-7755-4055-becf-aa8567d0af73") : secret "llmisvc-webhook-server-cert" not found
Sep 10 23:05:15.350460 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:15.350439    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msdds\" (UniqueName: \"kubernetes.io/projected/ba2bbdc1-7755-4055-becf-aa8567d0af73-kube-api-access-msdds\") pod \"llmisvc-controller-manager-777c6bd7d5-n64zt\" (UID: \"ba2bbdc1-7755-4055-becf-aa8567d0af73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"
Sep 10 23:05:15.840167 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:15.840134    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba2bbdc1-7755-4055-becf-aa8567d0af73-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n64zt\" (UID: \"ba2bbdc1-7755-4055-becf-aa8567d0af73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"
Sep 10 23:05:15.842467 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:15.842438    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ba2bbdc1-7755-4055-becf-aa8567d0af73-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n64zt\" (UID: \"ba2bbdc1-7755-4055-becf-aa8567d0af73\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"
Sep 10 23:05:16.027857 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:16.027821    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"
Sep 10 23:05:16.310683 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:16.310650    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"]
Sep 10 23:05:16.312057 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:05:16.312033    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podba2bbdc1_7755_4055_becf_aa8567d0af73.slice/crio-e7fd08f68d9bed48c39f8ca59a1992fece8894b3906c84a6a164d78f0f4c3764 WatchSource:0}: Error finding container e7fd08f68d9bed48c39f8ca59a1992fece8894b3906c84a6a164d78f0f4c3764: Status 404 returned error can't find the container with id e7fd08f68d9bed48c39f8ca59a1992fece8894b3906c84a6a164d78f0f4c3764
Sep 10 23:05:17.264700 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:17.264663    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt" event={"ID":"ba2bbdc1-7755-4055-becf-aa8567d0af73","Type":"ContainerStarted","Data":"e7fd08f68d9bed48c39f8ca59a1992fece8894b3906c84a6a164d78f0f4c3764"}
Sep 10 23:05:20.281711 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:20.281671    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt" event={"ID":"ba2bbdc1-7755-4055-becf-aa8567d0af73","Type":"ContainerStarted","Data":"45d41da00536893420879fd3f3367d4730487eb62572ca74ff9dca10e6fdb361"}
Sep 10 23:05:20.282131 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:20.281863    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"
Sep 10 23:05:20.312950 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:20.312905    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt" podStartSLOduration=2.418863419 podStartE2EDuration="5.312889635s" totalImagesPullingTime="2.894026216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:05:20.312317711 +0000 UTC m=+432.491188676" watchObservedRunningTime="2026-09-10 23:05:20.312889635 +0000 UTC m=+432.491760597"
Sep 10 23:05:21.232010 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:21.231977    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bl6kg"
Sep 10 23:05:23.099834 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:23.099795    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:23.100317 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:23.099856    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:23.104935 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:23.104903    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:23.306707 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:23.306677    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67c9888cd-xnchc"
Sep 10 23:05:51.289307 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:05:51.289276    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n64zt"
Sep 10 23:06:09.545829 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.545795    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"]
Sep 10 23:06:09.549286 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.549266    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"
Sep 10 23:06:09.552073 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.552055    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 10 23:06:09.552197 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.552175    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 10 23:06:09.559409 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.559395    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-mvt47\""
Sep 10 23:06:09.568276 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.568250    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"]
Sep 10 23:06:09.600934 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.600902    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxwtg\" (UniqueName: \"kubernetes.io/projected/725f7e3c-cf3f-4912-8564-8a4f478314ef-kube-api-access-mxwtg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh\" (UID: \"725f7e3c-cf3f-4912-8564-8a4f478314ef\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"
Sep 10 23:06:09.601080 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.600940    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/725f7e3c-cf3f-4912-8564-8a4f478314ef-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh\" (UID: \"725f7e3c-cf3f-4912-8564-8a4f478314ef\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"
Sep 10 23:06:09.601080 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.601046    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/725f7e3c-cf3f-4912-8564-8a4f478314ef-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh\" (UID: \"725f7e3c-cf3f-4912-8564-8a4f478314ef\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"
Sep 10 23:06:09.680761 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.680721    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"]
Sep 10 23:06:09.684248 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.684231    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"
Sep 10 23:06:09.701688 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.701662    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxwtg\" (UniqueName: \"kubernetes.io/projected/725f7e3c-cf3f-4912-8564-8a4f478314ef-kube-api-access-mxwtg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh\" (UID: \"725f7e3c-cf3f-4912-8564-8a4f478314ef\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"
Sep 10 23:06:09.701804 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.701697    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/725f7e3c-cf3f-4912-8564-8a4f478314ef-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh\" (UID: \"725f7e3c-cf3f-4912-8564-8a4f478314ef\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"
Sep 10 23:06:09.701804 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.701784    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/725f7e3c-cf3f-4912-8564-8a4f478314ef-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh\" (UID: \"725f7e3c-cf3f-4912-8564-8a4f478314ef\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"
Sep 10 23:06:09.702232 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.702203    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/725f7e3c-cf3f-4912-8564-8a4f478314ef-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh\" (UID: \"725f7e3c-cf3f-4912-8564-8a4f478314ef\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"
Sep 10 23:06:09.702320 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.702257    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/725f7e3c-cf3f-4912-8564-8a4f478314ef-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh\" (UID: \"725f7e3c-cf3f-4912-8564-8a4f478314ef\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"
Sep 10 23:06:09.703082 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.703062    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"]
Sep 10 23:06:09.712789 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.712768    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxwtg\" (UniqueName: \"kubernetes.io/projected/725f7e3c-cf3f-4912-8564-8a4f478314ef-kube-api-access-mxwtg\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh\" (UID: \"725f7e3c-cf3f-4912-8564-8a4f478314ef\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"
Sep 10 23:06:09.785495 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.785468    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"]
Sep 10 23:06:09.788971 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.788954    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"
Sep 10 23:06:09.800604 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.800541    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"]
Sep 10 23:06:09.802893 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.802871    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/047451f5-aa15-41cc-9a78-0ae821ddf555-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv\" (UID: \"047451f5-aa15-41cc-9a78-0ae821ddf555\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"
Sep 10 23:06:09.802987 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.802897    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/047451f5-aa15-41cc-9a78-0ae821ddf555-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv\" (UID: \"047451f5-aa15-41cc-9a78-0ae821ddf555\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"
Sep 10 23:06:09.803036 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.802988    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8s84\" (UniqueName: \"kubernetes.io/projected/047451f5-aa15-41cc-9a78-0ae821ddf555-kube-api-access-b8s84\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv\" (UID: \"047451f5-aa15-41cc-9a78-0ae821ddf555\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"
Sep 10 23:06:09.856007 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.855972    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"]
Sep 10 23:06:09.858118 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.858101    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"
Sep 10 23:06:09.859351 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.859336    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"
Sep 10 23:06:09.872409 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.872389    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"]
Sep 10 23:06:09.903791 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.903758    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv7kx\" (UniqueName: \"kubernetes.io/projected/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-kube-api-access-gv7kx\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf\" (UID: \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"
Sep 10 23:06:09.903791 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.903800    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8s84\" (UniqueName: \"kubernetes.io/projected/047451f5-aa15-41cc-9a78-0ae821ddf555-kube-api-access-b8s84\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv\" (UID: \"047451f5-aa15-41cc-9a78-0ae821ddf555\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"
Sep 10 23:06:09.904064 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.903824    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v96rj\" (UniqueName: \"kubernetes.io/projected/251ddc5d-94d6-4164-8b87-ddf17888f6b5-kube-api-access-v96rj\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4\" (UID: \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"
Sep 10 23:06:09.904064 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.903866    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/251ddc5d-94d6-4164-8b87-ddf17888f6b5-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4\" (UID: \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"
Sep 10 23:06:09.904064 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.903884    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf\" (UID: \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"
Sep 10 23:06:09.904064 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.903902    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/047451f5-aa15-41cc-9a78-0ae821ddf555-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv\" (UID: \"047451f5-aa15-41cc-9a78-0ae821ddf555\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"
Sep 10 23:06:09.904064 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.903934    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/047451f5-aa15-41cc-9a78-0ae821ddf555-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv\" (UID: \"047451f5-aa15-41cc-9a78-0ae821ddf555\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"
Sep 10 23:06:09.904064 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.903967    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/251ddc5d-94d6-4164-8b87-ddf17888f6b5-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4\" (UID: \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"
Sep 10 23:06:09.904064 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.903999    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf\" (UID: \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"
Sep 10 23:06:09.904430 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.904266    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/047451f5-aa15-41cc-9a78-0ae821ddf555-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv\" (UID: \"047451f5-aa15-41cc-9a78-0ae821ddf555\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"
Sep 10 23:06:09.904430 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.904284    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/047451f5-aa15-41cc-9a78-0ae821ddf555-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv\" (UID: \"047451f5-aa15-41cc-9a78-0ae821ddf555\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"
Sep 10 23:06:09.915836 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.915809    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8s84\" (UniqueName: \"kubernetes.io/projected/047451f5-aa15-41cc-9a78-0ae821ddf555-kube-api-access-b8s84\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv\" (UID: \"047451f5-aa15-41cc-9a78-0ae821ddf555\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"
Sep 10 23:06:09.993003 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:09.992971    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"
Sep 10 23:06:10.005304 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.005279    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v96rj\" (UniqueName: \"kubernetes.io/projected/251ddc5d-94d6-4164-8b87-ddf17888f6b5-kube-api-access-v96rj\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4\" (UID: \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"
Sep 10 23:06:10.005401 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.005326    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/251ddc5d-94d6-4164-8b87-ddf17888f6b5-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4\" (UID: \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"
Sep 10 23:06:10.005401 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.005351    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf\" (UID: \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"
Sep 10 23:06:10.005401 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.005390    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/251ddc5d-94d6-4164-8b87-ddf17888f6b5-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4\" (UID: \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"
Sep 10 23:06:10.005611 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.005428    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf\" (UID: \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"
Sep 10 23:06:10.005611 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.005473    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv7kx\" (UniqueName: \"kubernetes.io/projected/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-kube-api-access-gv7kx\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf\" (UID: \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"
Sep 10 23:06:10.005779 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.005753    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/251ddc5d-94d6-4164-8b87-ddf17888f6b5-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4\" (UID: \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"
Sep 10 23:06:10.005871 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.005832    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/251ddc5d-94d6-4164-8b87-ddf17888f6b5-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4\" (UID: \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"
Sep 10 23:06:10.005960 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.005939    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf\" (UID: \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"
Sep 10 23:06:10.006046 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.006019    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf\" (UID: \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"
Sep 10 23:06:10.015156 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.015134    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv7kx\" (UniqueName: \"kubernetes.io/projected/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-kube-api-access-gv7kx\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf\" (UID: \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"
Sep 10 23:06:10.015263 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.015201    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v96rj\" (UniqueName: \"kubernetes.io/projected/251ddc5d-94d6-4164-8b87-ddf17888f6b5-kube-api-access-v96rj\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4\" (UID: \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"
Sep 10 23:06:10.098818 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.098744    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"
Sep 10 23:06:10.141545 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.141514    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"]
Sep 10 23:06:10.143055 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:06:10.143032    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod725f7e3c_cf3f_4912_8564_8a4f478314ef.slice/crio-42b8148f2dffa697759a9d7bd7d64354ca19382c9aa11b11b1d0191c2da92212 WatchSource:0}: Error finding container 42b8148f2dffa697759a9d7bd7d64354ca19382c9aa11b11b1d0191c2da92212: Status 404 returned error can't find the container with id 42b8148f2dffa697759a9d7bd7d64354ca19382c9aa11b11b1d0191c2da92212
Sep 10 23:06:10.183434 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.183408    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"
Sep 10 23:06:10.269738 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.269706    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"]
Sep 10 23:06:10.317374 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:06:10.317345    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047451f5_aa15_41cc_9a78_0ae821ddf555.slice/crio-1c0b753f10ef0e7c8434138875530384d387b42828fcea62bd501fd7d218639c WatchSource:0}: Error finding container 1c0b753f10ef0e7c8434138875530384d387b42828fcea62bd501fd7d218639c: Status 404 returned error can't find the container with id 1c0b753f10ef0e7c8434138875530384d387b42828fcea62bd501fd7d218639c
Sep 10 23:06:10.381052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.381027    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"]
Sep 10 23:06:10.382161 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:06:10.382136    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb160721c_4ef9_4c7e_9ec1_b7ceedc33c50.slice/crio-cbde6d203bfa0e340a960aed51be99f0f4cf43f6a357ad53b7f92828fcf40302 WatchSource:0}: Error finding container cbde6d203bfa0e340a960aed51be99f0f4cf43f6a357ad53b7f92828fcf40302: Status 404 returned error can't find the container with id cbde6d203bfa0e340a960aed51be99f0f4cf43f6a357ad53b7f92828fcf40302
Sep 10 23:06:10.463637 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.463608    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"]
Sep 10 23:06:10.488501 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:06:10.488475    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251ddc5d_94d6_4164_8b87_ddf17888f6b5.slice/crio-76ed25b3aab5fdba58592f7683f611ef2c6410256c6626e526a8130198616165 WatchSource:0}: Error finding container 76ed25b3aab5fdba58592f7683f611ef2c6410256c6626e526a8130198616165: Status 404 returned error can't find the container with id 76ed25b3aab5fdba58592f7683f611ef2c6410256c6626e526a8130198616165
Sep 10 23:06:10.532922 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.532882    2585 generic.go:356] "Generic (PLEG): container finished" podID="725f7e3c-cf3f-4912-8564-8a4f478314ef" containerID="0b96b97b4ed04cd588c3c09d53fb9f20def36ede0f5904bd1e0a81466541b1f4" exitCode=0
Sep 10 23:06:10.533068 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.532967    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh" event={"ID":"725f7e3c-cf3f-4912-8564-8a4f478314ef","Type":"ContainerDied","Data":"0b96b97b4ed04cd588c3c09d53fb9f20def36ede0f5904bd1e0a81466541b1f4"}
Sep 10 23:06:10.533068 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.533030    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh" event={"ID":"725f7e3c-cf3f-4912-8564-8a4f478314ef","Type":"ContainerStarted","Data":"42b8148f2dffa697759a9d7bd7d64354ca19382c9aa11b11b1d0191c2da92212"}
Sep 10 23:06:10.535053 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.535019    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf" event={"ID":"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50","Type":"ContainerStarted","Data":"96cbdc9d8a05586ffaa8f9050d47f923a2f33c6b16287dfb86a98c1c9d8a4162"}
Sep 10 23:06:10.535189 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.535080    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf" event={"ID":"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50","Type":"ContainerStarted","Data":"cbde6d203bfa0e340a960aed51be99f0f4cf43f6a357ad53b7f92828fcf40302"}
Sep 10 23:06:10.536548 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.536522    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4" event={"ID":"251ddc5d-94d6-4164-8b87-ddf17888f6b5","Type":"ContainerStarted","Data":"76ed25b3aab5fdba58592f7683f611ef2c6410256c6626e526a8130198616165"}
Sep 10 23:06:10.538276 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.538249    2585 generic.go:356] "Generic (PLEG): container finished" podID="047451f5-aa15-41cc-9a78-0ae821ddf555" containerID="ce842568adad75480f5ef8ca75ff8442bbfa69c0afea6458ea107866a549e8c1" exitCode=0
Sep 10 23:06:10.538363 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.538308    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv" event={"ID":"047451f5-aa15-41cc-9a78-0ae821ddf555","Type":"ContainerDied","Data":"ce842568adad75480f5ef8ca75ff8442bbfa69c0afea6458ea107866a549e8c1"}
Sep 10 23:06:10.538363 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:10.538336    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv" event={"ID":"047451f5-aa15-41cc-9a78-0ae821ddf555","Type":"ContainerStarted","Data":"1c0b753f10ef0e7c8434138875530384d387b42828fcea62bd501fd7d218639c"}
Sep 10 23:06:11.545805 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:11.545774    2585 generic.go:356] "Generic (PLEG): container finished" podID="b160721c-4ef9-4c7e-9ec1-b7ceedc33c50" containerID="96cbdc9d8a05586ffaa8f9050d47f923a2f33c6b16287dfb86a98c1c9d8a4162" exitCode=0
Sep 10 23:06:11.546152 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:11.545851    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf" event={"ID":"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50","Type":"ContainerDied","Data":"96cbdc9d8a05586ffaa8f9050d47f923a2f33c6b16287dfb86a98c1c9d8a4162"}
Sep 10 23:06:11.548336 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:11.548314    2585 generic.go:356] "Generic (PLEG): container finished" podID="251ddc5d-94d6-4164-8b87-ddf17888f6b5" containerID="4a628beb3fec56218d319f74716f8aeb5d6fc7524062e526fe56505ded59d642" exitCode=0
Sep 10 23:06:11.548430 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:11.548387    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4" event={"ID":"251ddc5d-94d6-4164-8b87-ddf17888f6b5","Type":"ContainerDied","Data":"4a628beb3fec56218d319f74716f8aeb5d6fc7524062e526fe56505ded59d642"}
Sep 10 23:06:12.560080 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:12.560052    2585 generic.go:356] "Generic (PLEG): container finished" podID="b160721c-4ef9-4c7e-9ec1-b7ceedc33c50" containerID="17e790165c3608f6e3c4c7e82c621da47eb3f3660aa841f0a6c1b23c728b4b6c" exitCode=0
Sep 10 23:06:12.560410 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:12.560130    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf" event={"ID":"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50","Type":"ContainerDied","Data":"17e790165c3608f6e3c4c7e82c621da47eb3f3660aa841f0a6c1b23c728b4b6c"}
Sep 10 23:06:12.562230 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:12.562207    2585 generic.go:356] "Generic (PLEG): container finished" podID="047451f5-aa15-41cc-9a78-0ae821ddf555" containerID="911717c82b01d46426cfd22073cd4429151471198bd3d2e48e3656eeee321c97" exitCode=0
Sep 10 23:06:12.562336 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:12.562254    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv" event={"ID":"047451f5-aa15-41cc-9a78-0ae821ddf555","Type":"ContainerDied","Data":"911717c82b01d46426cfd22073cd4429151471198bd3d2e48e3656eeee321c97"}
Sep 10 23:06:12.564790 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:12.564766    2585 generic.go:356] "Generic (PLEG): container finished" podID="725f7e3c-cf3f-4912-8564-8a4f478314ef" containerID="e8a020ee99330e530985b70867fceafceeee703c643d18730f1cecd310792728" exitCode=0
Sep 10 23:06:12.564889 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:12.564833    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh" event={"ID":"725f7e3c-cf3f-4912-8564-8a4f478314ef","Type":"ContainerDied","Data":"e8a020ee99330e530985b70867fceafceeee703c643d18730f1cecd310792728"}
Sep 10 23:06:13.572963 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:13.572930    2585 generic.go:356] "Generic (PLEG): container finished" podID="b160721c-4ef9-4c7e-9ec1-b7ceedc33c50" containerID="ff4fdebc98f295ff71174b0a44d74e2535efa13d2ecb6d2b3a94dceb46a7fe6b" exitCode=0
Sep 10 23:06:13.573376 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:13.573019    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf" event={"ID":"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50","Type":"ContainerDied","Data":"ff4fdebc98f295ff71174b0a44d74e2535efa13d2ecb6d2b3a94dceb46a7fe6b"}
Sep 10 23:06:13.574816 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:13.574791    2585 generic.go:356] "Generic (PLEG): container finished" podID="251ddc5d-94d6-4164-8b87-ddf17888f6b5" containerID="f3b8752da3f447c537152ac93eb18109dc228f7c4efe02d52ac2bf2880a29c88" exitCode=0
Sep 10 23:06:13.574934 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:13.574876    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4" event={"ID":"251ddc5d-94d6-4164-8b87-ddf17888f6b5","Type":"ContainerDied","Data":"f3b8752da3f447c537152ac93eb18109dc228f7c4efe02d52ac2bf2880a29c88"}
Sep 10 23:06:13.577114 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:13.577085    2585 generic.go:356] "Generic (PLEG): container finished" podID="047451f5-aa15-41cc-9a78-0ae821ddf555" containerID="5b09a5c7a6bde7274e3c3493a4dc25207997b5eec5ca3e846209fc661fe31c36" exitCode=0
Sep 10 23:06:13.577205 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:13.577164    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv" event={"ID":"047451f5-aa15-41cc-9a78-0ae821ddf555","Type":"ContainerDied","Data":"5b09a5c7a6bde7274e3c3493a4dc25207997b5eec5ca3e846209fc661fe31c36"}
Sep 10 23:06:13.579053 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:13.579033    2585 generic.go:356] "Generic (PLEG): container finished" podID="725f7e3c-cf3f-4912-8564-8a4f478314ef" containerID="ebdae593a12294d2d94e4933749883c2b7d2ce4cbc5c3926963db477377dad83" exitCode=0
Sep 10 23:06:13.579147 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:13.579073    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh" event={"ID":"725f7e3c-cf3f-4912-8564-8a4f478314ef","Type":"ContainerDied","Data":"ebdae593a12294d2d94e4933749883c2b7d2ce4cbc5c3926963db477377dad83"}
Sep 10 23:06:14.585886 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.585848    2585 generic.go:356] "Generic (PLEG): container finished" podID="251ddc5d-94d6-4164-8b87-ddf17888f6b5" containerID="e53764a8daed3f84cec73c24e9bb5cf0dbe182eb67fc8f1057e41e3f56a02a85" exitCode=0
Sep 10 23:06:14.586344 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.585919    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4" event={"ID":"251ddc5d-94d6-4164-8b87-ddf17888f6b5","Type":"ContainerDied","Data":"e53764a8daed3f84cec73c24e9bb5cf0dbe182eb67fc8f1057e41e3f56a02a85"}
Sep 10 23:06:14.743172 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.743148    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"
Sep 10 23:06:14.761611 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.761552    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"
Sep 10 23:06:14.769359 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.769337    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"
Sep 10 23:06:14.850598 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.850502    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8s84\" (UniqueName: \"kubernetes.io/projected/047451f5-aa15-41cc-9a78-0ae821ddf555-kube-api-access-b8s84\") pod \"047451f5-aa15-41cc-9a78-0ae821ddf555\" (UID: \"047451f5-aa15-41cc-9a78-0ae821ddf555\") "
Sep 10 23:06:14.850598 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.850552    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gv7kx\" (UniqueName: \"kubernetes.io/projected/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-kube-api-access-gv7kx\") pod \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\" (UID: \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\") "
Sep 10 23:06:14.850598 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.850590    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-util\") pod \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\" (UID: \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\") "
Sep 10 23:06:14.850844 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.850613    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/725f7e3c-cf3f-4912-8564-8a4f478314ef-util\") pod \"725f7e3c-cf3f-4912-8564-8a4f478314ef\" (UID: \"725f7e3c-cf3f-4912-8564-8a4f478314ef\") "
Sep 10 23:06:14.850844 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.850636    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/047451f5-aa15-41cc-9a78-0ae821ddf555-bundle\") pod \"047451f5-aa15-41cc-9a78-0ae821ddf555\" (UID: \"047451f5-aa15-41cc-9a78-0ae821ddf555\") "
Sep 10 23:06:14.850844 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.850681    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/725f7e3c-cf3f-4912-8564-8a4f478314ef-bundle\") pod \"725f7e3c-cf3f-4912-8564-8a4f478314ef\" (UID: \"725f7e3c-cf3f-4912-8564-8a4f478314ef\") "
Sep 10 23:06:14.850844 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.850711    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/047451f5-aa15-41cc-9a78-0ae821ddf555-util\") pod \"047451f5-aa15-41cc-9a78-0ae821ddf555\" (UID: \"047451f5-aa15-41cc-9a78-0ae821ddf555\") "
Sep 10 23:06:14.850844 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.850742    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-bundle\") pod \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\" (UID: \"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50\") "
Sep 10 23:06:14.850844 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.850774    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxwtg\" (UniqueName: \"kubernetes.io/projected/725f7e3c-cf3f-4912-8564-8a4f478314ef-kube-api-access-mxwtg\") pod \"725f7e3c-cf3f-4912-8564-8a4f478314ef\" (UID: \"725f7e3c-cf3f-4912-8564-8a4f478314ef\") "
Sep 10 23:06:14.851731 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.851430    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/725f7e3c-cf3f-4912-8564-8a4f478314ef-bundle" (OuterVolumeSpecName: "bundle") pod "725f7e3c-cf3f-4912-8564-8a4f478314ef" (UID: "725f7e3c-cf3f-4912-8564-8a4f478314ef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:06:14.851731 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.851548    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047451f5-aa15-41cc-9a78-0ae821ddf555-bundle" (OuterVolumeSpecName: "bundle") pod "047451f5-aa15-41cc-9a78-0ae821ddf555" (UID: "047451f5-aa15-41cc-9a78-0ae821ddf555"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:06:14.851731 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.851705    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-bundle" (OuterVolumeSpecName: "bundle") pod "b160721c-4ef9-4c7e-9ec1-b7ceedc33c50" (UID: "b160721c-4ef9-4c7e-9ec1-b7ceedc33c50"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:06:14.853180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.853150    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/725f7e3c-cf3f-4912-8564-8a4f478314ef-kube-api-access-mxwtg" (OuterVolumeSpecName: "kube-api-access-mxwtg") pod "725f7e3c-cf3f-4912-8564-8a4f478314ef" (UID: "725f7e3c-cf3f-4912-8564-8a4f478314ef"). InnerVolumeSpecName "kube-api-access-mxwtg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:06:14.853287 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.853190    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-kube-api-access-gv7kx" (OuterVolumeSpecName: "kube-api-access-gv7kx") pod "b160721c-4ef9-4c7e-9ec1-b7ceedc33c50" (UID: "b160721c-4ef9-4c7e-9ec1-b7ceedc33c50"). InnerVolumeSpecName "kube-api-access-gv7kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:06:14.853358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.853310    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/047451f5-aa15-41cc-9a78-0ae821ddf555-kube-api-access-b8s84" (OuterVolumeSpecName: "kube-api-access-b8s84") pod "047451f5-aa15-41cc-9a78-0ae821ddf555" (UID: "047451f5-aa15-41cc-9a78-0ae821ddf555"). InnerVolumeSpecName "kube-api-access-b8s84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:06:14.856462 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.856435    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/725f7e3c-cf3f-4912-8564-8a4f478314ef-util" (OuterVolumeSpecName: "util") pod "725f7e3c-cf3f-4912-8564-8a4f478314ef" (UID: "725f7e3c-cf3f-4912-8564-8a4f478314ef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:06:14.857277 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.857257    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-util" (OuterVolumeSpecName: "util") pod "b160721c-4ef9-4c7e-9ec1-b7ceedc33c50" (UID: "b160721c-4ef9-4c7e-9ec1-b7ceedc33c50"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:06:14.857673 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.857649    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047451f5-aa15-41cc-9a78-0ae821ddf555-util" (OuterVolumeSpecName: "util") pod "047451f5-aa15-41cc-9a78-0ae821ddf555" (UID: "047451f5-aa15-41cc-9a78-0ae821ddf555"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:06:14.952455 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.952424    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gv7kx\" (UniqueName: \"kubernetes.io/projected/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-kube-api-access-gv7kx\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:06:14.952455 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.952450    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-util\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:06:14.952455 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.952461    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/725f7e3c-cf3f-4912-8564-8a4f478314ef-util\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:06:14.952697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.952469    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/047451f5-aa15-41cc-9a78-0ae821ddf555-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:06:14.952697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.952477    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/725f7e3c-cf3f-4912-8564-8a4f478314ef-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:06:14.952697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.952484    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/047451f5-aa15-41cc-9a78-0ae821ddf555-util\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:06:14.952697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.952491    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b160721c-4ef9-4c7e-9ec1-b7ceedc33c50-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:06:14.952697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.952500    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxwtg\" (UniqueName: \"kubernetes.io/projected/725f7e3c-cf3f-4912-8564-8a4f478314ef-kube-api-access-mxwtg\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:06:14.952697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:14.952509    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8s84\" (UniqueName: \"kubernetes.io/projected/047451f5-aa15-41cc-9a78-0ae821ddf555-kube-api-access-b8s84\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:06:15.593819 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.593787    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv"
Sep 10 23:06:15.594287 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.593791    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6lx6xv" event={"ID":"047451f5-aa15-41cc-9a78-0ae821ddf555","Type":"ContainerDied","Data":"1c0b753f10ef0e7c8434138875530384d387b42828fcea62bd501fd7d218639c"}
Sep 10 23:06:15.594287 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.593935    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c0b753f10ef0e7c8434138875530384d387b42828fcea62bd501fd7d218639c"
Sep 10 23:06:15.595708 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.595688    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh"
Sep 10 23:06:15.595818 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.595714    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847atjznh" event={"ID":"725f7e3c-cf3f-4912-8564-8a4f478314ef","Type":"ContainerDied","Data":"42b8148f2dffa697759a9d7bd7d64354ca19382c9aa11b11b1d0191c2da92212"}
Sep 10 23:06:15.595818 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.595752    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42b8148f2dffa697759a9d7bd7d64354ca19382c9aa11b11b1d0191c2da92212"
Sep 10 23:06:15.597660 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.597631    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf" event={"ID":"b160721c-4ef9-4c7e-9ec1-b7ceedc33c50","Type":"ContainerDied","Data":"cbde6d203bfa0e340a960aed51be99f0f4cf43f6a357ad53b7f92828fcf40302"}
Sep 10 23:06:15.597660 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.597650    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7qwpdf"
Sep 10 23:06:15.597805 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.597676    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbde6d203bfa0e340a960aed51be99f0f4cf43f6a357ad53b7f92828fcf40302"
Sep 10 23:06:15.717913 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.717881    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"
Sep 10 23:06:15.860251 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.860170    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/251ddc5d-94d6-4164-8b87-ddf17888f6b5-util\") pod \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\" (UID: \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\") "
Sep 10 23:06:15.860251 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.860209    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v96rj\" (UniqueName: \"kubernetes.io/projected/251ddc5d-94d6-4164-8b87-ddf17888f6b5-kube-api-access-v96rj\") pod \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\" (UID: \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\") "
Sep 10 23:06:15.860251 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.860231    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/251ddc5d-94d6-4164-8b87-ddf17888f6b5-bundle\") pod \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\" (UID: \"251ddc5d-94d6-4164-8b87-ddf17888f6b5\") "
Sep 10 23:06:15.860793 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.860766    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/251ddc5d-94d6-4164-8b87-ddf17888f6b5-bundle" (OuterVolumeSpecName: "bundle") pod "251ddc5d-94d6-4164-8b87-ddf17888f6b5" (UID: "251ddc5d-94d6-4164-8b87-ddf17888f6b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:06:15.862272 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.862249    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/251ddc5d-94d6-4164-8b87-ddf17888f6b5-kube-api-access-v96rj" (OuterVolumeSpecName: "kube-api-access-v96rj") pod "251ddc5d-94d6-4164-8b87-ddf17888f6b5" (UID: "251ddc5d-94d6-4164-8b87-ddf17888f6b5"). InnerVolumeSpecName "kube-api-access-v96rj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:06:15.902934 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.902901    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/251ddc5d-94d6-4164-8b87-ddf17888f6b5-util" (OuterVolumeSpecName: "util") pod "251ddc5d-94d6-4164-8b87-ddf17888f6b5" (UID: "251ddc5d-94d6-4164-8b87-ddf17888f6b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:06:15.961832 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.961805    2585 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/251ddc5d-94d6-4164-8b87-ddf17888f6b5-util\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:06:15.961832 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.961831    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v96rj\" (UniqueName: \"kubernetes.io/projected/251ddc5d-94d6-4164-8b87-ddf17888f6b5-kube-api-access-v96rj\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:06:15.961944 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:15.961841    2585 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/251ddc5d-94d6-4164-8b87-ddf17888f6b5-bundle\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:06:16.603451 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:16.603377    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4"
Sep 10 23:06:16.603904 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:16.603377    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmspf4" event={"ID":"251ddc5d-94d6-4164-8b87-ddf17888f6b5","Type":"ContainerDied","Data":"76ed25b3aab5fdba58592f7683f611ef2c6410256c6626e526a8130198616165"}
Sep 10 23:06:16.603904 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:16.603488    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76ed25b3aab5fdba58592f7683f611ef2c6410256c6626e526a8130198616165"
Sep 10 23:06:25.900754 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.900715    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"]
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901045    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725f7e3c-cf3f-4912-8564-8a4f478314ef" containerName="util"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901057    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="725f7e3c-cf3f-4912-8564-8a4f478314ef" containerName="util"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901065    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b160721c-4ef9-4c7e-9ec1-b7ceedc33c50" containerName="extract"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901071    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b160721c-4ef9-4c7e-9ec1-b7ceedc33c50" containerName="extract"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901079    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b160721c-4ef9-4c7e-9ec1-b7ceedc33c50" containerName="util"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901085    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b160721c-4ef9-4c7e-9ec1-b7ceedc33c50" containerName="util"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901091    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047451f5-aa15-41cc-9a78-0ae821ddf555" containerName="pull"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901096    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="047451f5-aa15-41cc-9a78-0ae821ddf555" containerName="pull"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901103    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725f7e3c-cf3f-4912-8564-8a4f478314ef" containerName="extract"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901108    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="725f7e3c-cf3f-4912-8564-8a4f478314ef" containerName="extract"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901120    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="725f7e3c-cf3f-4912-8564-8a4f478314ef" containerName="pull"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901125    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="725f7e3c-cf3f-4912-8564-8a4f478314ef" containerName="pull"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901131    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="251ddc5d-94d6-4164-8b87-ddf17888f6b5" containerName="util"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901136    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="251ddc5d-94d6-4164-8b87-ddf17888f6b5" containerName="util"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901141    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="251ddc5d-94d6-4164-8b87-ddf17888f6b5" containerName="pull"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901146    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="251ddc5d-94d6-4164-8b87-ddf17888f6b5" containerName="pull"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901155    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047451f5-aa15-41cc-9a78-0ae821ddf555" containerName="extract"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901160    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="047451f5-aa15-41cc-9a78-0ae821ddf555" containerName="extract"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901167    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b160721c-4ef9-4c7e-9ec1-b7ceedc33c50" containerName="pull"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901171    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b160721c-4ef9-4c7e-9ec1-b7ceedc33c50" containerName="pull"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901179    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047451f5-aa15-41cc-9a78-0ae821ddf555" containerName="util"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901184    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="047451f5-aa15-41cc-9a78-0ae821ddf555" containerName="util"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901190    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="251ddc5d-94d6-4164-8b87-ddf17888f6b5" containerName="extract"
Sep 10 23:06:25.901207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901194    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="251ddc5d-94d6-4164-8b87-ddf17888f6b5" containerName="extract"
Sep 10 23:06:25.901945 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901240    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="047451f5-aa15-41cc-9a78-0ae821ddf555" containerName="extract"
Sep 10 23:06:25.901945 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901248    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="251ddc5d-94d6-4164-8b87-ddf17888f6b5" containerName="extract"
Sep 10 23:06:25.901945 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901257    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b160721c-4ef9-4c7e-9ec1-b7ceedc33c50" containerName="extract"
Sep 10 23:06:25.901945 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.901262    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="725f7e3c-cf3f-4912-8564-8a4f478314ef" containerName="extract"
Sep 10 23:06:25.905408 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.905390    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"
Sep 10 23:06:25.909127 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.909104    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kfn4h\""
Sep 10 23:06:25.909267 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.909152    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 23:06:25.910120 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.910101    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 23:06:25.974011 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:25.973976    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"]
Sep 10 23:06:26.048915 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:26.048869    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twgcb\" (UniqueName: \"kubernetes.io/projected/907c3758-faf0-4b49-a32c-ca279e5cdd5c-kube-api-access-twgcb\") pod \"limitador-operator-controller-manager-74495c69f8-4jx9q\" (UID: \"907c3758-faf0-4b49-a32c-ca279e5cdd5c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"
Sep 10 23:06:26.149906 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:26.149874    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twgcb\" (UniqueName: \"kubernetes.io/projected/907c3758-faf0-4b49-a32c-ca279e5cdd5c-kube-api-access-twgcb\") pod \"limitador-operator-controller-manager-74495c69f8-4jx9q\" (UID: \"907c3758-faf0-4b49-a32c-ca279e5cdd5c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"
Sep 10 23:06:26.165022 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:26.164949    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twgcb\" (UniqueName: \"kubernetes.io/projected/907c3758-faf0-4b49-a32c-ca279e5cdd5c-kube-api-access-twgcb\") pod \"limitador-operator-controller-manager-74495c69f8-4jx9q\" (UID: \"907c3758-faf0-4b49-a32c-ca279e5cdd5c\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"
Sep 10 23:06:26.215573 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:26.215522    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"
Sep 10 23:06:26.514714 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:26.514681    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"]
Sep 10 23:06:26.515237 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:06:26.515204    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod907c3758_faf0_4b49_a32c_ca279e5cdd5c.slice/crio-8bbe7d4135788b146ba30813ea36fcfc0ce300aad38d39f92ba1b8600ee18c36 WatchSource:0}: Error finding container 8bbe7d4135788b146ba30813ea36fcfc0ce300aad38d39f92ba1b8600ee18c36: Status 404 returned error can't find the container with id 8bbe7d4135788b146ba30813ea36fcfc0ce300aad38d39f92ba1b8600ee18c36
Sep 10 23:06:26.653740 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:26.653704    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q" event={"ID":"907c3758-faf0-4b49-a32c-ca279e5cdd5c","Type":"ContainerStarted","Data":"8bbe7d4135788b146ba30813ea36fcfc0ce300aad38d39f92ba1b8600ee18c36"}
Sep 10 23:06:29.673969 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:29.673930    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q" event={"ID":"907c3758-faf0-4b49-a32c-ca279e5cdd5c","Type":"ContainerStarted","Data":"ee6b327e5ca9a6ad294d52f522e7c7566f2eda7dd9aab26b94e5ff7de762bc26"}
Sep 10 23:06:29.674368 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:29.674093    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"
Sep 10 23:06:29.707019 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:29.706965    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q" podStartSLOduration=2.208364069 podStartE2EDuration="4.706950447s" totalImagesPullingTime="2.498586378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:06:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:06:29.704062111 +0000 UTC m=+501.882933074" watchObservedRunningTime="2026-09-10 23:06:29.706950447 +0000 UTC m=+501.885821411"
Sep 10 23:06:31.607482 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.607444    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"]
Sep 10 23:06:31.610924 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.610903    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"
Sep 10 23:06:31.614503 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.614480    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 10 23:06:31.614503 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.614500    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 10 23:06:31.614721 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.614529    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vpt4b\""
Sep 10 23:06:31.668650 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.668620    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"]
Sep 10 23:06:31.698152 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.698124    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-g6dgk\" (UID: \"3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"
Sep 10 23:06:31.698326 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.698158    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-g6dgk\" (UID: \"3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"
Sep 10 23:06:31.698326 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.698292    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6sf4\" (UniqueName: \"kubernetes.io/projected/3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e-kube-api-access-v6sf4\") pod \"kuadrant-console-plugin-fbdd4f445-g6dgk\" (UID: \"3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"
Sep 10 23:06:31.798683 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.798653    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6sf4\" (UniqueName: \"kubernetes.io/projected/3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e-kube-api-access-v6sf4\") pod \"kuadrant-console-plugin-fbdd4f445-g6dgk\" (UID: \"3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"
Sep 10 23:06:31.798683 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.798690    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-g6dgk\" (UID: \"3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"
Sep 10 23:06:31.798941 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.798705    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-g6dgk\" (UID: \"3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"
Sep 10 23:06:31.798941 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:06:31.798816    2585 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 10 23:06:31.798941 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:06:31.798896    2585 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e-plugin-serving-cert podName:3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e nodeName:}" failed. No retries permitted until 2026-09-10 23:06:32.298876543 +0000 UTC m=+504.477747497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-g6dgk" (UID: "3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e") : secret "plugin-serving-cert" not found
Sep 10 23:06:31.799321 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.799303    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-g6dgk\" (UID: \"3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"
Sep 10 23:06:31.816103 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:31.816079    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6sf4\" (UniqueName: \"kubernetes.io/projected/3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e-kube-api-access-v6sf4\") pod \"kuadrant-console-plugin-fbdd4f445-g6dgk\" (UID: \"3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"
Sep 10 23:06:32.303705 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:32.303663    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-g6dgk\" (UID: \"3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"
Sep 10 23:06:32.306098 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:32.306079    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-g6dgk\" (UID: \"3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"
Sep 10 23:06:32.522116 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:32.522083    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"
Sep 10 23:06:32.798824 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:32.798801    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk"]
Sep 10 23:06:32.800755 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:06:32.800724    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3366cc4a_ebf8_4f94_bc7d_fadf25a78d4e.slice/crio-15281b251adc2b1c9f05b004f66c18f775b46188a22d8b8186fe14d34a62850e WatchSource:0}: Error finding container 15281b251adc2b1c9f05b004f66c18f775b46188a22d8b8186fe14d34a62850e: Status 404 returned error can't find the container with id 15281b251adc2b1c9f05b004f66c18f775b46188a22d8b8186fe14d34a62850e
Sep 10 23:06:33.700604 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:33.700522    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk" event={"ID":"3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e","Type":"ContainerStarted","Data":"15281b251adc2b1c9f05b004f66c18f775b46188a22d8b8186fe14d34a62850e"}
Sep 10 23:06:37.728580 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:37.728473    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk" event={"ID":"3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e","Type":"ContainerStarted","Data":"951a930907a7ca7b7f2dad9742dc1966e2422a16c887576e533b8f6486e3b629"}
Sep 10 23:06:37.752222 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:37.752174    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-g6dgk" podStartSLOduration=2.256325778 podStartE2EDuration="6.752160338s" totalImagesPullingTime="4.49583456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:06:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:06:37.751099492 +0000 UTC m=+509.929970455" watchObservedRunningTime="2026-09-10 23:06:37.752160338 +0000 UTC m=+509.931031300"
Sep 10 23:06:40.682060 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:40.682030    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"
Sep 10 23:06:42.631931 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.631884    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"]
Sep 10 23:06:42.636960 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.636856    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"
Sep 10 23:06:42.639663 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.639641    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-264xh\""
Sep 10 23:06:42.662257 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.662229    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"]
Sep 10 23:06:42.677217 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.677187    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"]
Sep 10 23:06:42.677425 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.677398    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q" podUID="907c3758-faf0-4b49-a32c-ca279e5cdd5c" containerName="manager" containerID="cri-o://ee6b327e5ca9a6ad294d52f522e7c7566f2eda7dd9aab26b94e5ff7de762bc26" gracePeriod=2
Sep 10 23:06:42.684085 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.684033    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"]
Sep 10 23:06:42.695203 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:06:42.695174    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4jx9q\" is forbidden: User \"system:node:ip-10-0-138-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-139.ec2.internal' and this object" podUID="907c3758-faf0-4b49-a32c-ca279e5cdd5c" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"
Sep 10 23:06:42.695625 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.695605    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07524aef-a6f2-49f8-a5e0-8251dfdbd5cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5jf4q\" (UID: \"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"
Sep 10 23:06:42.695729 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.695656    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v74q\" (UniqueName: \"kubernetes.io/projected/07524aef-a6f2-49f8-a5e0-8251dfdbd5cd-kube-api-access-9v74q\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5jf4q\" (UID: \"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"
Sep 10 23:06:42.796764 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.796743    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07524aef-a6f2-49f8-a5e0-8251dfdbd5cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5jf4q\" (UID: \"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"
Sep 10 23:06:42.796843 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.796789    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v74q\" (UniqueName: \"kubernetes.io/projected/07524aef-a6f2-49f8-a5e0-8251dfdbd5cd-kube-api-access-9v74q\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5jf4q\" (UID: \"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"
Sep 10 23:06:42.797149 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.797125    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07524aef-a6f2-49f8-a5e0-8251dfdbd5cd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5jf4q\" (UID: \"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"
Sep 10 23:06:42.813227 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.813199    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v74q\" (UniqueName: \"kubernetes.io/projected/07524aef-a6f2-49f8-a5e0-8251dfdbd5cd-kube-api-access-9v74q\") pod \"kuadrant-operator-controller-manager-5769f99d9f-5jf4q\" (UID: \"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"
Sep 10 23:06:42.920271 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.920248    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"
Sep 10 23:06:42.922828 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:06:42.922801    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4jx9q\" is forbidden: User \"system:node:ip-10-0-138-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-139.ec2.internal' and this object" podUID="907c3758-faf0-4b49-a32c-ca279e5cdd5c" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"
Sep 10 23:06:42.947016 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.946991    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"
Sep 10 23:06:42.999720 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:42.999019    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twgcb\" (UniqueName: \"kubernetes.io/projected/907c3758-faf0-4b49-a32c-ca279e5cdd5c-kube-api-access-twgcb\") pod \"907c3758-faf0-4b49-a32c-ca279e5cdd5c\" (UID: \"907c3758-faf0-4b49-a32c-ca279e5cdd5c\") "
Sep 10 23:06:43.003125 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:43.003077    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/907c3758-faf0-4b49-a32c-ca279e5cdd5c-kube-api-access-twgcb" (OuterVolumeSpecName: "kube-api-access-twgcb") pod "907c3758-faf0-4b49-a32c-ca279e5cdd5c" (UID: "907c3758-faf0-4b49-a32c-ca279e5cdd5c"). InnerVolumeSpecName "kube-api-access-twgcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:06:43.100146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:43.100114    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twgcb\" (UniqueName: \"kubernetes.io/projected/907c3758-faf0-4b49-a32c-ca279e5cdd5c-kube-api-access-twgcb\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:06:43.234764 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:43.234736    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"]
Sep 10 23:06:43.236571 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:06:43.236535    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07524aef_a6f2_49f8_a5e0_8251dfdbd5cd.slice/crio-385ca8d91333ecdca19cc584cfce178a4a64b2e4a06cee6f4a5318f5faf2671d WatchSource:0}: Error finding container 385ca8d91333ecdca19cc584cfce178a4a64b2e4a06cee6f4a5318f5faf2671d: Status 404 returned error can't find the container with id 385ca8d91333ecdca19cc584cfce178a4a64b2e4a06cee6f4a5318f5faf2671d
Sep 10 23:06:43.763509 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:43.763476    2585 generic.go:356] "Generic (PLEG): container finished" podID="907c3758-faf0-4b49-a32c-ca279e5cdd5c" containerID="ee6b327e5ca9a6ad294d52f522e7c7566f2eda7dd9aab26b94e5ff7de762bc26" exitCode=0
Sep 10 23:06:43.763997 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:43.763540    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"
Sep 10 23:06:43.763997 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:43.763601    2585 scope.go:117] "RemoveContainer" containerID="ee6b327e5ca9a6ad294d52f522e7c7566f2eda7dd9aab26b94e5ff7de762bc26"
Sep 10 23:06:43.765678 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:43.765649    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q" event={"ID":"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd","Type":"ContainerStarted","Data":"385ca8d91333ecdca19cc584cfce178a4a64b2e4a06cee6f4a5318f5faf2671d"}
Sep 10 23:06:43.766762 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:06:43.766728    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4jx9q\" is forbidden: User \"system:node:ip-10-0-138-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-139.ec2.internal' and this object" podUID="907c3758-faf0-4b49-a32c-ca279e5cdd5c" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"
Sep 10 23:06:43.774901 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:43.774874    2585 scope.go:117] "RemoveContainer" containerID="ee6b327e5ca9a6ad294d52f522e7c7566f2eda7dd9aab26b94e5ff7de762bc26"
Sep 10 23:06:43.775167 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:06:43.775151    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee6b327e5ca9a6ad294d52f522e7c7566f2eda7dd9aab26b94e5ff7de762bc26\": container with ID starting with ee6b327e5ca9a6ad294d52f522e7c7566f2eda7dd9aab26b94e5ff7de762bc26 not found: ID does not exist" containerID="ee6b327e5ca9a6ad294d52f522e7c7566f2eda7dd9aab26b94e5ff7de762bc26"
Sep 10 23:06:43.775243 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:43.775173    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee6b327e5ca9a6ad294d52f522e7c7566f2eda7dd9aab26b94e5ff7de762bc26"} err="failed to get container status \"ee6b327e5ca9a6ad294d52f522e7c7566f2eda7dd9aab26b94e5ff7de762bc26\": rpc error: code = NotFound desc = could not find container \"ee6b327e5ca9a6ad294d52f522e7c7566f2eda7dd9aab26b94e5ff7de762bc26\": container with ID starting with ee6b327e5ca9a6ad294d52f522e7c7566f2eda7dd9aab26b94e5ff7de762bc26 not found: ID does not exist"
Sep 10 23:06:43.775967 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:06:43.775944    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-4jx9q\" is forbidden: User \"system:node:ip-10-0-138-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-139.ec2.internal' and this object" podUID="907c3758-faf0-4b49-a32c-ca279e5cdd5c" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-4jx9q"
Sep 10 23:06:44.342896 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:44.342860    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="907c3758-faf0-4b49-a32c-ca279e5cdd5c" path="/var/lib/kubelet/pods/907c3758-faf0-4b49-a32c-ca279e5cdd5c/volumes"
Sep 10 23:06:46.797031 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:46.796994    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q" event={"ID":"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd","Type":"ContainerStarted","Data":"0d9e73e77edba03a8172b98eba5420a5b3b5c7e393434e3039f4f778346e9fcf"}
Sep 10 23:06:46.797345 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:46.797119    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"
Sep 10 23:06:46.846277 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:46.846220    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q" podStartSLOduration=1.364180199 podStartE2EDuration="4.846204419s" totalImagesPullingTime="3.48202422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:06:46.84402568 +0000 UTC m=+519.022896667" watchObservedRunningTime="2026-09-10 23:06:46.846204419 +0000 UTC m=+519.025075382"
Sep 10 23:06:57.805003 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:06:57.804968    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"
Sep 10 23:07:14.349919 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.349886    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"]
Sep 10 23:07:14.350349 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.350215    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="907c3758-faf0-4b49-a32c-ca279e5cdd5c" containerName="manager"
Sep 10 23:07:14.350349 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.350226    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="907c3758-faf0-4b49-a32c-ca279e5cdd5c" containerName="manager"
Sep 10 23:07:14.350349 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.350297    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="907c3758-faf0-4b49-a32c-ca279e5cdd5c" containerName="manager"
Sep 10 23:07:14.372208 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.372171    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"]
Sep 10 23:07:14.372382 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.372265    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.374751 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.374721    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-t2c2p\""
Sep 10 23:07:14.471532 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.471500    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.471532 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.471538    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f38eef04-b82b-4f71-94c2-5f768febbfb7-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.471796 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.471597    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.471796 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.471622    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.471796 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.471660    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f38eef04-b82b-4f71-94c2-5f768febbfb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.471796 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.471715    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f38eef04-b82b-4f71-94c2-5f768febbfb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.471951 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.471802    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpsgc\" (UniqueName: \"kubernetes.io/projected/f38eef04-b82b-4f71-94c2-5f768febbfb7-kube-api-access-zpsgc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.471951 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.471835    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.471951 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.471859    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.572866 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.572830    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.572866 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.572870    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.573133 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.572894    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.573133 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.573019    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f38eef04-b82b-4f71-94c2-5f768febbfb7-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.573133 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.573060    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.573295 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.573199    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.573295 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.573284    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.573402 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.573291    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f38eef04-b82b-4f71-94c2-5f768febbfb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.573402 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.573331    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.573402 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.573361    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f38eef04-b82b-4f71-94c2-5f768febbfb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.573592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.573445    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpsgc\" (UniqueName: \"kubernetes.io/projected/f38eef04-b82b-4f71-94c2-5f768febbfb7-kube-api-access-zpsgc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.573592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.573454    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.573592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.573531    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.574260 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.574235    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f38eef04-b82b-4f71-94c2-5f768febbfb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.575448 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.575423    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f38eef04-b82b-4f71-94c2-5f768febbfb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.575730 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.575713    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f38eef04-b82b-4f71-94c2-5f768febbfb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.583002 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.582977    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f38eef04-b82b-4f71-94c2-5f768febbfb7-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.583434 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.583414    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpsgc\" (UniqueName: \"kubernetes.io/projected/f38eef04-b82b-4f71-94c2-5f768febbfb7-kube-api-access-zpsgc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-9ks5r\" (UID: \"f38eef04-b82b-4f71-94c2-5f768febbfb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.682212 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.682130    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:14.984440 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:07:14.984398    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf38eef04_b82b_4f71_94c2_5f768febbfb7.slice/crio-5804b3eb8a961b41e17febe1f9c049a5448636a21b07336b5ceca71ec71e85a3 WatchSource:0}: Error finding container 5804b3eb8a961b41e17febe1f9c049a5448636a21b07336b5ceca71ec71e85a3: Status 404 returned error can't find the container with id 5804b3eb8a961b41e17febe1f9c049a5448636a21b07336b5ceca71ec71e85a3
Sep 10 23:07:14.985550 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.985524    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"]
Sep 10 23:07:14.986498 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.986466    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:07:14.986601 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.986530    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:07:14.986601 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:14.986586    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:07:15.949374 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:15.949338    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r" event={"ID":"f38eef04-b82b-4f71-94c2-5f768febbfb7","Type":"ContainerStarted","Data":"dc713497994e5f2ef5c3346f2edb3308d2a36bf290ce085dd21af7ef6cc288fb"}
Sep 10 23:07:15.949854 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:15.949393    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r" event={"ID":"f38eef04-b82b-4f71-94c2-5f768febbfb7","Type":"ContainerStarted","Data":"5804b3eb8a961b41e17febe1f9c049a5448636a21b07336b5ceca71ec71e85a3"}
Sep 10 23:07:15.991010 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:15.990957    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r" podStartSLOduration=1.990940954 podStartE2EDuration="1.990940954s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:07:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:07:15.988599618 +0000 UTC m=+548.167470578" watchObservedRunningTime="2026-09-10 23:07:15.990940954 +0000 UTC m=+548.169811916"
Sep 10 23:07:16.683136 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:16.683099    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:16.687829 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:16.687802    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:16.955033 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:16.954947    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:07:16.955865 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:07:16.955847    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:08:08.283119 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:08.283087    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:08:08.283708 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:08.283087    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:08:08.289912 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:08.289888    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:08:08.290113 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:08.290002    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:08:30.438294 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:30.438254    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pdlcg"]
Sep 10 23:08:30.442005 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:30.441982    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-pdlcg"
Sep 10 23:08:30.445121 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:30.445091    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 10 23:08:30.445473 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:30.445455    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-prl7r\""
Sep 10 23:08:30.455199 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:30.455173    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pdlcg"]
Sep 10 23:08:30.541250 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:30.541212    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3faa5574-b510-4949-b387-cc6607c9b0ac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pdlcg\" (UID: \"3faa5574-b510-4949-b387-cc6607c9b0ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pdlcg"
Sep 10 23:08:30.541428 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:30.541267    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2p6s\" (UniqueName: \"kubernetes.io/projected/3faa5574-b510-4949-b387-cc6607c9b0ac-kube-api-access-f2p6s\") pod \"payload-processing-5b54b7fbb7-pdlcg\" (UID: \"3faa5574-b510-4949-b387-cc6607c9b0ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pdlcg"
Sep 10 23:08:30.641825 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:30.641791    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2p6s\" (UniqueName: \"kubernetes.io/projected/3faa5574-b510-4949-b387-cc6607c9b0ac-kube-api-access-f2p6s\") pod \"payload-processing-5b54b7fbb7-pdlcg\" (UID: \"3faa5574-b510-4949-b387-cc6607c9b0ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pdlcg"
Sep 10 23:08:30.642028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:30.641886    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3faa5574-b510-4949-b387-cc6607c9b0ac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pdlcg\" (UID: \"3faa5574-b510-4949-b387-cc6607c9b0ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pdlcg"
Sep 10 23:08:30.642509 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:30.642489    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3faa5574-b510-4949-b387-cc6607c9b0ac-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-pdlcg\" (UID: \"3faa5574-b510-4949-b387-cc6607c9b0ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pdlcg"
Sep 10 23:08:30.652214 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:30.652188    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2p6s\" (UniqueName: \"kubernetes.io/projected/3faa5574-b510-4949-b387-cc6607c9b0ac-kube-api-access-f2p6s\") pod \"payload-processing-5b54b7fbb7-pdlcg\" (UID: \"3faa5574-b510-4949-b387-cc6607c9b0ac\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-pdlcg"
Sep 10 23:08:30.754649 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:30.754510    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-pdlcg"
Sep 10 23:08:31.038760 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:31.038692    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-pdlcg"]
Sep 10 23:08:31.041143 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:08:31.041102    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3faa5574_b510_4949_b387_cc6607c9b0ac.slice/crio-9c0d7bb14e73440f0d9a91c495ced5ffb925d924aa7dc08cf923ab8d28bba899 WatchSource:0}: Error finding container 9c0d7bb14e73440f0d9a91c495ced5ffb925d924aa7dc08cf923ab8d28bba899: Status 404 returned error can't find the container with id 9c0d7bb14e73440f0d9a91c495ced5ffb925d924aa7dc08cf923ab8d28bba899
Sep 10 23:08:31.339867 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:31.339828    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-pdlcg" event={"ID":"3faa5574-b510-4949-b387-cc6607c9b0ac","Type":"ContainerStarted","Data":"9c0d7bb14e73440f0d9a91c495ced5ffb925d924aa7dc08cf923ab8d28bba899"}
Sep 10 23:08:33.354551 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:33.354503    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-pdlcg" event={"ID":"3faa5574-b510-4949-b387-cc6607c9b0ac","Type":"ContainerStarted","Data":"a1fdde4b8bf923af0740493457b331c9bd9a6bcf7c34b7d0ffb185705c2c7291"}
Sep 10 23:08:33.355040 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:33.354736    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-pdlcg"
Sep 10 23:08:33.378186 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:33.378143    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-pdlcg" podStartSLOduration=1.588178747 podStartE2EDuration="3.378127721s" totalImagesPullingTime="1.789948974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:08:33.377748592 +0000 UTC m=+625.556619558" watchObservedRunningTime="2026-09-10 23:08:33.378127721 +0000 UTC m=+625.556998683"
Sep 10 23:08:40.397805 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:40.397771    2585 generic.go:356] "Generic (PLEG): container finished" podID="f38eef04-b82b-4f71-94c2-5f768febbfb7" containerID="dc713497994e5f2ef5c3346f2edb3308d2a36bf290ce085dd21af7ef6cc288fb" exitCode=0
Sep 10 23:08:40.398344 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:40.397838    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r" event={"ID":"f38eef04-b82b-4f71-94c2-5f768febbfb7","Type":"ContainerDied","Data":"dc713497994e5f2ef5c3346f2edb3308d2a36bf290ce085dd21af7ef6cc288fb"}
Sep 10 23:08:40.398344 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:40.398285    2585 scope.go:117] "RemoveContainer" containerID="dc713497994e5f2ef5c3346f2edb3308d2a36bf290ce085dd21af7ef6cc288fb"
Sep 10 23:08:40.399291 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:40.399262    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:08:40.399372 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:40.399327    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:08:40.399372 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:40.399360    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:08:41.409192 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:41.409145    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r" event={"ID":"f38eef04-b82b-4f71-94c2-5f768febbfb7","Type":"ContainerStarted","Data":"020cc36e1fed5d1487b679242594f2226eceec10b18cfc2259f493897f63609c"}
Sep 10 23:08:41.683122 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:41.683029    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:08:41.683274 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:41.683260    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9ks5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 23:08:41.683322 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:41.683301    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r" podUID="f38eef04-b82b-4f71-94c2-5f768febbfb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 23:08:42.683175 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:42.683139    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9ks5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 23:08:42.683584 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:42.683195    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r" podUID="f38eef04-b82b-4f71-94c2-5f768febbfb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 23:08:43.683346 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:43.683310    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9ks5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 23:08:43.683758 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:43.683374    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r" podUID="f38eef04-b82b-4f71-94c2-5f768febbfb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 23:08:44.361488 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:44.361455    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-pdlcg"
Sep 10 23:08:44.682707 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:44.682621    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9ks5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 23:08:44.682707 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:44.682671    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r" podUID="f38eef04-b82b-4f71-94c2-5f768febbfb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 23:08:45.682809 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:45.682772    2585 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-9ks5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 10 23:08:45.683196 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:45.682840    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r" podUID="f38eef04-b82b-4f71-94c2-5f768febbfb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 10 23:08:46.686480 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:46.686386    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:08:46.686909 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:46.686682    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:08:46.687427 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:08:46.687410    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-9ks5r"
Sep 10 23:11:57.965762 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:57.965728    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"]
Sep 10 23:11:57.969478 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:57.969456    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:57.974267 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:57.974242    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-28dbae-openshift-default-dockercfg-wb5bb\""
Sep 10 23:11:57.981937 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:57.981911    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"]
Sep 10 23:11:57.995034 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:57.995010    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09798020-4363-4103-9577-fca7a6aba795-istio-token\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:57.995237 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:57.995045    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09798020-4363-4103-9577-fca7a6aba795-istiod-ca-cert\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:57.995237 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:57.995123    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09798020-4363-4103-9577-fca7a6aba795-istio-podinfo\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:57.995237 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:57.995169    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-workload-certs\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:57.995237 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:57.995192    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-istio-data\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:57.995237 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:57.995227    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-istio-envoy\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:57.995598 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:57.995274    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-workload-socket\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:57.995598 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:57.995297    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld4hf\" (UniqueName: \"kubernetes.io/projected/09798020-4363-4103-9577-fca7a6aba795-kube-api-access-ld4hf\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:57.995598 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:57.995345    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-credential-socket\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.096466 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.096429    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-credential-socket\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.096685 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.096501    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09798020-4363-4103-9577-fca7a6aba795-istio-token\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.096685 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.096528    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09798020-4363-4103-9577-fca7a6aba795-istiod-ca-cert\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.096685 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.096601    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09798020-4363-4103-9577-fca7a6aba795-istio-podinfo\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.096685 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.096633    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-workload-certs\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.097358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.096924    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-credential-socket\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.097358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.096942    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-istio-data\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.097358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.097002    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-istio-envoy\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.097358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.097041    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-workload-socket\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.097358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.097064    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld4hf\" (UniqueName: \"kubernetes.io/projected/09798020-4363-4103-9577-fca7a6aba795-kube-api-access-ld4hf\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.097358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.097181    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-istio-data\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.097358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.097232    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-workload-certs\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.097358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.097318    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09798020-4363-4103-9577-fca7a6aba795-istiod-ca-cert\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.097795 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.097514    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-workload-socket\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.099373 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.099351    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09798020-4363-4103-9577-fca7a6aba795-istio-podinfo\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.099540 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.099521    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-istio-envoy\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.110844 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.110813    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld4hf\" (UniqueName: \"kubernetes.io/projected/09798020-4363-4103-9577-fca7a6aba795-kube-api-access-ld4hf\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.111191 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.111166    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09798020-4363-4103-9577-fca7a6aba795-istio-token\") pod \"e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") " pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.281801 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.281708    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:11:58.563072 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.563043    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"]
Sep 10 23:11:58.564622 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:11:58.564594    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09798020_4363_4103_9577_fca7a6aba795.slice/crio-7b6b24f611fa7f8fb26bb651772705414ecad52716e335100e23539de77767ce WatchSource:0}: Error finding container 7b6b24f611fa7f8fb26bb651772705414ecad52716e335100e23539de77767ce: Status 404 returned error can't find the container with id 7b6b24f611fa7f8fb26bb651772705414ecad52716e335100e23539de77767ce
Sep 10 23:11:58.566647 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.566614    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:11:58.566722 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.566704    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:11:58.566760 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:58.566732    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:11:59.464525 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:59.464496    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" event={"ID":"09798020-4363-4103-9577-fca7a6aba795","Type":"ContainerStarted","Data":"6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6"}
Sep 10 23:11:59.464962 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:59.464543    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" event={"ID":"09798020-4363-4103-9577-fca7a6aba795","Type":"ContainerStarted","Data":"7b6b24f611fa7f8fb26bb651772705414ecad52716e335100e23539de77767ce"}
Sep 10 23:11:59.500601 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:59.500527    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" podStartSLOduration=2.5005063 podStartE2EDuration="2.5005063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:11:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:11:59.496697338 +0000 UTC m=+831.675568323" watchObservedRunningTime="2026-09-10 23:11:59.5005063 +0000 UTC m=+831.679377265"
Sep 10 23:11:59.607778 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:59.607744    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7667-5094d0"]
Sep 10 23:11:59.611274 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:59.611250    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-5094d0"
Sep 10 23:11:59.613833 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:59.613810    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nn896\""
Sep 10 23:11:59.625946 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:59.625918    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7667-5094d0"]
Sep 10 23:11:59.711260 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:59.711220    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hhfr\" (UniqueName: \"kubernetes.io/projected/9643df9e-319d-4884-a500-075ca6f1b0e1-kube-api-access-2hhfr\") pod \"test-curl-7667-5094d0\" (UID: \"9643df9e-319d-4884-a500-075ca6f1b0e1\") " pod="opendatahub/test-curl-7667-5094d0"
Sep 10 23:11:59.812297 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:59.812253    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hhfr\" (UniqueName: \"kubernetes.io/projected/9643df9e-319d-4884-a500-075ca6f1b0e1-kube-api-access-2hhfr\") pod \"test-curl-7667-5094d0\" (UID: \"9643df9e-319d-4884-a500-075ca6f1b0e1\") " pod="opendatahub/test-curl-7667-5094d0"
Sep 10 23:11:59.827420 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:59.827393    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hhfr\" (UniqueName: \"kubernetes.io/projected/9643df9e-319d-4884-a500-075ca6f1b0e1-kube-api-access-2hhfr\") pod \"test-curl-7667-5094d0\" (UID: \"9643df9e-319d-4884-a500-075ca6f1b0e1\") " pod="opendatahub/test-curl-7667-5094d0"
Sep 10 23:11:59.924387 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:11:59.924351    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-5094d0"
Sep 10 23:12:00.216096 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:00.216061    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7667-5094d0"]
Sep 10 23:12:00.217961 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:12:00.217931    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9643df9e_319d_4884_a500_075ca6f1b0e1.slice/crio-0509f0f9e51dfafb077831746ab6ad3292e18ed3db5721634a19a8dccc7f01bd WatchSource:0}: Error finding container 0509f0f9e51dfafb077831746ab6ad3292e18ed3db5721634a19a8dccc7f01bd: Status 404 returned error can't find the container with id 0509f0f9e51dfafb077831746ab6ad3292e18ed3db5721634a19a8dccc7f01bd
Sep 10 23:12:00.220297 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:00.220280    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:12:00.282528 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:00.282487    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:12:00.287895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:00.287868    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:12:00.470799 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:00.470712    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7667-5094d0" event={"ID":"9643df9e-319d-4884-a500-075ca6f1b0e1","Type":"ContainerStarted","Data":"0509f0f9e51dfafb077831746ab6ad3292e18ed3db5721634a19a8dccc7f01bd"}
Sep 10 23:12:00.471163 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:00.470987    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:12:00.471972 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:00.471953    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:12:03.703271 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.703230    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"]
Sep 10 23:12:03.708400 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.708376    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"
Sep 10 23:12:03.711246 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.711220    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-28dbae\""
Sep 10 23:12:03.711553 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.711533    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-28dbae-dockercfg-vbfkv\""
Sep 10 23:12:03.718751 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.718724    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"]
Sep 10 23:12:03.751221 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.751186    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e50f01d8-2de3-4691-acad-2bdfcd262a41-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt\" (UID: \"e50f01d8-2de3-4691-acad-2bdfcd262a41\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"
Sep 10 23:12:03.751378 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.751228    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7j8g\" (UniqueName: \"kubernetes.io/projected/e50f01d8-2de3-4691-acad-2bdfcd262a41-kube-api-access-v7j8g\") pod \"payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt\" (UID: \"e50f01d8-2de3-4691-acad-2bdfcd262a41\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"
Sep 10 23:12:03.773818 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.773780    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"]
Sep 10 23:12:03.777125 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.777109    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"
Sep 10 23:12:03.794041 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.794010    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"]
Sep 10 23:12:03.852164 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.852128    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79cnk\" (UniqueName: \"kubernetes.io/projected/40aa4734-f044-416c-bb45-226b0ebf6a54-kube-api-access-79cnk\") pod \"payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr\" (UID: \"40aa4734-f044-416c-bb45-226b0ebf6a54\") " pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"
Sep 10 23:12:03.852317 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.852187    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e50f01d8-2de3-4691-acad-2bdfcd262a41-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt\" (UID: \"e50f01d8-2de3-4691-acad-2bdfcd262a41\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"
Sep 10 23:12:03.852364 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.852317    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7j8g\" (UniqueName: \"kubernetes.io/projected/e50f01d8-2de3-4691-acad-2bdfcd262a41-kube-api-access-v7j8g\") pod \"payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt\" (UID: \"e50f01d8-2de3-4691-acad-2bdfcd262a41\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"
Sep 10 23:12:03.852401 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.852385    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40aa4734-f044-416c-bb45-226b0ebf6a54-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr\" (UID: \"40aa4734-f044-416c-bb45-226b0ebf6a54\") " pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"
Sep 10 23:12:03.852912 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.852896    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e50f01d8-2de3-4691-acad-2bdfcd262a41-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt\" (UID: \"e50f01d8-2de3-4691-acad-2bdfcd262a41\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"
Sep 10 23:12:03.861525 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.861503    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7j8g\" (UniqueName: \"kubernetes.io/projected/e50f01d8-2de3-4691-acad-2bdfcd262a41-kube-api-access-v7j8g\") pod \"payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt\" (UID: \"e50f01d8-2de3-4691-acad-2bdfcd262a41\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"
Sep 10 23:12:03.952906 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.952858    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40aa4734-f044-416c-bb45-226b0ebf6a54-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr\" (UID: \"40aa4734-f044-416c-bb45-226b0ebf6a54\") " pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"
Sep 10 23:12:03.953079 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.952951    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79cnk\" (UniqueName: \"kubernetes.io/projected/40aa4734-f044-416c-bb45-226b0ebf6a54-kube-api-access-79cnk\") pod \"payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr\" (UID: \"40aa4734-f044-416c-bb45-226b0ebf6a54\") " pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"
Sep 10 23:12:03.953585 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.953522    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40aa4734-f044-416c-bb45-226b0ebf6a54-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr\" (UID: \"40aa4734-f044-416c-bb45-226b0ebf6a54\") " pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"
Sep 10 23:12:03.963887 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:03.963863    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79cnk\" (UniqueName: \"kubernetes.io/projected/40aa4734-f044-416c-bb45-226b0ebf6a54-kube-api-access-79cnk\") pod \"payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr\" (UID: \"40aa4734-f044-416c-bb45-226b0ebf6a54\") " pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"
Sep 10 23:12:04.020183 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:04.020143    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"
Sep 10 23:12:04.090063 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:04.089884    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"
Sep 10 23:12:04.301657 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:04.301628    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"]
Sep 10 23:12:04.303152 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:12:04.303120    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode50f01d8_2de3_4691_acad_2bdfcd262a41.slice/crio-86d43824568dd76de11bd7faf6d264b348a935f02acd4d9b093fcba4fd2af95e WatchSource:0}: Error finding container 86d43824568dd76de11bd7faf6d264b348a935f02acd4d9b093fcba4fd2af95e: Status 404 returned error can't find the container with id 86d43824568dd76de11bd7faf6d264b348a935f02acd4d9b093fcba4fd2af95e
Sep 10 23:12:04.373721 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:04.373695    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"]
Sep 10 23:12:04.375429 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:12:04.375401    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40aa4734_f044_416c_bb45_226b0ebf6a54.slice/crio-f25457f0ac53d2af3e7c0fe06fbb08c81857f6bdb1a3f50d3467c3f61159a146 WatchSource:0}: Error finding container f25457f0ac53d2af3e7c0fe06fbb08c81857f6bdb1a3f50d3467c3f61159a146: Status 404 returned error can't find the container with id f25457f0ac53d2af3e7c0fe06fbb08c81857f6bdb1a3f50d3467c3f61159a146
Sep 10 23:12:04.501002 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:04.500963    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr" event={"ID":"40aa4734-f044-416c-bb45-226b0ebf6a54","Type":"ContainerStarted","Data":"4e4a8bb37558a7bf6153a4764a4abf3f67782ee9a1d1a2be57e112b978bad6a9"}
Sep 10 23:12:04.501191 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:04.501045    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"
Sep 10 23:12:04.501191 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:04.501074    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr" event={"ID":"40aa4734-f044-416c-bb45-226b0ebf6a54","Type":"ContainerStarted","Data":"f25457f0ac53d2af3e7c0fe06fbb08c81857f6bdb1a3f50d3467c3f61159a146"}
Sep 10 23:12:04.502985 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:04.502896    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt" event={"ID":"e50f01d8-2de3-4691-acad-2bdfcd262a41","Type":"ContainerStarted","Data":"9fe1720cbd5bd2dcf88468727bccfe194359db9ec7d560516166a034e444eef2"}
Sep 10 23:12:04.502985 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:04.502942    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt" event={"ID":"e50f01d8-2de3-4691-acad-2bdfcd262a41","Type":"ContainerStarted","Data":"86d43824568dd76de11bd7faf6d264b348a935f02acd4d9b093fcba4fd2af95e"}
Sep 10 23:12:04.502985 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:04.502971    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"
Sep 10 23:12:04.525231 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:04.525165    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr" podStartSLOduration=1.525143392 podStartE2EDuration="1.525143392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:12:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:12:04.522980565 +0000 UTC m=+836.701851519" watchObservedRunningTime="2026-09-10 23:12:04.525143392 +0000 UTC m=+836.704014359"
Sep 10 23:12:04.543219 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:04.543156    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt" podStartSLOduration=1.543135116 podStartE2EDuration="1.543135116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:12:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:12:04.542233932 +0000 UTC m=+836.721104922" watchObservedRunningTime="2026-09-10 23:12:04.543135116 +0000 UTC m=+836.722006080"
Sep 10 23:12:07.078253 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.078219    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"]
Sep 10 23:12:07.081811 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.081784    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.084745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.084723    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e7db0e72-openshift-default-dockercfg-8bw9f\""
Sep 10 23:12:07.096345 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.096318    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"]
Sep 10 23:12:07.183522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.183485    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-workload-socket\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.183700 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.183532    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-data\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.183700 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.183580    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istiod-ca-cert\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.183700 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.183661    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-token\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.183845 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.183736    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-workload-certs\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.183845 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.183827    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-credential-socket\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.183914 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.183898    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-podinfo\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.183989 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.183961    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-envoy\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.184031 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.184006    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t5qw\" (UniqueName: \"kubernetes.io/projected/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-kube-api-access-2t5qw\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.284881 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.284835    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-token\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.284881 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.284888    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-workload-certs\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.285145 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.284935    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-credential-socket\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.285145 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.284968    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-podinfo\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.285145 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.285000    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-envoy\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.285145 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.285018    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t5qw\" (UniqueName: \"kubernetes.io/projected/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-kube-api-access-2t5qw\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.285145 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.285062    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-workload-socket\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.285145 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.285077    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-data\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.285145 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.285094    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istiod-ca-cert\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.285492 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.285439    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-workload-certs\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.285602 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.285549    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-credential-socket\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.285602 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.285591    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-workload-socket\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.285762 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.285656    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-data\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.285937 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.285921    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istiod-ca-cert\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.287391 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.287366    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-envoy\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.287621 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.287603    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-podinfo\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.296802 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.296755    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t5qw\" (UniqueName: \"kubernetes.io/projected/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-kube-api-access-2t5qw\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.298720 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.298700    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-token\") pod \"e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") " pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.392150 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.392070    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:07.676751 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.676714    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"]
Sep 10 23:12:07.678811 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:12:07.678782    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc9f8529_6e00_4b81_ab9c_83ff27b8b04f.slice/crio-c6e3cef45d8075d7ace20180075e6aa09d787663122ff0419f7dced90214b53b WatchSource:0}: Error finding container c6e3cef45d8075d7ace20180075e6aa09d787663122ff0419f7dced90214b53b: Status 404 returned error can't find the container with id c6e3cef45d8075d7ace20180075e6aa09d787663122ff0419f7dced90214b53b
Sep 10 23:12:07.681115 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.681084    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:07.681199 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.681154    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:07.681199 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:07.681183    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:08.528088 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:08.528043    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7667-5094d0" event={"ID":"9643df9e-319d-4884-a500-075ca6f1b0e1","Type":"ContainerStarted","Data":"9162c656af09008734e49357ecbcbbf2f7526fe3aec63fbf9d9d91bed869cbd1"}
Sep 10 23:12:08.529768 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:08.529733    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" event={"ID":"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f","Type":"ContainerStarted","Data":"95d3a0ecca4c242bbc0a002a65a02badb26add96eb82c37b04ae789204525d63"}
Sep 10 23:12:08.529878 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:08.529788    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" event={"ID":"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f","Type":"ContainerStarted","Data":"c6e3cef45d8075d7ace20180075e6aa09d787663122ff0419f7dced90214b53b"}
Sep 10 23:12:08.556389 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:08.556340    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7667-5094d0" podStartSLOduration=2.270250409 podStartE2EDuration="9.556325502s" totalImagesPullingTime="7.286075093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:12:08.55366081 +0000 UTC m=+840.732531776" watchObservedRunningTime="2026-09-10 23:12:08.556325502 +0000 UTC m=+840.735196522"
Sep 10 23:12:08.577106 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:08.577055    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" podStartSLOduration=1.577040394 podStartE2EDuration="1.577040394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:12:08.57419701 +0000 UTC m=+840.753067997" watchObservedRunningTime="2026-09-10 23:12:08.577040394 +0000 UTC m=+840.755911357"
Sep 10 23:12:09.207575 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.207515    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7667-5094d0"]
Sep 10 23:12:09.210421 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.210387    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7667-5094d0"]
Sep 10 23:12:09.329655 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.329620    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7667-cee9f6"]
Sep 10 23:12:09.330015 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.330001    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9643df9e-319d-4884-a500-075ca6f1b0e1" containerName="test-curl-7667-5094d0"
Sep 10 23:12:09.330072 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.330019    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9643df9e-319d-4884-a500-075ca6f1b0e1" containerName="test-curl-7667-5094d0"
Sep 10 23:12:09.330107 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.330098    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9643df9e-319d-4884-a500-075ca6f1b0e1" containerName="test-curl-7667-5094d0"
Sep 10 23:12:09.333348 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.333332    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-cee9f6"
Sep 10 23:12:09.346054 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.346030    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7667-cee9f6"]
Sep 10 23:12:09.392806 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.392767    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:09.399629 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.399304    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:09.416058 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.416019    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkvcl\" (UniqueName: \"kubernetes.io/projected/62130ae1-ccbe-47b8-b828-799488a1239b-kube-api-access-vkvcl\") pod \"test-curl-7667-cee9f6\" (UID: \"62130ae1-ccbe-47b8-b828-799488a1239b\") " pod="opendatahub/test-curl-7667-cee9f6"
Sep 10 23:12:09.516932 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.516896    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkvcl\" (UniqueName: \"kubernetes.io/projected/62130ae1-ccbe-47b8-b828-799488a1239b-kube-api-access-vkvcl\") pod \"test-curl-7667-cee9f6\" (UID: \"62130ae1-ccbe-47b8-b828-799488a1239b\") " pod="opendatahub/test-curl-7667-cee9f6"
Sep 10 23:12:09.526943 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.526915    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkvcl\" (UniqueName: \"kubernetes.io/projected/62130ae1-ccbe-47b8-b828-799488a1239b-kube-api-access-vkvcl\") pod \"test-curl-7667-cee9f6\" (UID: \"62130ae1-ccbe-47b8-b828-799488a1239b\") " pod="opendatahub/test-curl-7667-cee9f6"
Sep 10 23:12:09.537175 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:12:09.537139    2585 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7667-5094d0" container="test-curl-7667-5094d0"
Sep 10 23:12:09.537687 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.537667    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:09.542504 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.542476    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:09.645831 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.645724    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-cee9f6"
Sep 10 23:12:09.987687 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:09.987660    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7667-cee9f6"]
Sep 10 23:12:09.989289 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:12:09.989267    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62130ae1_ccbe_47b8_b828_799488a1239b.slice/crio-aba400ce84477a8c635477e05d500340f9905176d5d56146addaab1b0d766620 WatchSource:0}: Error finding container aba400ce84477a8c635477e05d500340f9905176d5d56146addaab1b0d766620: Status 404 returned error can't find the container with id aba400ce84477a8c635477e05d500340f9905176d5d56146addaab1b0d766620
Sep 10 23:12:10.543524 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:10.543475    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7667-cee9f6" event={"ID":"62130ae1-ccbe-47b8-b828-799488a1239b","Type":"ContainerStarted","Data":"e284d320b41ba6b18db0955977a818e378a6ad64182e6c06a5c300f5e0618f84"}
Sep 10 23:12:10.543524 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:10.543520    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7667-5094d0" podUID="9643df9e-319d-4884-a500-075ca6f1b0e1" containerName="test-curl-7667-5094d0" containerID="cri-o://9162c656af09008734e49357ecbcbbf2f7526fe3aec63fbf9d9d91bed869cbd1" gracePeriod=2
Sep 10 23:12:10.544028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:10.543541    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7667-cee9f6" event={"ID":"62130ae1-ccbe-47b8-b828-799488a1239b","Type":"ContainerStarted","Data":"aba400ce84477a8c635477e05d500340f9905176d5d56146addaab1b0d766620"}
Sep 10 23:12:10.570819 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:10.570768    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7667-cee9f6" podStartSLOduration=1.570752291 podStartE2EDuration="1.570752291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:12:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:12:10.568910712 +0000 UTC m=+842.747781676" watchObservedRunningTime="2026-09-10 23:12:10.570752291 +0000 UTC m=+842.749623254"
Sep 10 23:12:11.236434 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:11.236399    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7667-cee9f6"]
Sep 10 23:12:11.241476 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:11.241444    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7667-cee9f6"]
Sep 10 23:12:11.549820 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:12:11.549793    2585 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7667-cee9f6" container="test-curl-7667-cee9f6"
Sep 10 23:12:11.993610 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:11.993500    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"]
Sep 10 23:12:11.993999 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:11.993983    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62130ae1-ccbe-47b8-b828-799488a1239b" containerName="test-curl-7667-cee9f6"
Sep 10 23:12:11.993999 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:11.994001    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="62130ae1-ccbe-47b8-b828-799488a1239b" containerName="test-curl-7667-cee9f6"
Sep 10 23:12:11.994102 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:11.994064    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="62130ae1-ccbe-47b8-b828-799488a1239b" containerName="test-curl-7667-cee9f6"
Sep 10 23:12:12.003032 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.003000    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"
Sep 10 23:12:12.008643 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.008612    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"]
Sep 10 23:12:12.009066 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.009037    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-e7db0e72\""
Sep 10 23:12:12.009320 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.009297    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-e7db0e72-dockercfg-v8nmv\""
Sep 10 23:12:12.065256 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.065210    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"]
Sep 10 23:12:12.068834 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.068810    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.071640 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.071602    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-3a438f-openshift-default-dockercfg-l6ccl\""
Sep 10 23:12:12.083676 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.083646    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"]
Sep 10 23:12:12.155406 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.155372    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-data\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.155586 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.155421    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e6deb9c-c762-405d-98c6-33d4328d37f3-plugins-config-volume\") pod \"payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7\" (UID: \"3e6deb9c-c762-405d-98c6-33d4328d37f3\") " pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"
Sep 10 23:12:12.155586 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.155443    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bvrw\" (UniqueName: \"kubernetes.io/projected/3e6deb9c-c762-405d-98c6-33d4328d37f3-kube-api-access-2bvrw\") pod \"payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7\" (UID: \"3e6deb9c-c762-405d-98c6-33d4328d37f3\") " pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"
Sep 10 23:12:12.155586 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.155518    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhs5r\" (UniqueName: \"kubernetes.io/projected/d47af31a-10c8-4c41-bc32-fb56e3447c25-kube-api-access-dhs5r\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.155832 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.155612    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-podinfo\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.155832 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.155635    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d47af31a-10c8-4c41-bc32-fb56e3447c25-istiod-ca-cert\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.155832 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.155655    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-workload-certs\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.155832 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.155672    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-envoy\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.155832 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.155764    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-credential-socket\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.155832 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.155822    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-token\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.156088 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.155880    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-workload-socket\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.257109 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257022    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-credential-socket\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.257109 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257066    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-token\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.257298 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257119    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-workload-socket\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.257298 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257139    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-data\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.257298 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257171    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e6deb9c-c762-405d-98c6-33d4328d37f3-plugins-config-volume\") pod \"payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7\" (UID: \"3e6deb9c-c762-405d-98c6-33d4328d37f3\") " pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"
Sep 10 23:12:12.257298 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257193    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bvrw\" (UniqueName: \"kubernetes.io/projected/3e6deb9c-c762-405d-98c6-33d4328d37f3-kube-api-access-2bvrw\") pod \"payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7\" (UID: \"3e6deb9c-c762-405d-98c6-33d4328d37f3\") " pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"
Sep 10 23:12:12.257298 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257230    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhs5r\" (UniqueName: \"kubernetes.io/projected/d47af31a-10c8-4c41-bc32-fb56e3447c25-kube-api-access-dhs5r\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.257298 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257279    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-podinfo\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.257478 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257307    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d47af31a-10c8-4c41-bc32-fb56e3447c25-istiod-ca-cert\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.257478 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257335    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-workload-certs\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.257478 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257360    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-envoy\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.257596 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257498    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-credential-socket\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.257596 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257584    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-data\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.257938 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.257912    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-workload-certs\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.258068 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.258049    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-workload-socket\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.258322 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.258154    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d47af31a-10c8-4c41-bc32-fb56e3447c25-istiod-ca-cert\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.258322 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.258101    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e6deb9c-c762-405d-98c6-33d4328d37f3-plugins-config-volume\") pod \"payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7\" (UID: \"3e6deb9c-c762-405d-98c6-33d4328d37f3\") " pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"
Sep 10 23:12:12.260441 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.260419    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-envoy\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.260551 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.260533    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-podinfo\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.271163 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.271140    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-token\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.271410 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.271387    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bvrw\" (UniqueName: \"kubernetes.io/projected/3e6deb9c-c762-405d-98c6-33d4328d37f3-kube-api-access-2bvrw\") pod \"payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7\" (UID: \"3e6deb9c-c762-405d-98c6-33d4328d37f3\") " pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"
Sep 10 23:12:12.271622 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.271604    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhs5r\" (UniqueName: \"kubernetes.io/projected/d47af31a-10c8-4c41-bc32-fb56e3447c25-kube-api-access-dhs5r\") pod \"e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") " pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.323027 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.322991    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"
Sep 10 23:12:12.381911 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.381885    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:12.555510 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.555476    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7667-cee9f6" podUID="62130ae1-ccbe-47b8-b828-799488a1239b" containerName="test-curl-7667-cee9f6" containerID="cri-o://e284d320b41ba6b18db0955977a818e378a6ad64182e6c06a5c300f5e0618f84" gracePeriod=2
Sep 10 23:12:12.627596 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.620523    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"]
Sep 10 23:12:12.631861 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:12:12.631788    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e6deb9c_c762_405d_98c6_33d4328d37f3.slice/crio-7df658597e7db5d3363f38ed060bdb5898e961b526842a5c3fe9d6a5e39942dd WatchSource:0}: Error finding container 7df658597e7db5d3363f38ed060bdb5898e961b526842a5c3fe9d6a5e39942dd: Status 404 returned error can't find the container with id 7df658597e7db5d3363f38ed060bdb5898e961b526842a5c3fe9d6a5e39942dd
Sep 10 23:12:12.695117 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:12:12.695078    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd47af31a_10c8_4c41_bc32_fb56e3447c25.slice/crio-667c12c80d0b79830f9e18c8d7c72faad6d2f79174465b0730252c81bd2f5510 WatchSource:0}: Error finding container 667c12c80d0b79830f9e18c8d7c72faad6d2f79174465b0730252c81bd2f5510: Status 404 returned error can't find the container with id 667c12c80d0b79830f9e18c8d7c72faad6d2f79174465b0730252c81bd2f5510
Sep 10 23:12:12.695234 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.695179    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"]
Sep 10 23:12:12.707728 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.702724    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:12.707728 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.702808    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:12.707728 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.702854    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:12.778944 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.778920    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-5094d0"
Sep 10 23:12:12.863832 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.863737    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hhfr\" (UniqueName: \"kubernetes.io/projected/9643df9e-319d-4884-a500-075ca6f1b0e1-kube-api-access-2hhfr\") pod \"9643df9e-319d-4884-a500-075ca6f1b0e1\" (UID: \"9643df9e-319d-4884-a500-075ca6f1b0e1\") "
Sep 10 23:12:12.865904 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.865877    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9643df9e-319d-4884-a500-075ca6f1b0e1-kube-api-access-2hhfr" (OuterVolumeSpecName: "kube-api-access-2hhfr") pod "9643df9e-319d-4884-a500-075ca6f1b0e1" (UID: "9643df9e-319d-4884-a500-075ca6f1b0e1"). InnerVolumeSpecName "kube-api-access-2hhfr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:12:12.965507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:12.965468    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hhfr\" (UniqueName: \"kubernetes.io/projected/9643df9e-319d-4884-a500-075ca6f1b0e1-kube-api-access-2hhfr\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:12:13.563478 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:13.563443    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" event={"ID":"d47af31a-10c8-4c41-bc32-fb56e3447c25","Type":"ContainerStarted","Data":"02efee2b5aba997ae259d95b666d4591d20c886be553f2934db6dee02667f76a"}
Sep 10 23:12:13.564072 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:13.563508    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" event={"ID":"d47af31a-10c8-4c41-bc32-fb56e3447c25","Type":"ContainerStarted","Data":"667c12c80d0b79830f9e18c8d7c72faad6d2f79174465b0730252c81bd2f5510"}
Sep 10 23:12:13.564945 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:13.564917    2585 generic.go:356] "Generic (PLEG): container finished" podID="9643df9e-319d-4884-a500-075ca6f1b0e1" containerID="9162c656af09008734e49357ecbcbbf2f7526fe3aec63fbf9d9d91bed869cbd1" exitCode=137
Sep 10 23:12:13.565050 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:13.564975    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-5094d0"
Sep 10 23:12:13.565050 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:13.565031    2585 scope.go:117] "RemoveContainer" containerID="9162c656af09008734e49357ecbcbbf2f7526fe3aec63fbf9d9d91bed869cbd1"
Sep 10 23:12:13.567425 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:13.567325    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7" event={"ID":"3e6deb9c-c762-405d-98c6-33d4328d37f3","Type":"ContainerStarted","Data":"b229efc0805350fab8f85024cce31abb7f9ebbf7877ae5ec0f0e50aa299265df"}
Sep 10 23:12:13.567425 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:13.567388    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7" event={"ID":"3e6deb9c-c762-405d-98c6-33d4328d37f3","Type":"ContainerStarted","Data":"7df658597e7db5d3363f38ed060bdb5898e961b526842a5c3fe9d6a5e39942dd"}
Sep 10 23:12:13.567639 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:13.567488    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"
Sep 10 23:12:13.574664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:13.574645    2585 scope.go:117] "RemoveContainer" containerID="9162c656af09008734e49357ecbcbbf2f7526fe3aec63fbf9d9d91bed869cbd1"
Sep 10 23:12:13.574921 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:12:13.574901    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9162c656af09008734e49357ecbcbbf2f7526fe3aec63fbf9d9d91bed869cbd1\": container with ID starting with 9162c656af09008734e49357ecbcbbf2f7526fe3aec63fbf9d9d91bed869cbd1 not found: ID does not exist" containerID="9162c656af09008734e49357ecbcbbf2f7526fe3aec63fbf9d9d91bed869cbd1"
Sep 10 23:12:13.574979 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:13.574930    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9162c656af09008734e49357ecbcbbf2f7526fe3aec63fbf9d9d91bed869cbd1"} err="failed to get container status \"9162c656af09008734e49357ecbcbbf2f7526fe3aec63fbf9d9d91bed869cbd1\": rpc error: code = NotFound desc = could not find container \"9162c656af09008734e49357ecbcbbf2f7526fe3aec63fbf9d9d91bed869cbd1\": container with ID starting with 9162c656af09008734e49357ecbcbbf2f7526fe3aec63fbf9d9d91bed869cbd1 not found: ID does not exist"
Sep 10 23:12:13.588471 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:13.588418    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" podStartSLOduration=1.588400446 podStartE2EDuration="1.588400446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:12:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:12:13.586013106 +0000 UTC m=+845.764884094" watchObservedRunningTime="2026-09-10 23:12:13.588400446 +0000 UTC m=+845.767271411"
Sep 10 23:12:13.589772 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:12:13.589749    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7667-5094d0\" is forbidden: User \"system:node:ip-10-0-138-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-139.ec2.internal' and this object" podUID="9643df9e-319d-4884-a500-075ca6f1b0e1" pod="opendatahub/test-curl-7667-5094d0"
Sep 10 23:12:13.610808 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:13.610516    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7" podStartSLOduration=2.610494251 podStartE2EDuration="2.610494251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:12:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:12:13.608248789 +0000 UTC m=+845.787119743" watchObservedRunningTime="2026-09-10 23:12:13.610494251 +0000 UTC m=+845.789365218"
Sep 10 23:12:14.341966 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:14.341931    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9643df9e-319d-4884-a500-075ca6f1b0e1" path="/var/lib/kubelet/pods/9643df9e-319d-4884-a500-075ca6f1b0e1/volumes"
Sep 10 23:12:14.382459 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:14.382421    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:14.387809 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:14.387784    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:14.574901 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:14.574872    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:14.575661 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:14.575641    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:14.787427 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:14.787401    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-cee9f6"
Sep 10 23:12:14.886591 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:14.886480    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkvcl\" (UniqueName: \"kubernetes.io/projected/62130ae1-ccbe-47b8-b828-799488a1239b-kube-api-access-vkvcl\") pod \"62130ae1-ccbe-47b8-b828-799488a1239b\" (UID: \"62130ae1-ccbe-47b8-b828-799488a1239b\") "
Sep 10 23:12:14.888592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:14.888546    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62130ae1-ccbe-47b8-b828-799488a1239b-kube-api-access-vkvcl" (OuterVolumeSpecName: "kube-api-access-vkvcl") pod "62130ae1-ccbe-47b8-b828-799488a1239b" (UID: "62130ae1-ccbe-47b8-b828-799488a1239b"). InnerVolumeSpecName "kube-api-access-vkvcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:12:14.988046 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:14.988011    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkvcl\" (UniqueName: \"kubernetes.io/projected/62130ae1-ccbe-47b8-b828-799488a1239b-kube-api-access-vkvcl\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:12:15.511720 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:15.511686    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"
Sep 10 23:12:15.511881 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:15.511764    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"
Sep 10 23:12:15.584716 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:15.584681    2585 generic.go:356] "Generic (PLEG): container finished" podID="62130ae1-ccbe-47b8-b828-799488a1239b" containerID="e284d320b41ba6b18db0955977a818e378a6ad64182e6c06a5c300f5e0618f84" exitCode=137
Sep 10 23:12:15.585268 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:15.584732    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7667-cee9f6"
Sep 10 23:12:15.585548 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:15.585525    2585 scope.go:117] "RemoveContainer" containerID="e284d320b41ba6b18db0955977a818e378a6ad64182e6c06a5c300f5e0618f84"
Sep 10 23:12:15.600362 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:15.600199    2585 scope.go:117] "RemoveContainer" containerID="e284d320b41ba6b18db0955977a818e378a6ad64182e6c06a5c300f5e0618f84"
Sep 10 23:12:15.601028 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:12:15.600908    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e284d320b41ba6b18db0955977a818e378a6ad64182e6c06a5c300f5e0618f84\": container with ID starting with e284d320b41ba6b18db0955977a818e378a6ad64182e6c06a5c300f5e0618f84 not found: ID does not exist" containerID="e284d320b41ba6b18db0955977a818e378a6ad64182e6c06a5c300f5e0618f84"
Sep 10 23:12:15.601028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:15.600949    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e284d320b41ba6b18db0955977a818e378a6ad64182e6c06a5c300f5e0618f84"} err="failed to get container status \"e284d320b41ba6b18db0955977a818e378a6ad64182e6c06a5c300f5e0618f84\": rpc error: code = NotFound desc = could not find container \"e284d320b41ba6b18db0955977a818e378a6ad64182e6c06a5c300f5e0618f84\": container with ID starting with e284d320b41ba6b18db0955977a818e378a6ad64182e6c06a5c300f5e0618f84 not found: ID does not exist"
Sep 10 23:12:15.601524 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:12:15.601497    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7667-cee9f6\" is forbidden: User \"system:node:ip-10-0-138-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-139.ec2.internal' and this object" podUID="62130ae1-ccbe-47b8-b828-799488a1239b" pod="opendatahub/test-curl-7667-cee9f6"
Sep 10 23:12:16.342800 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:16.342762    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62130ae1-ccbe-47b8-b828-799488a1239b" path="/var/lib/kubelet/pods/62130ae1-ccbe-47b8-b828-799488a1239b/volumes"
Sep 10 23:12:16.512795 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:16.512750    2585 patch_prober.go:28] interesting pod/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 23:12:16.513013 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:16.512817    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" podUID="09798020-4363-4103-9577-fca7a6aba795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:12:17.705784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:17.705743    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"]
Sep 10 23:12:17.710458 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:17.710433    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"
Sep 10 23:12:17.713916 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:17.713897    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-3a438f\""
Sep 10 23:12:17.714044 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:17.713898    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-3a438f-dockercfg-d4tpk\""
Sep 10 23:12:17.723349 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:17.723324    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"]
Sep 10 23:12:17.816257 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:17.816215    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81423e3d-7662-402d-85de-d2b757202c30-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx\" (UID: \"81423e3d-7662-402d-85de-d2b757202c30\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"
Sep 10 23:12:17.816468 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:17.816273    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69q47\" (UniqueName: \"kubernetes.io/projected/81423e3d-7662-402d-85de-d2b757202c30-kube-api-access-69q47\") pod \"payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx\" (UID: \"81423e3d-7662-402d-85de-d2b757202c30\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"
Sep 10 23:12:17.917358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:17.917303    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81423e3d-7662-402d-85de-d2b757202c30-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx\" (UID: \"81423e3d-7662-402d-85de-d2b757202c30\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"
Sep 10 23:12:17.917358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:17.917358    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69q47\" (UniqueName: \"kubernetes.io/projected/81423e3d-7662-402d-85de-d2b757202c30-kube-api-access-69q47\") pod \"payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx\" (UID: \"81423e3d-7662-402d-85de-d2b757202c30\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"
Sep 10 23:12:17.918051 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:17.918024    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81423e3d-7662-402d-85de-d2b757202c30-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx\" (UID: \"81423e3d-7662-402d-85de-d2b757202c30\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"
Sep 10 23:12:17.934595 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:17.934537    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69q47\" (UniqueName: \"kubernetes.io/projected/81423e3d-7662-402d-85de-d2b757202c30-kube-api-access-69q47\") pod \"payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx\" (UID: \"81423e3d-7662-402d-85de-d2b757202c30\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"
Sep 10 23:12:18.022786 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:18.022701    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"
Sep 10 23:12:18.338614 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:18.334605    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"]
Sep 10 23:12:18.383757 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:12:18.383729    2585 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/system.slice/system-systemd\\\\x2dcoredump.slice/systemd-coredump@1-14466-0.service\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09798020_4363_4103_9577_fca7a6aba795.slice/crio-conmon-6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6.scope\": RecentStats: unable to find data in memory cache]"
Sep 10 23:12:18.611881 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:18.611783    2585 generic.go:356] "Generic (PLEG): container finished" podID="09798020-4363-4103-9577-fca7a6aba795" containerID="6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6" exitCode=0
Sep 10 23:12:18.612061 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:18.611939    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" event={"ID":"09798020-4363-4103-9577-fca7a6aba795","Type":"ContainerDied","Data":"6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6"}
Sep 10 23:12:18.612452 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:18.612427    2585 scope.go:117] "RemoveContainer" containerID="6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6"
Sep 10 23:12:18.619184 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:18.619147    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx" event={"ID":"81423e3d-7662-402d-85de-d2b757202c30","Type":"ContainerStarted","Data":"071d5c349f129487e77b9ab9e3b929d9c93658451a9ddb38ebbfb0dc6f9d83cb"}
Sep 10 23:12:18.619317 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:18.619227    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx" event={"ID":"81423e3d-7662-402d-85de-d2b757202c30","Type":"ContainerStarted","Data":"bd38ad73cd238259968533b453c6dc2cae10ec44f7d37dcfe33b6be1b9079474"}
Sep 10 23:12:18.619994 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:18.619971    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"
Sep 10 23:12:18.621002 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:18.620965    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:18.621091 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:18.621053    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:18.621148 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:18.621099    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:18.669399 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:18.669339    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx" podStartSLOduration=1.669304082 podStartE2EDuration="1.669304082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:12:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:12:18.668861535 +0000 UTC m=+850.847732498" watchObservedRunningTime="2026-09-10 23:12:18.669304082 +0000 UTC m=+850.848175046"
Sep 10 23:12:19.632206 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:19.632164    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" event={"ID":"09798020-4363-4103-9577-fca7a6aba795","Type":"ContainerStarted","Data":"8c8dc8d7e427e17306436cee718eae23aa668fe296145ed762ce32f5f44a77cb"}
Sep 10 23:12:20.282363 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:20.282324    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:12:20.282363 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:20.282364    2585 patch_prober.go:28] interesting pod/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 23:12:20.282621 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:20.282408    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" podUID="09798020-4363-4103-9577-fca7a6aba795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 23:12:21.282789 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:21.282751    2585 patch_prober.go:28] interesting pod/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 23:12:21.283249 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:21.283163    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" podUID="09798020-4363-4103-9577-fca7a6aba795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 23:12:22.282429 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:22.282399    2585 patch_prober.go:28] interesting pod/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 23:12:22.282723 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:22.282697    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" podUID="09798020-4363-4103-9577-fca7a6aba795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 23:12:23.282800 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:23.282758    2585 patch_prober.go:28] interesting pod/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 23:12:23.283210 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:23.282818    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" podUID="09798020-4363-4103-9577-fca7a6aba795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 23:12:24.282868 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:24.282818    2585 patch_prober.go:28] interesting pod/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 23:12:24.283360 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:24.282889    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" podUID="09798020-4363-4103-9577-fca7a6aba795" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 23:12:24.577390 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:24.577353    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"
Sep 10 23:12:25.517514 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:25.517478    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:12:25.518155 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:25.518134    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:12:25.519100 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:25.519075    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:12:25.580005 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:25.579967    2585 patch_prober.go:28] interesting pod/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 23:12:25.580241 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:25.580033    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:12:27.044283 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.044248    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"]
Sep 10 23:12:27.049231 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.049208    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.052835 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.052802    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-1f1f85-openshift-default-dockercfg-v4tkr\""
Sep 10 23:12:27.062042 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.062015    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"]
Sep 10 23:12:27.128903 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.128875    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-workload-certs\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.138652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.128915    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qkkl\" (UniqueName: \"kubernetes.io/projected/a6477081-85d0-4953-bdc7-e00a79e1e8f3-kube-api-access-4qkkl\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.138652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.128982    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-envoy\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.138652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.129047    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-credential-socket\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.138652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.129142    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-data\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.138652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.129194    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-token\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.138652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.129238    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istiod-ca-cert\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.138652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.129271    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-podinfo\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.138652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.129324    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-workload-socket\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.230218 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.230185    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-token\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.230406 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.230242    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istiod-ca-cert\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.230406 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.230270    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-podinfo\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.230406 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.230318    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-workload-socket\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.230406 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.230364    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-workload-certs\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.230406 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.230396    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qkkl\" (UniqueName: \"kubernetes.io/projected/a6477081-85d0-4953-bdc7-e00a79e1e8f3-kube-api-access-4qkkl\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.230776 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.230477    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-envoy\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.230776 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.230508    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-credential-socket\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.230776 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.230545    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-data\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.230938 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.230916    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-workload-certs\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.230997 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.230939    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-data\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.231147 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.231122    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istiod-ca-cert\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.231212 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.231183    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-workload-socket\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.231992 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.231965    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-credential-socket\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.233899 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.233858    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-envoy\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.236717 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.236668    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-podinfo\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.245520 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.242651    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qkkl\" (UniqueName: \"kubernetes.io/projected/a6477081-85d0-4953-bdc7-e00a79e1e8f3-kube-api-access-4qkkl\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.245520 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.243147    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-token\") pod \"e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") " pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.363544 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.363471    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:27.652936 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.652836    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"]
Sep 10 23:12:27.660470 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:12:27.660442    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6477081_85d0_4953_bdc7_e00a79e1e8f3.slice/crio-c9ecae8a9060c5e39412061b646f6797b4b929934e76afc2cd1e57f5a0f31f2d WatchSource:0}: Error finding container c9ecae8a9060c5e39412061b646f6797b4b929934e76afc2cd1e57f5a0f31f2d: Status 404 returned error can't find the container with id c9ecae8a9060c5e39412061b646f6797b4b929934e76afc2cd1e57f5a0f31f2d
Sep 10 23:12:27.662587 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.662538    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:27.662683 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.662633    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:27.662683 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.662676    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:27.692633 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.692603    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" event={"ID":"a6477081-85d0-4953-bdc7-e00a79e1e8f3","Type":"ContainerStarted","Data":"c9ecae8a9060c5e39412061b646f6797b4b929934e76afc2cd1e57f5a0f31f2d"}
Sep 10 23:12:27.694183 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.694158    2585 generic.go:356] "Generic (PLEG): container finished" podID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerID="95d3a0ecca4c242bbc0a002a65a02badb26add96eb82c37b04ae789204525d63" exitCode=0
Sep 10 23:12:27.694303 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.694225    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" event={"ID":"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f","Type":"ContainerDied","Data":"95d3a0ecca4c242bbc0a002a65a02badb26add96eb82c37b04ae789204525d63"}
Sep 10 23:12:27.694631 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.694618    2585 scope.go:117] "RemoveContainer" containerID="95d3a0ecca4c242bbc0a002a65a02badb26add96eb82c37b04ae789204525d63"
Sep 10 23:12:27.695626 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.695596    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:27.695697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.695679    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:27.695746 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:27.695731    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:28.705922 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:28.705862    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" event={"ID":"a6477081-85d0-4953-bdc7-e00a79e1e8f3","Type":"ContainerStarted","Data":"c64767f63447555d7c60fbb6d4e95d62a5bdf8fd8272bbb40f2e5f23142c708a"}
Sep 10 23:12:28.711978 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:28.711941    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" event={"ID":"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f","Type":"ContainerStarted","Data":"329150bc6f19aad16ed2435da7fa0b827991e9e6eef517bd98f8cb10a81d3c39"}
Sep 10 23:12:28.752005 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:28.751822    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" podStartSLOduration=1.751806084 podStartE2EDuration="1.751806084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:12:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:12:28.74707866 +0000 UTC m=+860.925949623" watchObservedRunningTime="2026-09-10 23:12:28.751806084 +0000 UTC m=+860.930677046"
Sep 10 23:12:29.363969 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:29.363926    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:29.369179 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:29.369151    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:29.393052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:29.393019    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:29.393202 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:29.393180    2585 patch_prober.go:28] interesting pod/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 23:12:29.393258 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:29.393239    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 23:12:29.726671 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:29.726575    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:29.732336 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:29.732300    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:30.392683 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:30.392646    2585 patch_prober.go:28] interesting pod/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 23:12:30.392837 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:30.392698    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 23:12:30.645813 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:30.645716    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"
Sep 10 23:12:31.392699 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:31.392657    2585 patch_prober.go:28] interesting pod/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 23:12:31.393180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:31.392722    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 23:12:32.392980 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:32.392936    2585 patch_prober.go:28] interesting pod/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 23:12:32.393446 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:32.393010    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 23:12:33.057851 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.057814    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"]
Sep 10 23:12:33.062631 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.062612    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"
Sep 10 23:12:33.066528 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.066507    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-1f1f85-dockercfg-jwjbx\""
Sep 10 23:12:33.066701 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.066682    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-1f1f85\""
Sep 10 23:12:33.075255 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.075231    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"]
Sep 10 23:12:33.091466 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.091421    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgggn\" (UniqueName: \"kubernetes.io/projected/d8821535-249c-4e9b-91c8-572e0ac232eb-kube-api-access-hgggn\") pod \"payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw\" (UID: \"d8821535-249c-4e9b-91c8-572e0ac232eb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"
Sep 10 23:12:33.091678 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.091511    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8821535-249c-4e9b-91c8-572e0ac232eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw\" (UID: \"d8821535-249c-4e9b-91c8-572e0ac232eb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"
Sep 10 23:12:33.192514 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.192476    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgggn\" (UniqueName: \"kubernetes.io/projected/d8821535-249c-4e9b-91c8-572e0ac232eb-kube-api-access-hgggn\") pod \"payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw\" (UID: \"d8821535-249c-4e9b-91c8-572e0ac232eb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"
Sep 10 23:12:33.192701 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.192534    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8821535-249c-4e9b-91c8-572e0ac232eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw\" (UID: \"d8821535-249c-4e9b-91c8-572e0ac232eb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"
Sep 10 23:12:33.193306 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.193285    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8821535-249c-4e9b-91c8-572e0ac232eb-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw\" (UID: \"d8821535-249c-4e9b-91c8-572e0ac232eb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"
Sep 10 23:12:33.244594 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.244329    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgggn\" (UniqueName: \"kubernetes.io/projected/d8821535-249c-4e9b-91c8-572e0ac232eb-kube-api-access-hgggn\") pod \"payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw\" (UID: \"d8821535-249c-4e9b-91c8-572e0ac232eb\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"
Sep 10 23:12:33.375542 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.375441    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"
Sep 10 23:12:33.392835 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.392805    2585 patch_prober.go:28] interesting pod/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 23:12:33.392960 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.392864    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 23:12:33.735589 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.732099    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"]
Sep 10 23:12:33.756733 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:12:33.755720    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8821535_249c_4e9b_91c8_572e0ac232eb.slice/crio-21ebc8dc24bd64d83d7a1e6c05698ff7529b9d95c29ba609fc15d0026d6ff383 WatchSource:0}: Error finding container 21ebc8dc24bd64d83d7a1e6c05698ff7529b9d95c29ba609fc15d0026d6ff383: Status 404 returned error can't find the container with id 21ebc8dc24bd64d83d7a1e6c05698ff7529b9d95c29ba609fc15d0026d6ff383
Sep 10 23:12:33.765448 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:33.765422    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw" event={"ID":"d8821535-249c-4e9b-91c8-572e0ac232eb","Type":"ContainerStarted","Data":"21ebc8dc24bd64d83d7a1e6c05698ff7529b9d95c29ba609fc15d0026d6ff383"}
Sep 10 23:12:34.556763 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:34.556729    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:34.557165 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:34.557148    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:34.557960 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:34.557940    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:34.773370 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:34.773280    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw" event={"ID":"d8821535-249c-4e9b-91c8-572e0ac232eb","Type":"ContainerStarted","Data":"b7e1dd1363fc67923785d46b4cf74fc23ed2ad8f01f73533b8005cefa154ede7"}
Sep 10 23:12:34.773763 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:34.773595    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"
Sep 10 23:12:34.800663 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:34.800611    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw" podStartSLOduration=1.800591613 podStartE2EDuration="1.800591613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:12:34.798753996 +0000 UTC m=+866.977624964" watchObservedRunningTime="2026-09-10 23:12:34.800591613 +0000 UTC m=+866.979462578"
Sep 10 23:12:37.793709 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:37.793676    2585 generic.go:356] "Generic (PLEG): container finished" podID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerID="02efee2b5aba997ae259d95b666d4591d20c886be553f2934db6dee02667f76a" exitCode=0
Sep 10 23:12:37.794458 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:37.793755    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" event={"ID":"d47af31a-10c8-4c41-bc32-fb56e3447c25","Type":"ContainerDied","Data":"02efee2b5aba997ae259d95b666d4591d20c886be553f2934db6dee02667f76a"}
Sep 10 23:12:37.794458 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:37.794351    2585 scope.go:117] "RemoveContainer" containerID="02efee2b5aba997ae259d95b666d4591d20c886be553f2934db6dee02667f76a"
Sep 10 23:12:37.795450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:37.795424    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:37.795513 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:37.795489    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:37.795552 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:37.795521    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:38.804605 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:38.804546    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" event={"ID":"d47af31a-10c8-4c41-bc32-fb56e3447c25","Type":"ContainerStarted","Data":"9db8751ceda4d8d226659a3e2248857bea5a4d1a7dc15bd823ee2e493bf69f93"}
Sep 10 23:12:39.382774 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:39.382747    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:39.383061 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:39.383019    2585 patch_prober.go:28] interesting pod/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 23:12:39.383127 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:39.383093    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 23:12:40.382848 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:40.382810    2585 patch_prober.go:28] interesting pod/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 23:12:40.383258 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:40.382868    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 23:12:41.382982 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:41.382930    2585 patch_prober.go:28] interesting pod/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 23:12:41.383498 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:41.383016    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 23:12:42.382955 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:42.382914    2585 patch_prober.go:28] interesting pod/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 23:12:42.383163 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:42.382975    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 23:12:43.383139 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:43.383064    2585 patch_prober.go:28] interesting pod/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 23:12:43.383139 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:43.383119    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 23:12:44.383233 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:44.383191    2585 patch_prober.go:28] interesting pod/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 23:12:44.383414 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:44.383268    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 23:12:44.575408 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:44.575371    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:45.387432 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:45.387402    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:45.388500 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:45.388477    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:12:45.768803 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:45.768715    2585 patch_prober.go:28] interesting pod/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 23:12:45.768803 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:45.768787    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:12:45.783110 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:45.783080    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"
Sep 10 23:12:46.889089 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:46.889056    2585 generic.go:356] "Generic (PLEG): container finished" podID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerID="c64767f63447555d7c60fbb6d4e95d62a5bdf8fd8272bbb40f2e5f23142c708a" exitCode=0
Sep 10 23:12:46.889582 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:46.889142    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" event={"ID":"a6477081-85d0-4953-bdc7-e00a79e1e8f3","Type":"ContainerDied","Data":"c64767f63447555d7c60fbb6d4e95d62a5bdf8fd8272bbb40f2e5f23142c708a"}
Sep 10 23:12:46.889639 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:46.889605    2585 scope.go:117] "RemoveContainer" containerID="c64767f63447555d7c60fbb6d4e95d62a5bdf8fd8272bbb40f2e5f23142c708a"
Sep 10 23:12:46.890819 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:46.890792    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:46.890887 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:46.890860    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:46.890926 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:46.890907    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:47.897737 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:47.897697    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" event={"ID":"a6477081-85d0-4953-bdc7-e00a79e1e8f3","Type":"ContainerStarted","Data":"0d408c036546d4cf40289398b09e293f1918dc7d097271de2fc46a90d54a34dc"}
Sep 10 23:12:48.363888 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:48.363851    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:48.364109 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:48.364082    2585 patch_prober.go:28] interesting pod/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 10 23:12:48.364169 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:48.364144    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 10 23:12:49.364819 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:49.364783    2585 patch_prober.go:28] interesting pod/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 10 23:12:49.365292 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:49.364841    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 10 23:12:50.364357 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:50.364323    2585 patch_prober.go:28] interesting pod/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 10 23:12:50.364533 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:50.364375    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 10 23:12:51.364617 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:51.364581    2585 patch_prober.go:28] interesting pod/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 10 23:12:51.365014 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:51.364640    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 10 23:12:52.287137 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.287102    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"]
Sep 10 23:12:52.287627 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.287592    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7" podUID="3e6deb9c-c762-405d-98c6-33d4328d37f3" containerName="payload-processing" containerID="cri-o://b229efc0805350fab8f85024cce31abb7f9ebbf7877ae5ec0f0e50aa299265df" gracePeriod=30
Sep 10 23:12:52.364552 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.364514    2585 patch_prober.go:28] interesting pod/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 10 23:12:52.364761 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.364617    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 10 23:12:52.654592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.654449    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"]
Sep 10 23:12:52.654811 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.654696    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerName="istio-proxy" containerID="cri-o://329150bc6f19aad16ed2435da7fa0b827991e9e6eef517bd98f8cb10a81d3c39" gracePeriod=30
Sep 10 23:12:52.688436 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.688411    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"
Sep 10 23:12:52.831468 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.831424    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bvrw\" (UniqueName: \"kubernetes.io/projected/3e6deb9c-c762-405d-98c6-33d4328d37f3-kube-api-access-2bvrw\") pod \"3e6deb9c-c762-405d-98c6-33d4328d37f3\" (UID: \"3e6deb9c-c762-405d-98c6-33d4328d37f3\") "
Sep 10 23:12:52.831468 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.831472    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e6deb9c-c762-405d-98c6-33d4328d37f3-plugins-config-volume\") pod \"3e6deb9c-c762-405d-98c6-33d4328d37f3\" (UID: \"3e6deb9c-c762-405d-98c6-33d4328d37f3\") "
Sep 10 23:12:52.831867 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.831841    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e6deb9c-c762-405d-98c6-33d4328d37f3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3e6deb9c-c762-405d-98c6-33d4328d37f3" (UID: "3e6deb9c-c762-405d-98c6-33d4328d37f3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:12:52.833733 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.833700    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e6deb9c-c762-405d-98c6-33d4328d37f3-kube-api-access-2bvrw" (OuterVolumeSpecName: "kube-api-access-2bvrw") pod "3e6deb9c-c762-405d-98c6-33d4328d37f3" (UID: "3e6deb9c-c762-405d-98c6-33d4328d37f3"). InnerVolumeSpecName "kube-api-access-2bvrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:12:52.932864 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.932771    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bvrw\" (UniqueName: \"kubernetes.io/projected/3e6deb9c-c762-405d-98c6-33d4328d37f3-kube-api-access-2bvrw\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:12:52.932864 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.932803    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3e6deb9c-c762-405d-98c6-33d4328d37f3-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:12:52.939022 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.938990    2585 generic.go:356] "Generic (PLEG): container finished" podID="3e6deb9c-c762-405d-98c6-33d4328d37f3" containerID="b229efc0805350fab8f85024cce31abb7f9ebbf7877ae5ec0f0e50aa299265df" exitCode=0
Sep 10 23:12:52.939167 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.939065    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"
Sep 10 23:12:52.939167 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.939074    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7" event={"ID":"3e6deb9c-c762-405d-98c6-33d4328d37f3","Type":"ContainerDied","Data":"b229efc0805350fab8f85024cce31abb7f9ebbf7877ae5ec0f0e50aa299265df"}
Sep 10 23:12:52.939167 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.939152    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7" event={"ID":"3e6deb9c-c762-405d-98c6-33d4328d37f3","Type":"ContainerDied","Data":"7df658597e7db5d3363f38ed060bdb5898e961b526842a5c3fe9d6a5e39942dd"}
Sep 10 23:12:52.939302 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.939174    2585 scope.go:117] "RemoveContainer" containerID="b229efc0805350fab8f85024cce31abb7f9ebbf7877ae5ec0f0e50aa299265df"
Sep 10 23:12:52.948227 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.948209    2585 scope.go:117] "RemoveContainer" containerID="b229efc0805350fab8f85024cce31abb7f9ebbf7877ae5ec0f0e50aa299265df"
Sep 10 23:12:52.948502 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:12:52.948482    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b229efc0805350fab8f85024cce31abb7f9ebbf7877ae5ec0f0e50aa299265df\": container with ID starting with b229efc0805350fab8f85024cce31abb7f9ebbf7877ae5ec0f0e50aa299265df not found: ID does not exist" containerID="b229efc0805350fab8f85024cce31abb7f9ebbf7877ae5ec0f0e50aa299265df"
Sep 10 23:12:52.948591 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.948510    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b229efc0805350fab8f85024cce31abb7f9ebbf7877ae5ec0f0e50aa299265df"} err="failed to get container status \"b229efc0805350fab8f85024cce31abb7f9ebbf7877ae5ec0f0e50aa299265df\": rpc error: code = NotFound desc = could not find container \"b229efc0805350fab8f85024cce31abb7f9ebbf7877ae5ec0f0e50aa299265df\": container with ID starting with b229efc0805350fab8f85024cce31abb7f9ebbf7877ae5ec0f0e50aa299265df not found: ID does not exist"
Sep 10 23:12:52.981237 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.981197    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"]
Sep 10 23:12:52.984885 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:52.984857    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-e7db0e72-68d6c7498c-pn2x7"]
Sep 10 23:12:53.367775 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.367749    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:53.368224 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.368047    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:53.368849 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.368832    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:12:53.605884 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.605850    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"]
Sep 10 23:12:53.606247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.606235    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e6deb9c-c762-405d-98c6-33d4328d37f3" containerName="payload-processing"
Sep 10 23:12:53.606293 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.606249    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e6deb9c-c762-405d-98c6-33d4328d37f3" containerName="payload-processing"
Sep 10 23:12:53.606329 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.606325    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e6deb9c-c762-405d-98c6-33d4328d37f3" containerName="payload-processing"
Sep 10 23:12:53.610881 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.610858    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.613687 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.613668    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-4a0c9f43-gw-openshift-default-dockercfg-8fkgk\""
Sep 10 23:12:53.628895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.628840    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"]
Sep 10 23:12:53.741184 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.741145    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4905456f-237f-4b71-a207-d0b06f4e143a-istiod-ca-cert\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.741361 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.741191    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-workload-certs\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.741361 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.741219    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-istio-data\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.741361 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.741300    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-istio-envoy\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.741361 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.741343    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b25x\" (UniqueName: \"kubernetes.io/projected/4905456f-237f-4b71-a207-d0b06f4e143a-kube-api-access-9b25x\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.741599 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.741446    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-workload-socket\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.741599 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.741490    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-credential-socket\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.741599 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.741586    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4905456f-237f-4b71-a207-d0b06f4e143a-istio-podinfo\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.741730 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.741613    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4905456f-237f-4b71-a207-d0b06f4e143a-istio-token\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.842716 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.842679    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-credential-socket\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.842917 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.842745    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4905456f-237f-4b71-a207-d0b06f4e143a-istio-podinfo\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.842917 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.842781    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4905456f-237f-4b71-a207-d0b06f4e143a-istio-token\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.842917 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.842816    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4905456f-237f-4b71-a207-d0b06f4e143a-istiod-ca-cert\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.843147 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.842939    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-workload-certs\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.843147 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.842982    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-istio-data\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.843147 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.843037    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-istio-envoy\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.843147 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.843067    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-credential-socket\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.843147 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.843080    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b25x\" (UniqueName: \"kubernetes.io/projected/4905456f-237f-4b71-a207-d0b06f4e143a-kube-api-access-9b25x\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.843425 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.843180    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-workload-socket\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.843425 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.843264    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-workload-certs\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.843425 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.843334    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-istio-data\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.843634 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.843467    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-workload-socket\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.843826 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.843806    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4905456f-237f-4b71-a207-d0b06f4e143a-istiod-ca-cert\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.845284 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.845261    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-istio-envoy\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.845409 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.845391    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4905456f-237f-4b71-a207-d0b06f4e143a-istio-podinfo\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.852737 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.852718    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b25x\" (UniqueName: \"kubernetes.io/projected/4905456f-237f-4b71-a207-d0b06f4e143a-kube-api-access-9b25x\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.852825 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.852804    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4905456f-237f-4b71-a207-d0b06f4e143a-istio-token\") pod \"e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") " pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:53.921539 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:53.921461    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:54.205385 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:54.205350    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"]
Sep 10 23:12:54.205994 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:12:54.205969    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4905456f_237f_4b71_a207_d0b06f4e143a.slice/crio-739b5ddebfcc5193b5741842de3094cf1539ae1656f6bf4568fe8729ca7cee2e WatchSource:0}: Error finding container 739b5ddebfcc5193b5741842de3094cf1539ae1656f6bf4568fe8729ca7cee2e: Status 404 returned error can't find the container with id 739b5ddebfcc5193b5741842de3094cf1539ae1656f6bf4568fe8729ca7cee2e
Sep 10 23:12:54.208321 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:54.208285    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:54.208430 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:54.208347    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:54.208430 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:54.208377    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:12:54.346441 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:54.346395    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e6deb9c-c762-405d-98c6-33d4328d37f3" path="/var/lib/kubelet/pods/3e6deb9c-c762-405d-98c6-33d4328d37f3/volumes"
Sep 10 23:12:54.953616 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:54.953554    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" event={"ID":"4905456f-237f-4b71-a207-d0b06f4e143a","Type":"ContainerStarted","Data":"e50e5301a29258a0ef9400c1c67ad85fad465b345d52fb060e6d65665efbb614"}
Sep 10 23:12:54.953980 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:54.953635    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" event={"ID":"4905456f-237f-4b71-a207-d0b06f4e143a","Type":"ContainerStarted","Data":"739b5ddebfcc5193b5741842de3094cf1539ae1656f6bf4568fe8729ca7cee2e"}
Sep 10 23:12:54.979148 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:54.979095    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" podStartSLOduration=1.979077272 podStartE2EDuration="1.979077272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:12:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:12:54.97714948 +0000 UTC m=+887.156020443" watchObservedRunningTime="2026-09-10 23:12:54.979077272 +0000 UTC m=+887.157948235"
Sep 10 23:12:55.922645 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:55.922613    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:55.927617 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:55.927594    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:55.960386 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:55.960355    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:55.961271 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:55.961251    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:12:57.357974 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.357925    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"]
Sep 10 23:12:57.362670 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.362647    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"
Sep 10 23:12:57.365062 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.365035    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-4a0c9f43\""
Sep 10 23:12:57.365167 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.365077    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-4a0c9f43-dockercfg-dmd2f\""
Sep 10 23:12:57.374327 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.374306    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"]
Sep 10 23:12:57.477919 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.477882    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-826sn\" (UniqueName: \"kubernetes.io/projected/e66c6ad2-8cbd-41d3-b842-8c6533e0b71a-kube-api-access-826sn\") pod \"payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq\" (UID: \"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a\") " pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"
Sep 10 23:12:57.479355 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.479326    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e66c6ad2-8cbd-41d3-b842-8c6533e0b71a-plugins-config-volume\") pod \"payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq\" (UID: \"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a\") " pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"
Sep 10 23:12:57.580426 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.580381    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-826sn\" (UniqueName: \"kubernetes.io/projected/e66c6ad2-8cbd-41d3-b842-8c6533e0b71a-kube-api-access-826sn\") pod \"payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq\" (UID: \"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a\") " pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"
Sep 10 23:12:57.580426 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.580426    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e66c6ad2-8cbd-41d3-b842-8c6533e0b71a-plugins-config-volume\") pod \"payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq\" (UID: \"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a\") " pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"
Sep 10 23:12:57.581178 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.581157    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e66c6ad2-8cbd-41d3-b842-8c6533e0b71a-plugins-config-volume\") pod \"payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq\" (UID: \"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a\") " pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"
Sep 10 23:12:57.590790 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.590757    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-826sn\" (UniqueName: \"kubernetes.io/projected/e66c6ad2-8cbd-41d3-b842-8c6533e0b71a-kube-api-access-826sn\") pod \"payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq\" (UID: \"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a\") " pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"
Sep 10 23:12:57.674626 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.674602    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"
Sep 10 23:12:57.950638 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.950611    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"]
Sep 10 23:12:57.952078 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:12:57.952047    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode66c6ad2_8cbd_41d3_b842_8c6533e0b71a.slice/crio-3c0cb5070565cb3f315605021fba87d95c6e0cec06f9a07f59974a80ecf6ef30 WatchSource:0}: Error finding container 3c0cb5070565cb3f315605021fba87d95c6e0cec06f9a07f59974a80ecf6ef30: Status 404 returned error can't find the container with id 3c0cb5070565cb3f315605021fba87d95c6e0cec06f9a07f59974a80ecf6ef30
Sep 10 23:12:57.972778 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.972751    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq" event={"ID":"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a","Type":"ContainerStarted","Data":"3c0cb5070565cb3f315605021fba87d95c6e0cec06f9a07f59974a80ecf6ef30"}
Sep 10 23:12:57.975068 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.975036    2585 generic.go:356] "Generic (PLEG): container finished" podID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerID="329150bc6f19aad16ed2435da7fa0b827991e9e6eef517bd98f8cb10a81d3c39" exitCode=0
Sep 10 23:12:57.975159 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.975113    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" event={"ID":"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f","Type":"ContainerDied","Data":"329150bc6f19aad16ed2435da7fa0b827991e9e6eef517bd98f8cb10a81d3c39"}
Sep 10 23:12:57.975229 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:57.975177    2585 scope.go:117] "RemoveContainer" containerID="95d3a0ecca4c242bbc0a002a65a02badb26add96eb82c37b04ae789204525d63"
Sep 10 23:12:58.303800 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.303768    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:58.489915 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.489820    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-workload-socket\") pod \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") "
Sep 10 23:12:58.489915 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.489889    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istiod-ca-cert\") pod \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") "
Sep 10 23:12:58.489915 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.489914    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-credential-socket\") pod \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") "
Sep 10 23:12:58.490481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.489961    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2t5qw\" (UniqueName: \"kubernetes.io/projected/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-kube-api-access-2t5qw\") pod \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") "
Sep 10 23:12:58.490481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.489990    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-podinfo\") pod \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") "
Sep 10 23:12:58.490481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.490046    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-workload-certs\") pod \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") "
Sep 10 23:12:58.490481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.490081    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" (UID: "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:12:58.490481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.490096    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-data\") pod \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") "
Sep 10 23:12:58.490481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.490169    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-envoy\") pod \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") "
Sep 10 23:12:58.490481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.490236    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-token\") pod \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\" (UID: \"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f\") "
Sep 10 23:12:58.490481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.490244    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" (UID: "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:12:58.490481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.490367    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" (UID: "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:12:58.490481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.490387    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" (UID: "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:12:58.490481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.490387    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" (UID: "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:12:58.491144 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.491122    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:12:58.491198 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.491148    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:12:58.491198 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.491161    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:12:58.491198 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.491174    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:12:58.491198 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.491187    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:12:58.492249 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.492217    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-kube-api-access-2t5qw" (OuterVolumeSpecName: "kube-api-access-2t5qw") pod "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" (UID: "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f"). InnerVolumeSpecName "kube-api-access-2t5qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:12:58.492359 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.492263    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" (UID: "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:12:58.492693 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.492673    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" (UID: "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:12:58.492767 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.492710    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" (UID: "cc9f8529-6e00-4b81-ab9c-83ff27b8b04f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:12:58.592480 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.592447    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2t5qw\" (UniqueName: \"kubernetes.io/projected/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-kube-api-access-2t5qw\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:12:58.592480 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.592475    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:12:58.592480 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.592485    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:12:58.592751 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.592494    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:12:58.982391 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.982361    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"
Sep 10 23:12:58.982626 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.982397    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4" event={"ID":"cc9f8529-6e00-4b81-ab9c-83ff27b8b04f","Type":"ContainerDied","Data":"c6e3cef45d8075d7ace20180075e6aa09d787663122ff0419f7dced90214b53b"}
Sep 10 23:12:58.982626 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.982452    2585 scope.go:117] "RemoveContainer" containerID="329150bc6f19aad16ed2435da7fa0b827991e9e6eef517bd98f8cb10a81d3c39"
Sep 10 23:12:58.984265 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.984236    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq" event={"ID":"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a","Type":"ContainerStarted","Data":"0b2e5d82553fba415104be4974c6de8b6eac39839fe25b0ba56c203bf427a8cc"}
Sep 10 23:12:58.984361 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:58.984289    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"
Sep 10 23:12:59.006123 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:59.006001    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq" podStartSLOduration=2.005982337 podStartE2EDuration="2.005982337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:12:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:12:59.005318037 +0000 UTC m=+891.184188999" watchObservedRunningTime="2026-09-10 23:12:59.005982337 +0000 UTC m=+891.184853302"
Sep 10 23:12:59.020496 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:59.020465    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"]
Sep 10 23:12:59.024646 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:12:59.024625    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e7db0e72-openshift-default-79967ffdc6-mrhc4"]
Sep 10 23:13:00.348800 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:00.348765    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" path="/var/lib/kubelet/pods/cc9f8529-6e00-4b81-ab9c-83ff27b8b04f/volumes"
Sep 10 23:13:08.345359 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:08.345331    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:13:08.349265 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:08.348983    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:13:08.353355 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:08.353336    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:13:08.356886 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:08.356868    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:13:09.993784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:09.993745    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"
Sep 10 23:13:11.629758 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:11.629062    2585 patch_prober.go:28] interesting pod/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": read tcp 10.134.0.2:37650->10.134.0.53:15021: read: connection reset by peer" start-of-body=
Sep 10 23:13:11.629758 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:11.629132    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": read tcp 10.134.0.2:37650->10.134.0.53:15021: read: connection reset by peer"
Sep 10 23:13:12.076845 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:12.076811    2585 generic.go:356] "Generic (PLEG): container finished" podID="4905456f-237f-4b71-a207-d0b06f4e143a" containerID="e50e5301a29258a0ef9400c1c67ad85fad465b345d52fb060e6d65665efbb614" exitCode=0
Sep 10 23:13:12.077012 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:12.076887    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" event={"ID":"4905456f-237f-4b71-a207-d0b06f4e143a","Type":"ContainerDied","Data":"e50e5301a29258a0ef9400c1c67ad85fad465b345d52fb060e6d65665efbb614"}
Sep 10 23:13:12.077336 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:12.077321    2585 scope.go:117] "RemoveContainer" containerID="e50e5301a29258a0ef9400c1c67ad85fad465b345d52fb060e6d65665efbb614"
Sep 10 23:13:12.078496 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:12.078464    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:13:12.078579 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:12.078540    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:13:12.078631 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:12.078586    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:13:13.084920 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:13.084885    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" event={"ID":"4905456f-237f-4b71-a207-d0b06f4e143a","Type":"ContainerStarted","Data":"18e795fd574958d9ee73f96c1bde0bce4a4f6fd6d55431a153d6cc22f4916714"}
Sep 10 23:13:13.921657 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:13.921620    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:13:13.922010 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:13.921979    2585 patch_prober.go:28] interesting pod/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 23:13:13.922112 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:13.922038    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 23:13:14.922852 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:14.922815    2585 patch_prober.go:28] interesting pod/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 23:13:14.923423 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:14.923389    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 23:13:15.922204 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:15.922159    2585 patch_prober.go:28] interesting pod/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 23:13:15.922382 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:15.922230    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 23:13:16.922116 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:16.922072    2585 patch_prober.go:28] interesting pod/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 23:13:16.922663 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:16.922157    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 23:13:17.922693 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:17.922654    2585 patch_prober.go:28] interesting pod/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 23:13:17.923915 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:17.923732    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 23:13:18.925639 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:18.925608    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:13:18.926047 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:18.925857    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:13:18.926650 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:18.926631    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:13:28.163758 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:28.163719    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"]
Sep 10 23:13:28.164797 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:28.164162    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq" podUID="e66c6ad2-8cbd-41d3-b842-8c6533e0b71a" containerName="payload-processing" containerID="cri-o://0b2e5d82553fba415104be4974c6de8b6eac39839fe25b0ba56c203bf427a8cc" gracePeriod=30
Sep 10 23:13:28.427530 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:28.427472    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"
Sep 10 23:13:28.512453 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:28.512363    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-826sn\" (UniqueName: \"kubernetes.io/projected/e66c6ad2-8cbd-41d3-b842-8c6533e0b71a-kube-api-access-826sn\") pod \"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a\" (UID: \"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a\") "
Sep 10 23:13:28.512453 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:28.512425    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e66c6ad2-8cbd-41d3-b842-8c6533e0b71a-plugins-config-volume\") pod \"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a\" (UID: \"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a\") "
Sep 10 23:13:28.513187 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:28.513117    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e66c6ad2-8cbd-41d3-b842-8c6533e0b71a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e66c6ad2-8cbd-41d3-b842-8c6533e0b71a" (UID: "e66c6ad2-8cbd-41d3-b842-8c6533e0b71a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:13:28.516070 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:28.516039    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e66c6ad2-8cbd-41d3-b842-8c6533e0b71a-kube-api-access-826sn" (OuterVolumeSpecName: "kube-api-access-826sn") pod "e66c6ad2-8cbd-41d3-b842-8c6533e0b71a" (UID: "e66c6ad2-8cbd-41d3-b842-8c6533e0b71a"). InnerVolumeSpecName "kube-api-access-826sn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:13:28.535922 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:28.535895    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"]
Sep 10 23:13:28.536159 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:28.536134    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" containerName="istio-proxy" containerID="cri-o://18e795fd574958d9ee73f96c1bde0bce4a4f6fd6d55431a153d6cc22f4916714" gracePeriod=30
Sep 10 23:13:28.613962 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:28.613918    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-826sn\" (UniqueName: \"kubernetes.io/projected/e66c6ad2-8cbd-41d3-b842-8c6533e0b71a-kube-api-access-826sn\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:13:28.613962 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:28.613952    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e66c6ad2-8cbd-41d3-b842-8c6533e0b71a-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:13:29.200296 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.200261    2585 generic.go:356] "Generic (PLEG): container finished" podID="e66c6ad2-8cbd-41d3-b842-8c6533e0b71a" containerID="0b2e5d82553fba415104be4974c6de8b6eac39839fe25b0ba56c203bf427a8cc" exitCode=0
Sep 10 23:13:29.200806 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.200316    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"
Sep 10 23:13:29.200806 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.200344    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq" event={"ID":"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a","Type":"ContainerDied","Data":"0b2e5d82553fba415104be4974c6de8b6eac39839fe25b0ba56c203bf427a8cc"}
Sep 10 23:13:29.200806 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.200414    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq" event={"ID":"e66c6ad2-8cbd-41d3-b842-8c6533e0b71a","Type":"ContainerDied","Data":"3c0cb5070565cb3f315605021fba87d95c6e0cec06f9a07f59974a80ecf6ef30"}
Sep 10 23:13:29.200806 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.200450    2585 scope.go:117] "RemoveContainer" containerID="0b2e5d82553fba415104be4974c6de8b6eac39839fe25b0ba56c203bf427a8cc"
Sep 10 23:13:29.211534 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.211513    2585 scope.go:117] "RemoveContainer" containerID="0b2e5d82553fba415104be4974c6de8b6eac39839fe25b0ba56c203bf427a8cc"
Sep 10 23:13:29.211890 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:13:29.211858    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b2e5d82553fba415104be4974c6de8b6eac39839fe25b0ba56c203bf427a8cc\": container with ID starting with 0b2e5d82553fba415104be4974c6de8b6eac39839fe25b0ba56c203bf427a8cc not found: ID does not exist" containerID="0b2e5d82553fba415104be4974c6de8b6eac39839fe25b0ba56c203bf427a8cc"
Sep 10 23:13:29.211992 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.211900    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b2e5d82553fba415104be4974c6de8b6eac39839fe25b0ba56c203bf427a8cc"} err="failed to get container status \"0b2e5d82553fba415104be4974c6de8b6eac39839fe25b0ba56c203bf427a8cc\": rpc error: code = NotFound desc = could not find container \"0b2e5d82553fba415104be4974c6de8b6eac39839fe25b0ba56c203bf427a8cc\": container with ID starting with 0b2e5d82553fba415104be4974c6de8b6eac39839fe25b0ba56c203bf427a8cc not found: ID does not exist"
Sep 10 23:13:29.227445 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.227420    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"]
Sep 10 23:13:29.235820 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.235794    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-4a0c9f43-8685cfb7bb-lhpmq"]
Sep 10 23:13:29.255816 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.255792    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"]
Sep 10 23:13:29.256261 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.256243    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e66c6ad2-8cbd-41d3-b842-8c6533e0b71a" containerName="payload-processing"
Sep 10 23:13:29.256261 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.256261    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e66c6ad2-8cbd-41d3-b842-8c6533e0b71a" containerName="payload-processing"
Sep 10 23:13:29.256443 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.256281    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerName="istio-proxy"
Sep 10 23:13:29.256443 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.256288    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerName="istio-proxy"
Sep 10 23:13:29.256443 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.256414    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerName="istio-proxy"
Sep 10 23:13:29.256443 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.256431    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerName="istio-proxy"
Sep 10 23:13:29.256443 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.256441    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e66c6ad2-8cbd-41d3-b842-8c6533e0b71a" containerName="payload-processing"
Sep 10 23:13:29.260867 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.260849    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.263239 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.263220    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-00575c78-openshift-default-dockercfg-tptsp\""
Sep 10 23:13:29.273271 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.273249    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"]
Sep 10 23:13:29.318624 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.318595    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2615458c-1e7f-4ca4-868a-730021fb00b7-istiod-ca-cert\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.318792 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.318665    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-envoy\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.318873 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.318793    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-workload-certs\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.318873 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.318839    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4cj8\" (UniqueName: \"kubernetes.io/projected/2615458c-1e7f-4ca4-868a-730021fb00b7-kube-api-access-x4cj8\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.318979 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.318869    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-data\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.318979 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.318901    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-podinfo\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.318979 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.318935    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-credential-socket\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.319115 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.318982    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-workload-socket\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.319115 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.319031    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-token\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.420274 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.420241    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2615458c-1e7f-4ca4-868a-730021fb00b7-istiod-ca-cert\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.420450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.420281    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-envoy\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.420450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.420338    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-workload-certs\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.420450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.420359    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4cj8\" (UniqueName: \"kubernetes.io/projected/2615458c-1e7f-4ca4-868a-730021fb00b7-kube-api-access-x4cj8\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.420450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.420377    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-data\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.420450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.420396    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-podinfo\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.420450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.420423    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-credential-socket\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.420809 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.420462    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-workload-socket\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.420809 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.420494    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-token\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.420916 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.420826    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-data\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.421127 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.421103    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2615458c-1e7f-4ca4-868a-730021fb00b7-istiod-ca-cert\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.421219 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.421140    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-workload-certs\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.421219 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.421180    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-credential-socket\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.421307 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.421189    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-workload-socket\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.422892 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.422865    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-envoy\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.423164 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.423145    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-podinfo\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.430504 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.430480    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-token\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.430669 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.430649    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4cj8\" (UniqueName: \"kubernetes.io/projected/2615458c-1e7f-4ca4-868a-730021fb00b7-kube-api-access-x4cj8\") pod \"e2e-ait-00575c78-openshift-default-99dbcdcd-247dn\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") " pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.571642 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.571612    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:29.860173 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.860135    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"]
Sep 10 23:13:29.861832 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:13:29.861804    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2615458c_1e7f_4ca4_868a_730021fb00b7.slice/crio-9f6ed8470089a21db2313ace7a9736fbf137ba91580a853c92e0d0d9594ee161 WatchSource:0}: Error finding container 9f6ed8470089a21db2313ace7a9736fbf137ba91580a853c92e0d0d9594ee161: Status 404 returned error can't find the container with id 9f6ed8470089a21db2313ace7a9736fbf137ba91580a853c92e0d0d9594ee161
Sep 10 23:13:29.863981 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.863951    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:13:29.864050 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.864016    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:13:29.864090 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:29.864046    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:13:30.210684 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:30.210580    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" event={"ID":"2615458c-1e7f-4ca4-868a-730021fb00b7","Type":"ContainerStarted","Data":"1e2be5fe1e0a4398a2c2f7cdd6a9822970c492fb3dd39c479272d873cf34b90f"}
Sep 10 23:13:30.211140 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:30.210680    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" event={"ID":"2615458c-1e7f-4ca4-868a-730021fb00b7","Type":"ContainerStarted","Data":"9f6ed8470089a21db2313ace7a9736fbf137ba91580a853c92e0d0d9594ee161"}
Sep 10 23:13:30.235710 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:30.235662    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" podStartSLOduration=1.2356476 podStartE2EDuration="1.2356476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:13:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:13:30.232273754 +0000 UTC m=+922.411144746" watchObservedRunningTime="2026-09-10 23:13:30.2356476 +0000 UTC m=+922.414518562"
Sep 10 23:13:30.341782 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:30.341749    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e66c6ad2-8cbd-41d3-b842-8c6533e0b71a" path="/var/lib/kubelet/pods/e66c6ad2-8cbd-41d3-b842-8c6533e0b71a/volumes"
Sep 10 23:13:30.572493 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:30.572454    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:30.577803 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:30.577779    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:31.218113 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:31.218079    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:31.219083 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:31.219065    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:33.804401 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.804296    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"]
Sep 10 23:13:33.805445 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.805414    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerName="istio-proxy"
Sep 10 23:13:33.805445 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.805444    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc9f8529-6e00-4b81-ab9c-83ff27b8b04f" containerName="istio-proxy"
Sep 10 23:13:33.809115 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.809095    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"
Sep 10 23:13:33.811538 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.811519    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-00575c78\""
Sep 10 23:13:33.811671 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.811631    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-00575c78-dockercfg-hp7d9\""
Sep 10 23:13:33.817185 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.817125    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"]
Sep 10 23:13:33.819609 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.819586    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:13:33.865829 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.865799    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b25x\" (UniqueName: \"kubernetes.io/projected/4905456f-237f-4b71-a207-d0b06f4e143a-kube-api-access-9b25x\") pod \"4905456f-237f-4b71-a207-d0b06f4e143a\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") "
Sep 10 23:13:33.866001 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.865855    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-credential-socket\") pod \"4905456f-237f-4b71-a207-d0b06f4e143a\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") "
Sep 10 23:13:33.866001 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.865979    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4905456f-237f-4b71-a207-d0b06f4e143a-istio-podinfo\") pod \"4905456f-237f-4b71-a207-d0b06f4e143a\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") "
Sep 10 23:13:33.866133 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866020    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4905456f-237f-4b71-a207-d0b06f4e143a-istio-token\") pod \"4905456f-237f-4b71-a207-d0b06f4e143a\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") "
Sep 10 23:13:33.866133 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866077    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4905456f-237f-4b71-a207-d0b06f4e143a-istiod-ca-cert\") pod \"4905456f-237f-4b71-a207-d0b06f4e143a\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") "
Sep 10 23:13:33.866133 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866103    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-workload-certs\") pod \"4905456f-237f-4b71-a207-d0b06f4e143a\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") "
Sep 10 23:13:33.866133 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866129    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-istio-envoy\") pod \"4905456f-237f-4b71-a207-d0b06f4e143a\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") "
Sep 10 23:13:33.866339 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866143    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4905456f-237f-4b71-a207-d0b06f4e143a" (UID: "4905456f-237f-4b71-a207-d0b06f4e143a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:13:33.866339 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866158    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-workload-socket\") pod \"4905456f-237f-4b71-a207-d0b06f4e143a\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") "
Sep 10 23:13:33.866339 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866207    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-istio-data\") pod \"4905456f-237f-4b71-a207-d0b06f4e143a\" (UID: \"4905456f-237f-4b71-a207-d0b06f4e143a\") "
Sep 10 23:13:33.866483 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866402    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4905456f-237f-4b71-a207-d0b06f4e143a" (UID: "4905456f-237f-4b71-a207-d0b06f4e143a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:13:33.866483 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866440    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1b6589-2b70-4012-b7e8-07cbf3a892e5-plugins-config-volume\") pod \"payload-processing-e2e-ait-00575c78-55899cc5b5-whxng\" (UID: \"cc1b6589-2b70-4012-b7e8-07cbf3a892e5\") " pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"
Sep 10 23:13:33.866483 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866466    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4905456f-237f-4b71-a207-d0b06f4e143a" (UID: "4905456f-237f-4b71-a207-d0b06f4e143a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:13:33.866659 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866625    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-istio-data" (OuterVolumeSpecName: "istio-data") pod "4905456f-237f-4b71-a207-d0b06f4e143a" (UID: "4905456f-237f-4b71-a207-d0b06f4e143a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:13:33.866659 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866640    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8mw5\" (UniqueName: \"kubernetes.io/projected/cc1b6589-2b70-4012-b7e8-07cbf3a892e5-kube-api-access-k8mw5\") pod \"payload-processing-e2e-ait-00575c78-55899cc5b5-whxng\" (UID: \"cc1b6589-2b70-4012-b7e8-07cbf3a892e5\") " pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"
Sep 10 23:13:33.866770 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866700    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:13:33.866770 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866716    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:13:33.866770 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866729    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:13:33.866770 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866742    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:13:33.866983 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.866852    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4905456f-237f-4b71-a207-d0b06f4e143a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4905456f-237f-4b71-a207-d0b06f4e143a" (UID: "4905456f-237f-4b71-a207-d0b06f4e143a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:13:33.868694 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.868663    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4905456f-237f-4b71-a207-d0b06f4e143a-istio-token" (OuterVolumeSpecName: "istio-token") pod "4905456f-237f-4b71-a207-d0b06f4e143a" (UID: "4905456f-237f-4b71-a207-d0b06f4e143a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:13:33.868926 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.868896    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4905456f-237f-4b71-a207-d0b06f4e143a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4905456f-237f-4b71-a207-d0b06f4e143a" (UID: "4905456f-237f-4b71-a207-d0b06f4e143a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:13:33.869032 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.868951    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4905456f-237f-4b71-a207-d0b06f4e143a-kube-api-access-9b25x" (OuterVolumeSpecName: "kube-api-access-9b25x") pod "4905456f-237f-4b71-a207-d0b06f4e143a" (UID: "4905456f-237f-4b71-a207-d0b06f4e143a"). InnerVolumeSpecName "kube-api-access-9b25x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:13:33.869032 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.868971    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4905456f-237f-4b71-a207-d0b06f4e143a" (UID: "4905456f-237f-4b71-a207-d0b06f4e143a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:13:33.967251 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.967216    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1b6589-2b70-4012-b7e8-07cbf3a892e5-plugins-config-volume\") pod \"payload-processing-e2e-ait-00575c78-55899cc5b5-whxng\" (UID: \"cc1b6589-2b70-4012-b7e8-07cbf3a892e5\") " pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"
Sep 10 23:13:33.967424 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.967284    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8mw5\" (UniqueName: \"kubernetes.io/projected/cc1b6589-2b70-4012-b7e8-07cbf3a892e5-kube-api-access-k8mw5\") pod \"payload-processing-e2e-ait-00575c78-55899cc5b5-whxng\" (UID: \"cc1b6589-2b70-4012-b7e8-07cbf3a892e5\") " pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"
Sep 10 23:13:33.967424 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.967336    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b25x\" (UniqueName: \"kubernetes.io/projected/4905456f-237f-4b71-a207-d0b06f4e143a-kube-api-access-9b25x\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:13:33.967424 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.967347    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4905456f-237f-4b71-a207-d0b06f4e143a-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:13:33.967424 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.967356    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4905456f-237f-4b71-a207-d0b06f4e143a-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:13:33.967424 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.967364    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4905456f-237f-4b71-a207-d0b06f4e143a-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:13:33.967424 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.967372    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4905456f-237f-4b71-a207-d0b06f4e143a-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:13:33.967887 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.967867    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1b6589-2b70-4012-b7e8-07cbf3a892e5-plugins-config-volume\") pod \"payload-processing-e2e-ait-00575c78-55899cc5b5-whxng\" (UID: \"cc1b6589-2b70-4012-b7e8-07cbf3a892e5\") " pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"
Sep 10 23:13:33.976590 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:33.976545    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8mw5\" (UniqueName: \"kubernetes.io/projected/cc1b6589-2b70-4012-b7e8-07cbf3a892e5-kube-api-access-k8mw5\") pod \"payload-processing-e2e-ait-00575c78-55899cc5b5-whxng\" (UID: \"cc1b6589-2b70-4012-b7e8-07cbf3a892e5\") " pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"
Sep 10 23:13:34.125738 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.125644    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"
Sep 10 23:13:34.238076 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.238040    2585 generic.go:356] "Generic (PLEG): container finished" podID="4905456f-237f-4b71-a207-d0b06f4e143a" containerID="18e795fd574958d9ee73f96c1bde0bce4a4f6fd6d55431a153d6cc22f4916714" exitCode=0
Sep 10 23:13:34.238239 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.238109    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" event={"ID":"4905456f-237f-4b71-a207-d0b06f4e143a","Type":"ContainerDied","Data":"18e795fd574958d9ee73f96c1bde0bce4a4f6fd6d55431a153d6cc22f4916714"}
Sep 10 23:13:34.238239 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.238126    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"
Sep 10 23:13:34.238239 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.238176    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q" event={"ID":"4905456f-237f-4b71-a207-d0b06f4e143a","Type":"ContainerDied","Data":"739b5ddebfcc5193b5741842de3094cf1539ae1656f6bf4568fe8729ca7cee2e"}
Sep 10 23:13:34.238239 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.238198    2585 scope.go:117] "RemoveContainer" containerID="18e795fd574958d9ee73f96c1bde0bce4a4f6fd6d55431a153d6cc22f4916714"
Sep 10 23:13:34.248856 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.248837    2585 scope.go:117] "RemoveContainer" containerID="e50e5301a29258a0ef9400c1c67ad85fad465b345d52fb060e6d65665efbb614"
Sep 10 23:13:34.257488 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.257472    2585 scope.go:117] "RemoveContainer" containerID="18e795fd574958d9ee73f96c1bde0bce4a4f6fd6d55431a153d6cc22f4916714"
Sep 10 23:13:34.257769 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:13:34.257749    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18e795fd574958d9ee73f96c1bde0bce4a4f6fd6d55431a153d6cc22f4916714\": container with ID starting with 18e795fd574958d9ee73f96c1bde0bce4a4f6fd6d55431a153d6cc22f4916714 not found: ID does not exist" containerID="18e795fd574958d9ee73f96c1bde0bce4a4f6fd6d55431a153d6cc22f4916714"
Sep 10 23:13:34.257828 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.257777    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18e795fd574958d9ee73f96c1bde0bce4a4f6fd6d55431a153d6cc22f4916714"} err="failed to get container status \"18e795fd574958d9ee73f96c1bde0bce4a4f6fd6d55431a153d6cc22f4916714\": rpc error: code = NotFound desc = could not find container \"18e795fd574958d9ee73f96c1bde0bce4a4f6fd6d55431a153d6cc22f4916714\": container with ID starting with 18e795fd574958d9ee73f96c1bde0bce4a4f6fd6d55431a153d6cc22f4916714 not found: ID does not exist"
Sep 10 23:13:34.257828 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.257795    2585 scope.go:117] "RemoveContainer" containerID="e50e5301a29258a0ef9400c1c67ad85fad465b345d52fb060e6d65665efbb614"
Sep 10 23:13:34.258035 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:13:34.258019    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e50e5301a29258a0ef9400c1c67ad85fad465b345d52fb060e6d65665efbb614\": container with ID starting with e50e5301a29258a0ef9400c1c67ad85fad465b345d52fb060e6d65665efbb614 not found: ID does not exist" containerID="e50e5301a29258a0ef9400c1c67ad85fad465b345d52fb060e6d65665efbb614"
Sep 10 23:13:34.258077 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.258041    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e50e5301a29258a0ef9400c1c67ad85fad465b345d52fb060e6d65665efbb614"} err="failed to get container status \"e50e5301a29258a0ef9400c1c67ad85fad465b345d52fb060e6d65665efbb614\": rpc error: code = NotFound desc = could not find container \"e50e5301a29258a0ef9400c1c67ad85fad465b345d52fb060e6d65665efbb614\": container with ID starting with e50e5301a29258a0ef9400c1c67ad85fad465b345d52fb060e6d65665efbb614 not found: ID does not exist"
Sep 10 23:13:34.266763 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.266736    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"]
Sep 10 23:13:34.269523 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.269501    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-4a0c9f43-gw-openshift-default-56c5cb8776-kx92q"]
Sep 10 23:13:34.342126 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.342092    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" path="/var/lib/kubelet/pods/4905456f-237f-4b71-a207-d0b06f4e143a/volumes"
Sep 10 23:13:34.404476 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:34.404452    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"]
Sep 10 23:13:34.406020 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:13:34.405994    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1b6589_2b70_4012_b7e8_07cbf3a892e5.slice/crio-5fba75c311184f3285bbf25c807ff3de94dcae5dd24982e2d671eff73dd7c0f7 WatchSource:0}: Error finding container 5fba75c311184f3285bbf25c807ff3de94dcae5dd24982e2d671eff73dd7c0f7: Status 404 returned error can't find the container with id 5fba75c311184f3285bbf25c807ff3de94dcae5dd24982e2d671eff73dd7c0f7
Sep 10 23:13:35.245502 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:35.245462    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng" event={"ID":"cc1b6589-2b70-4012-b7e8-07cbf3a892e5","Type":"ContainerStarted","Data":"03587ea5e1bb986da318a4c1f09fc273f916b9e11f53911a885a703660c8f23d"}
Sep 10 23:13:35.245987 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:35.245534    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng" event={"ID":"cc1b6589-2b70-4012-b7e8-07cbf3a892e5","Type":"ContainerStarted","Data":"5fba75c311184f3285bbf25c807ff3de94dcae5dd24982e2d671eff73dd7c0f7"}
Sep 10 23:13:35.245987 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:35.245579    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"
Sep 10 23:13:35.272457 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:35.272403    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng" podStartSLOduration=2.272389574 podStartE2EDuration="2.272389574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:13:35.270060329 +0000 UTC m=+927.448931291" watchObservedRunningTime="2026-09-10 23:13:35.272389574 +0000 UTC m=+927.451260590"
Sep 10 23:13:46.255771 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:46.255738    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"
Sep 10 23:13:53.377379 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:53.377346    2585 generic.go:356] "Generic (PLEG): container finished" podID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerID="1e2be5fe1e0a4398a2c2f7cdd6a9822970c492fb3dd39c479272d873cf34b90f" exitCode=0
Sep 10 23:13:53.377797 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:53.377419    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" event={"ID":"2615458c-1e7f-4ca4-868a-730021fb00b7","Type":"ContainerDied","Data":"1e2be5fe1e0a4398a2c2f7cdd6a9822970c492fb3dd39c479272d873cf34b90f"}
Sep 10 23:13:53.377966 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:53.377949    2585 scope.go:117] "RemoveContainer" containerID="1e2be5fe1e0a4398a2c2f7cdd6a9822970c492fb3dd39c479272d873cf34b90f"
Sep 10 23:13:53.379202 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:53.379169    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:13:53.379314 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:53.379254    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:13:53.379314 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:53.379304    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:13:54.384966 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:54.384930    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" event={"ID":"2615458c-1e7f-4ca4-868a-730021fb00b7","Type":"ContainerStarted","Data":"c58ff030c72500d712444adbc2edcf1b7a7ac29d2bf31b6342372a4487eeeb00"}
Sep 10 23:13:54.572555 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:54.572520    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:13:54.572871 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:54.572848    2585 patch_prober.go:28] interesting pod/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 23:13:54.572933 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:54.572900    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 23:13:55.572016 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:55.571975    2585 patch_prober.go:28] interesting pod/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 23:13:55.572401 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:55.572048    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 23:13:56.572807 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:56.572776    2585 patch_prober.go:28] interesting pod/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 23:13:56.573180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:56.572860    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 23:13:57.572796 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:57.572759    2585 patch_prober.go:28] interesting pod/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 23:13:57.572980 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:57.572815    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 23:13:58.572039 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:58.572000    2585 patch_prober.go:28] interesting pod/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 23:13:58.572245 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:58.572074    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 23:13:59.572973 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:59.572935    2585 patch_prober.go:28] interesting pod/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 23:13:59.573446 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:13:59.573000    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 23:14:00.572497 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:00.572456    2585 patch_prober.go:28] interesting pod/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 10 23:14:00.572716 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:00.572524    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 10 23:14:01.218702 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:01.218666    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:14:01.576913 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:01.576882    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:14:01.578119 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:01.578100    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:14:03.780576 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:03.780528    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"]
Sep 10 23:14:03.781006 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:03.780821    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng" podUID="cc1b6589-2b70-4012-b7e8-07cbf3a892e5" containerName="payload-processing" containerID="cri-o://03587ea5e1bb986da318a4c1f09fc273f916b9e11f53911a885a703660c8f23d" gracePeriod=30
Sep 10 23:14:04.075574 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.075526    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"
Sep 10 23:14:04.082324 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.082295    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8mw5\" (UniqueName: \"kubernetes.io/projected/cc1b6589-2b70-4012-b7e8-07cbf3a892e5-kube-api-access-k8mw5\") pod \"cc1b6589-2b70-4012-b7e8-07cbf3a892e5\" (UID: \"cc1b6589-2b70-4012-b7e8-07cbf3a892e5\") "
Sep 10 23:14:04.082480 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.082399    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1b6589-2b70-4012-b7e8-07cbf3a892e5-plugins-config-volume\") pod \"cc1b6589-2b70-4012-b7e8-07cbf3a892e5\" (UID: \"cc1b6589-2b70-4012-b7e8-07cbf3a892e5\") "
Sep 10 23:14:04.082885 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.082855    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc1b6589-2b70-4012-b7e8-07cbf3a892e5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cc1b6589-2b70-4012-b7e8-07cbf3a892e5" (UID: "cc1b6589-2b70-4012-b7e8-07cbf3a892e5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:14:04.084980 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.084942    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1b6589-2b70-4012-b7e8-07cbf3a892e5-kube-api-access-k8mw5" (OuterVolumeSpecName: "kube-api-access-k8mw5") pod "cc1b6589-2b70-4012-b7e8-07cbf3a892e5" (UID: "cc1b6589-2b70-4012-b7e8-07cbf3a892e5"). InnerVolumeSpecName "kube-api-access-k8mw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:14:04.183886 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.183838    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cc1b6589-2b70-4012-b7e8-07cbf3a892e5-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:04.183886 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.183872    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8mw5\" (UniqueName: \"kubernetes.io/projected/cc1b6589-2b70-4012-b7e8-07cbf3a892e5-kube-api-access-k8mw5\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:04.456962 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.456930    2585 generic.go:356] "Generic (PLEG): container finished" podID="cc1b6589-2b70-4012-b7e8-07cbf3a892e5" containerID="03587ea5e1bb986da318a4c1f09fc273f916b9e11f53911a885a703660c8f23d" exitCode=0
Sep 10 23:14:04.457120 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.456971    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng" event={"ID":"cc1b6589-2b70-4012-b7e8-07cbf3a892e5","Type":"ContainerDied","Data":"03587ea5e1bb986da318a4c1f09fc273f916b9e11f53911a885a703660c8f23d"}
Sep 10 23:14:04.457120 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.456979    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"
Sep 10 23:14:04.457120 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.457013    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng" event={"ID":"cc1b6589-2b70-4012-b7e8-07cbf3a892e5","Type":"ContainerDied","Data":"5fba75c311184f3285bbf25c807ff3de94dcae5dd24982e2d671eff73dd7c0f7"}
Sep 10 23:14:04.457120 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.457036    2585 scope.go:117] "RemoveContainer" containerID="03587ea5e1bb986da318a4c1f09fc273f916b9e11f53911a885a703660c8f23d"
Sep 10 23:14:04.469279 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.469257    2585 scope.go:117] "RemoveContainer" containerID="03587ea5e1bb986da318a4c1f09fc273f916b9e11f53911a885a703660c8f23d"
Sep 10 23:14:04.469586 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:14:04.469567    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03587ea5e1bb986da318a4c1f09fc273f916b9e11f53911a885a703660c8f23d\": container with ID starting with 03587ea5e1bb986da318a4c1f09fc273f916b9e11f53911a885a703660c8f23d not found: ID does not exist" containerID="03587ea5e1bb986da318a4c1f09fc273f916b9e11f53911a885a703660c8f23d"
Sep 10 23:14:04.469644 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.469597    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03587ea5e1bb986da318a4c1f09fc273f916b9e11f53911a885a703660c8f23d"} err="failed to get container status \"03587ea5e1bb986da318a4c1f09fc273f916b9e11f53911a885a703660c8f23d\": rpc error: code = NotFound desc = could not find container \"03587ea5e1bb986da318a4c1f09fc273f916b9e11f53911a885a703660c8f23d\": container with ID starting with 03587ea5e1bb986da318a4c1f09fc273f916b9e11f53911a885a703660c8f23d not found: ID does not exist"
Sep 10 23:14:04.485794 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.485770    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"]
Sep 10 23:14:04.490203 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:04.490170    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-00575c78-55899cc5b5-whxng"]
Sep 10 23:14:05.092054 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.092018    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"]
Sep 10 23:14:05.092537 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.092259    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy" containerID="cri-o://c58ff030c72500d712444adbc2edcf1b7a7ac29d2bf31b6342372a4487eeeb00" gracePeriod=30
Sep 10 23:14:05.822104 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.822058    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"]
Sep 10 23:14:05.822786 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.822762    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1b6589-2b70-4012-b7e8-07cbf3a892e5" containerName="payload-processing"
Sep 10 23:14:05.822786 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.822787    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1b6589-2b70-4012-b7e8-07cbf3a892e5" containerName="payload-processing"
Sep 10 23:14:05.822991 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.822816    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" containerName="istio-proxy"
Sep 10 23:14:05.822991 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.822825    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" containerName="istio-proxy"
Sep 10 23:14:05.822991 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.822853    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" containerName="istio-proxy"
Sep 10 23:14:05.822991 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.822863    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" containerName="istio-proxy"
Sep 10 23:14:05.822991 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.822980    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" containerName="istio-proxy"
Sep 10 23:14:05.822991 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.822988    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1b6589-2b70-4012-b7e8-07cbf3a892e5" containerName="payload-processing"
Sep 10 23:14:05.826771 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.826748    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:05.829576 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.829545    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-e5ec8ad4-openshift-default-dockercfg-jqs58\""
Sep 10 23:14:05.839841 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.839807    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"]
Sep 10 23:14:05.900020 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.899981    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-workload-certs\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:05.900020 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.900032    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-istio-data\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:05.900286 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.900130    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-istio-envoy\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:05.900286 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.900192    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ada9ab88-6501-467e-ac77-03b080640251-istio-token\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:05.900286 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.900237    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ada9ab88-6501-467e-ac77-03b080640251-istiod-ca-cert\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:05.900451 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.900311    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-workload-socket\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:05.900451 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.900350    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-credential-socket\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:05.900550 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.900444    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ada9ab88-6501-467e-ac77-03b080640251-istio-podinfo\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:05.900550 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:05.900494    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pv79\" (UniqueName: \"kubernetes.io/projected/ada9ab88-6501-467e-ac77-03b080640251-kube-api-access-9pv79\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.001132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.001096    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-workload-socket\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.001400 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.001377    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-credential-socket\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.001961 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.001940    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ada9ab88-6501-467e-ac77-03b080640251-istio-podinfo\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.002161 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.002143    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pv79\" (UniqueName: \"kubernetes.io/projected/ada9ab88-6501-467e-ac77-03b080640251-kube-api-access-9pv79\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.002628 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.002608    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-workload-certs\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.003507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.002811    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-istio-data\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.003507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.002896    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-istio-envoy\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.003507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.002977    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ada9ab88-6501-467e-ac77-03b080640251-istio-token\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.003507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.003001    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-workload-certs\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.003507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.003030    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ada9ab88-6501-467e-ac77-03b080640251-istiod-ca-cert\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.003507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.001698    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-workload-socket\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.003507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.003242    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-istio-data\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.003507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.001825    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-credential-socket\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.004530 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.004400    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ada9ab88-6501-467e-ac77-03b080640251-istiod-ca-cert\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.008632 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.005933    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ada9ab88-6501-467e-ac77-03b080640251-istio-podinfo\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.008632 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.006137    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-istio-envoy\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.012580 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.012510    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pv79\" (UniqueName: \"kubernetes.io/projected/ada9ab88-6501-467e-ac77-03b080640251-kube-api-access-9pv79\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.018114 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.018093    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ada9ab88-6501-467e-ac77-03b080640251-istio-token\") pod \"e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") " pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.139615 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.139500    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:06.345224 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.345187    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc1b6589-2b70-4012-b7e8-07cbf3a892e5" path="/var/lib/kubelet/pods/cc1b6589-2b70-4012-b7e8-07cbf3a892e5/volumes"
Sep 10 23:14:06.438114 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.438079    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"]
Sep 10 23:14:06.439298 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:14:06.439264    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada9ab88_6501_467e_ac77_03b080640251.slice/crio-6eeb4281a76eaeab15bf932943016caf13549452a199da204fab6a98470008c6 WatchSource:0}: Error finding container 6eeb4281a76eaeab15bf932943016caf13549452a199da204fab6a98470008c6: Status 404 returned error can't find the container with id 6eeb4281a76eaeab15bf932943016caf13549452a199da204fab6a98470008c6
Sep 10 23:14:06.442013 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.441980    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:14:06.442127 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.442055    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:14:06.442127 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.442109    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:14:06.472287 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:06.472254    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" event={"ID":"ada9ab88-6501-467e-ac77-03b080640251","Type":"ContainerStarted","Data":"6eeb4281a76eaeab15bf932943016caf13549452a199da204fab6a98470008c6"}
Sep 10 23:14:07.479783 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:07.479744    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" event={"ID":"ada9ab88-6501-467e-ac77-03b080640251","Type":"ContainerStarted","Data":"7ee417ab76a080116c373af08b59e61ee265c078b5884e802a884fd41e9fba6a"}
Sep 10 23:14:07.504785 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:07.504723    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" podStartSLOduration=2.504707322 podStartE2EDuration="2.504707322s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:14:07.504125649 +0000 UTC m=+959.682996612" watchObservedRunningTime="2026-09-10 23:14:07.504707322 +0000 UTC m=+959.683578343"
Sep 10 23:14:08.139899 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:08.139861    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:08.145590 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:08.145545    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:08.486688 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:08.486609    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:08.487514 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:08.487495    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:10.356898 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.356873    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:14:10.446155 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446058    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2615458c-1e7f-4ca4-868a-730021fb00b7-istiod-ca-cert\") pod \"2615458c-1e7f-4ca4-868a-730021fb00b7\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") "
Sep 10 23:14:10.446155 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446099    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-workload-socket\") pod \"2615458c-1e7f-4ca4-868a-730021fb00b7\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") "
Sep 10 23:14:10.446155 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446131    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4cj8\" (UniqueName: \"kubernetes.io/projected/2615458c-1e7f-4ca4-868a-730021fb00b7-kube-api-access-x4cj8\") pod \"2615458c-1e7f-4ca4-868a-730021fb00b7\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") "
Sep 10 23:14:10.446450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446161    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-credential-socket\") pod \"2615458c-1e7f-4ca4-868a-730021fb00b7\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") "
Sep 10 23:14:10.446450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446214    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-data\") pod \"2615458c-1e7f-4ca4-868a-730021fb00b7\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") "
Sep 10 23:14:10.446450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446341    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-workload-certs\") pod \"2615458c-1e7f-4ca4-868a-730021fb00b7\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") "
Sep 10 23:14:10.446450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446406    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-token\") pod \"2615458c-1e7f-4ca4-868a-730021fb00b7\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") "
Sep 10 23:14:10.446697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446484    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2615458c-1e7f-4ca4-868a-730021fb00b7" (UID: "2615458c-1e7f-4ca4-868a-730021fb00b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:14:10.446697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446498    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-podinfo\") pod \"2615458c-1e7f-4ca4-868a-730021fb00b7\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") "
Sep 10 23:14:10.446697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446526    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-envoy\") pod \"2615458c-1e7f-4ca4-868a-730021fb00b7\" (UID: \"2615458c-1e7f-4ca4-868a-730021fb00b7\") "
Sep 10 23:14:10.446697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446544    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2615458c-1e7f-4ca4-868a-730021fb00b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2615458c-1e7f-4ca4-868a-730021fb00b7" (UID: "2615458c-1e7f-4ca4-868a-730021fb00b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:14:10.446697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446530    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "2615458c-1e7f-4ca4-868a-730021fb00b7" (UID: "2615458c-1e7f-4ca4-868a-730021fb00b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:14:10.446697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446616    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2615458c-1e7f-4ca4-868a-730021fb00b7" (UID: "2615458c-1e7f-4ca4-868a-730021fb00b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:14:10.446991 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446746    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2615458c-1e7f-4ca4-868a-730021fb00b7" (UID: "2615458c-1e7f-4ca4-868a-730021fb00b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:14:10.446991 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446948    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2615458c-1e7f-4ca4-868a-730021fb00b7-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:10.446991 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446969    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:10.446991 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446983    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:10.447193 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.446996    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:10.447193 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.447009    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:10.448603 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.448552    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2615458c-1e7f-4ca4-868a-730021fb00b7" (UID: "2615458c-1e7f-4ca4-868a-730021fb00b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:14:10.448603 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.448583    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "2615458c-1e7f-4ca4-868a-730021fb00b7" (UID: "2615458c-1e7f-4ca4-868a-730021fb00b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:14:10.448934 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.448912    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2615458c-1e7f-4ca4-868a-730021fb00b7-kube-api-access-x4cj8" (OuterVolumeSpecName: "kube-api-access-x4cj8") pod "2615458c-1e7f-4ca4-868a-730021fb00b7" (UID: "2615458c-1e7f-4ca4-868a-730021fb00b7"). InnerVolumeSpecName "kube-api-access-x4cj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:14:10.448934 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.448918    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2615458c-1e7f-4ca4-868a-730021fb00b7" (UID: "2615458c-1e7f-4ca4-868a-730021fb00b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:14:10.511427 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.511366    2585 generic.go:356] "Generic (PLEG): container finished" podID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerID="c58ff030c72500d712444adbc2edcf1b7a7ac29d2bf31b6342372a4487eeeb00" exitCode=0
Sep 10 23:14:10.511628 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.511458    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" event={"ID":"2615458c-1e7f-4ca4-868a-730021fb00b7","Type":"ContainerDied","Data":"c58ff030c72500d712444adbc2edcf1b7a7ac29d2bf31b6342372a4487eeeb00"}
Sep 10 23:14:10.511628 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.511476    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"
Sep 10 23:14:10.511628 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.511573    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn" event={"ID":"2615458c-1e7f-4ca4-868a-730021fb00b7","Type":"ContainerDied","Data":"9f6ed8470089a21db2313ace7a9736fbf137ba91580a853c92e0d0d9594ee161"}
Sep 10 23:14:10.511628 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.511608    2585 scope.go:117] "RemoveContainer" containerID="c58ff030c72500d712444adbc2edcf1b7a7ac29d2bf31b6342372a4487eeeb00"
Sep 10 23:14:10.524078 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.524061    2585 scope.go:117] "RemoveContainer" containerID="1e2be5fe1e0a4398a2c2f7cdd6a9822970c492fb3dd39c479272d873cf34b90f"
Sep 10 23:14:10.532943 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.532918    2585 scope.go:117] "RemoveContainer" containerID="c58ff030c72500d712444adbc2edcf1b7a7ac29d2bf31b6342372a4487eeeb00"
Sep 10 23:14:10.533284 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:14:10.533261    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c58ff030c72500d712444adbc2edcf1b7a7ac29d2bf31b6342372a4487eeeb00\": container with ID starting with c58ff030c72500d712444adbc2edcf1b7a7ac29d2bf31b6342372a4487eeeb00 not found: ID does not exist" containerID="c58ff030c72500d712444adbc2edcf1b7a7ac29d2bf31b6342372a4487eeeb00"
Sep 10 23:14:10.533364 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.533293    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c58ff030c72500d712444adbc2edcf1b7a7ac29d2bf31b6342372a4487eeeb00"} err="failed to get container status \"c58ff030c72500d712444adbc2edcf1b7a7ac29d2bf31b6342372a4487eeeb00\": rpc error: code = NotFound desc = could not find container \"c58ff030c72500d712444adbc2edcf1b7a7ac29d2bf31b6342372a4487eeeb00\": container with ID starting with c58ff030c72500d712444adbc2edcf1b7a7ac29d2bf31b6342372a4487eeeb00 not found: ID does not exist"
Sep 10 23:14:10.533364 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.533311    2585 scope.go:117] "RemoveContainer" containerID="1e2be5fe1e0a4398a2c2f7cdd6a9822970c492fb3dd39c479272d873cf34b90f"
Sep 10 23:14:10.533608 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:14:10.533578    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e2be5fe1e0a4398a2c2f7cdd6a9822970c492fb3dd39c479272d873cf34b90f\": container with ID starting with 1e2be5fe1e0a4398a2c2f7cdd6a9822970c492fb3dd39c479272d873cf34b90f not found: ID does not exist" containerID="1e2be5fe1e0a4398a2c2f7cdd6a9822970c492fb3dd39c479272d873cf34b90f"
Sep 10 23:14:10.533663 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.533603    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e2be5fe1e0a4398a2c2f7cdd6a9822970c492fb3dd39c479272d873cf34b90f"} err="failed to get container status \"1e2be5fe1e0a4398a2c2f7cdd6a9822970c492fb3dd39c479272d873cf34b90f\": rpc error: code = NotFound desc = could not find container \"1e2be5fe1e0a4398a2c2f7cdd6a9822970c492fb3dd39c479272d873cf34b90f\": container with ID starting with 1e2be5fe1e0a4398a2c2f7cdd6a9822970c492fb3dd39c479272d873cf34b90f not found: ID does not exist"
Sep 10 23:14:10.547645 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.547614    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4cj8\" (UniqueName: \"kubernetes.io/projected/2615458c-1e7f-4ca4-868a-730021fb00b7-kube-api-access-x4cj8\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:10.547645 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.547645    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:10.547774 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.547659    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:10.547774 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.547671    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2615458c-1e7f-4ca4-868a-730021fb00b7-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:10.561311 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.561288    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"]
Sep 10 23:14:10.563655 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.563635    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-00575c78-openshift-default-99dbcdcd-247dn"]
Sep 10 23:14:10.752752 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.752669    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"]
Sep 10 23:14:10.753128 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.753112    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy"
Sep 10 23:14:10.753187 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.753130    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy"
Sep 10 23:14:10.753187 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.753146    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy"
Sep 10 23:14:10.753187 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.753151    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy"
Sep 10 23:14:10.753334 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.753248    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4905456f-237f-4b71-a207-d0b06f4e143a" containerName="istio-proxy"
Sep 10 23:14:10.753334 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.753259    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy"
Sep 10 23:14:10.757647 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.757626    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"
Sep 10 23:14:10.760658 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.760637    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-e5ec8ad4\""
Sep 10 23:14:10.766365 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.766342    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"]
Sep 10 23:14:10.850063 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.850022    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2205d298-c033-4fbc-bae0-7d8a0bf6daba-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr\" (UID: \"2205d298-c033-4fbc-bae0-7d8a0bf6daba\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"
Sep 10 23:14:10.850276 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.850246    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-765gv\" (UniqueName: \"kubernetes.io/projected/2205d298-c033-4fbc-bae0-7d8a0bf6daba-kube-api-access-765gv\") pod \"payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr\" (UID: \"2205d298-c033-4fbc-bae0-7d8a0bf6daba\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"
Sep 10 23:14:10.951088 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.951051    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-765gv\" (UniqueName: \"kubernetes.io/projected/2205d298-c033-4fbc-bae0-7d8a0bf6daba-kube-api-access-765gv\") pod \"payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr\" (UID: \"2205d298-c033-4fbc-bae0-7d8a0bf6daba\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"
Sep 10 23:14:10.951088 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.951106    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2205d298-c033-4fbc-bae0-7d8a0bf6daba-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr\" (UID: \"2205d298-c033-4fbc-bae0-7d8a0bf6daba\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"
Sep 10 23:14:10.951840 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.951819    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2205d298-c033-4fbc-bae0-7d8a0bf6daba-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr\" (UID: \"2205d298-c033-4fbc-bae0-7d8a0bf6daba\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"
Sep 10 23:14:10.961587 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:10.961540    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-765gv\" (UniqueName: \"kubernetes.io/projected/2205d298-c033-4fbc-bae0-7d8a0bf6daba-kube-api-access-765gv\") pod \"payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr\" (UID: \"2205d298-c033-4fbc-bae0-7d8a0bf6daba\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"
Sep 10 23:14:11.069530 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:11.069488    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"
Sep 10 23:14:11.351014 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:11.350985    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"]
Sep 10 23:14:11.351128 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:14:11.351078    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2205d298_c033_4fbc_bae0_7d8a0bf6daba.slice/crio-7aaa6a1db59bdbf2eb71cd34283ff321256b2242970023e7ffda19dca6674ff4 WatchSource:0}: Error finding container 7aaa6a1db59bdbf2eb71cd34283ff321256b2242970023e7ffda19dca6674ff4: Status 404 returned error can't find the container with id 7aaa6a1db59bdbf2eb71cd34283ff321256b2242970023e7ffda19dca6674ff4
Sep 10 23:14:11.521276 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:11.521239    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr" event={"ID":"2205d298-c033-4fbc-bae0-7d8a0bf6daba","Type":"ContainerStarted","Data":"ad6694c77fe582474b76b3d65e00d1724e7b4699078317bf12bfaa0554804224"}
Sep 10 23:14:11.521776 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:11.521307    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr" event={"ID":"2205d298-c033-4fbc-bae0-7d8a0bf6daba","Type":"ContainerStarted","Data":"7aaa6a1db59bdbf2eb71cd34283ff321256b2242970023e7ffda19dca6674ff4"}
Sep 10 23:14:11.521776 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:11.521341    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"
Sep 10 23:14:11.541692 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:11.541642    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr" podStartSLOduration=1.541628634 podStartE2EDuration="1.541628634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:14:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:14:11.538660551 +0000 UTC m=+963.717531514" watchObservedRunningTime="2026-09-10 23:14:11.541628634 +0000 UTC m=+963.720499598"
Sep 10 23:14:12.343847 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:12.343814    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" path="/var/lib/kubelet/pods/2615458c-1e7f-4ca4-868a-730021fb00b7/volumes"
Sep 10 23:14:22.530159 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:22.530126    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"
Sep 10 23:14:24.528758 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:24.528717    2585 patch_prober.go:28] interesting pod/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 23:14:24.529243 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:24.528794    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" podUID="ada9ab88-6501-467e-ac77-03b080640251" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:14:26.617091 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:26.617062    2585 generic.go:356] "Generic (PLEG): container finished" podID="ada9ab88-6501-467e-ac77-03b080640251" containerID="7ee417ab76a080116c373af08b59e61ee265c078b5884e802a884fd41e9fba6a" exitCode=0
Sep 10 23:14:26.617492 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:26.617140    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" event={"ID":"ada9ab88-6501-467e-ac77-03b080640251","Type":"ContainerDied","Data":"7ee417ab76a080116c373af08b59e61ee265c078b5884e802a884fd41e9fba6a"}
Sep 10 23:14:26.617624 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:26.617606    2585 scope.go:117] "RemoveContainer" containerID="7ee417ab76a080116c373af08b59e61ee265c078b5884e802a884fd41e9fba6a"
Sep 10 23:14:26.618654 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:26.618627    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:14:26.618710 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:26.618693    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:14:26.618754 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:26.618724    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:14:27.634907 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:27.634872    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" event={"ID":"ada9ab88-6501-467e-ac77-03b080640251","Type":"ContainerStarted","Data":"6d1a3a03c354e4f6036df6c1dac6ea35fba81c9334cdaf5b722f31773d99f80a"}
Sep 10 23:14:28.139640 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:28.139599    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:28.139948 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:28.139915    2585 patch_prober.go:28] interesting pod/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 10 23:14:28.140007 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:28.139987    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" podUID="ada9ab88-6501-467e-ac77-03b080640251" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 10 23:14:29.139956 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:29.139913    2585 patch_prober.go:28] interesting pod/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 10 23:14:29.140335 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:29.139980    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" podUID="ada9ab88-6501-467e-ac77-03b080640251" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 10 23:14:30.140665 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:30.140622    2585 patch_prober.go:28] interesting pod/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 10 23:14:30.141159 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:30.140690    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" podUID="ada9ab88-6501-467e-ac77-03b080640251" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 10 23:14:31.140124 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:31.140036    2585 patch_prober.go:28] interesting pod/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 10 23:14:31.140124 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:31.140109    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" podUID="ada9ab88-6501-467e-ac77-03b080640251" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 10 23:14:32.140625 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:32.140587    2585 patch_prober.go:28] interesting pod/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 10 23:14:32.141028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:32.140658    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" podUID="ada9ab88-6501-467e-ac77-03b080640251" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 10 23:14:33.282081 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:33.282042    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:33.282552 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:33.282380    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:33.283168 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:33.283152    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:34.364001 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:34.363956    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6"]
Sep 10 23:14:34.364466 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:34.364452    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2615458c-1e7f-4ca4-868a-730021fb00b7" containerName="istio-proxy"
Sep 10 23:14:34.367723 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:34.367708    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6"
Sep 10 23:14:34.370240 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:34.370220    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:14:34.370346 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:34.370227    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:14:34.389295 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:34.389261    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6"]
Sep 10 23:14:34.488612 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:34.488549    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13f92aa3-2486-408a-8a3d-b30afe011c0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-3a438f-w6ld6\" (UID: \"13f92aa3-2486-408a-8a3d-b30afe011c0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6"
Sep 10 23:14:34.590204 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:34.590173    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13f92aa3-2486-408a-8a3d-b30afe011c0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-3a438f-w6ld6\" (UID: \"13f92aa3-2486-408a-8a3d-b30afe011c0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6"
Sep 10 23:14:34.590825 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:34.590804    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13f92aa3-2486-408a-8a3d-b30afe011c0f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-3a438f-w6ld6\" (UID: \"13f92aa3-2486-408a-8a3d-b30afe011c0f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6"
Sep 10 23:14:34.684188 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:34.684098    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6"
Sep 10 23:14:34.983304 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:34.983274    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6"]
Sep 10 23:14:34.985381 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:14:34.985346    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13f92aa3_2486_408a_8a3d_b30afe011c0f.slice/crio-bd874fcec5263b9c230074a61bc4adf4db33a0382832d3247cbf8726bd49b274 WatchSource:0}: Error finding container bd874fcec5263b9c230074a61bc4adf4db33a0382832d3247cbf8726bd49b274: Status 404 returned error can't find the container with id bd874fcec5263b9c230074a61bc4adf4db33a0382832d3247cbf8726bd49b274
Sep 10 23:14:35.687825 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:35.687786    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6" event={"ID":"13f92aa3-2486-408a-8a3d-b30afe011c0f","Type":"ContainerStarted","Data":"bd874fcec5263b9c230074a61bc4adf4db33a0382832d3247cbf8726bd49b274"}
Sep 10 23:14:38.709264 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:38.709173    2585 generic.go:356] "Generic (PLEG): container finished" podID="13f92aa3-2486-408a-8a3d-b30afe011c0f" containerID="f69d55e68e486e2ee0d402a68febf9febd4ab7cf0754bc0f897b5eb9fffa1cb7" exitCode=0
Sep 10 23:14:38.709264 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:38.709231    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6" event={"ID":"13f92aa3-2486-408a-8a3d-b30afe011c0f","Type":"ContainerDied","Data":"f69d55e68e486e2ee0d402a68febf9febd4ab7cf0754bc0f897b5eb9fffa1cb7"}
Sep 10 23:14:39.854164 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:39.854140    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6"
Sep 10 23:14:39.945078 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:39.945044    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13f92aa3-2486-408a-8a3d-b30afe011c0f-maas-api-service-ca\") pod \"13f92aa3-2486-408a-8a3d-b30afe011c0f\" (UID: \"13f92aa3-2486-408a-8a3d-b30afe011c0f\") "
Sep 10 23:14:39.945418 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:39.945394    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13f92aa3-2486-408a-8a3d-b30afe011c0f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "13f92aa3-2486-408a-8a3d-b30afe011c0f" (UID: "13f92aa3-2486-408a-8a3d-b30afe011c0f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:14:40.046465 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:40.046428    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13f92aa3-2486-408a-8a3d-b30afe011c0f-maas-api-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:40.722223 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:40.722131    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6"
Sep 10 23:14:40.722223 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:40.722175    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6" event={"ID":"13f92aa3-2486-408a-8a3d-b30afe011c0f","Type":"ContainerDied","Data":"bd874fcec5263b9c230074a61bc4adf4db33a0382832d3247cbf8726bd49b274"}
Sep 10 23:14:40.722511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:40.722268    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bd874fcec5263b9c230074a61bc4adf4db33a0382832d3247cbf8726bd49b274"
Sep 10 23:14:40.975285 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:40.975197    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"]
Sep 10 23:14:40.975744 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:40.975493    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr" podUID="2205d298-c033-4fbc-bae0-7d8a0bf6daba" containerName="payload-pre-processing" containerID="cri-o://ad6694c77fe582474b76b3d65e00d1724e7b4699078317bf12bfaa0554804224" gracePeriod=30
Sep 10 23:14:41.276136 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.276041    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"
Sep 10 23:14:41.287674 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.287642    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"]
Sep 10 23:14:41.287909 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.287873    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" podUID="ada9ab88-6501-467e-ac77-03b080640251" containerName="istio-proxy" containerID="cri-o://6d1a3a03c354e4f6036df6c1dac6ea35fba81c9334cdaf5b722f31773d99f80a" gracePeriod=30
Sep 10 23:14:41.357405 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.357375    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2205d298-c033-4fbc-bae0-7d8a0bf6daba-plugins-config-volume\") pod \"2205d298-c033-4fbc-bae0-7d8a0bf6daba\" (UID: \"2205d298-c033-4fbc-bae0-7d8a0bf6daba\") "
Sep 10 23:14:41.357592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.357434    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-765gv\" (UniqueName: \"kubernetes.io/projected/2205d298-c033-4fbc-bae0-7d8a0bf6daba-kube-api-access-765gv\") pod \"2205d298-c033-4fbc-bae0-7d8a0bf6daba\" (UID: \"2205d298-c033-4fbc-bae0-7d8a0bf6daba\") "
Sep 10 23:14:41.357979 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.357857    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2205d298-c033-4fbc-bae0-7d8a0bf6daba-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2205d298-c033-4fbc-bae0-7d8a0bf6daba" (UID: "2205d298-c033-4fbc-bae0-7d8a0bf6daba"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:14:41.359658 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.359626    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2205d298-c033-4fbc-bae0-7d8a0bf6daba-kube-api-access-765gv" (OuterVolumeSpecName: "kube-api-access-765gv") pod "2205d298-c033-4fbc-bae0-7d8a0bf6daba" (UID: "2205d298-c033-4fbc-bae0-7d8a0bf6daba"). InnerVolumeSpecName "kube-api-access-765gv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:14:41.459205 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.459170    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2205d298-c033-4fbc-bae0-7d8a0bf6daba-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:41.459205 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.459202    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-765gv\" (UniqueName: \"kubernetes.io/projected/2205d298-c033-4fbc-bae0-7d8a0bf6daba-kube-api-access-765gv\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:41.729007 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.728968    2585 generic.go:356] "Generic (PLEG): container finished" podID="2205d298-c033-4fbc-bae0-7d8a0bf6daba" containerID="ad6694c77fe582474b76b3d65e00d1724e7b4699078317bf12bfaa0554804224" exitCode=0
Sep 10 23:14:41.729186 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.729015    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"
Sep 10 23:14:41.729186 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.729037    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr" event={"ID":"2205d298-c033-4fbc-bae0-7d8a0bf6daba","Type":"ContainerDied","Data":"ad6694c77fe582474b76b3d65e00d1724e7b4699078317bf12bfaa0554804224"}
Sep 10 23:14:41.729186 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.729094    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr" event={"ID":"2205d298-c033-4fbc-bae0-7d8a0bf6daba","Type":"ContainerDied","Data":"7aaa6a1db59bdbf2eb71cd34283ff321256b2242970023e7ffda19dca6674ff4"}
Sep 10 23:14:41.729186 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.729125    2585 scope.go:117] "RemoveContainer" containerID="ad6694c77fe582474b76b3d65e00d1724e7b4699078317bf12bfaa0554804224"
Sep 10 23:14:41.739512 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.739489    2585 scope.go:117] "RemoveContainer" containerID="ad6694c77fe582474b76b3d65e00d1724e7b4699078317bf12bfaa0554804224"
Sep 10 23:14:41.739902 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:14:41.739882    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad6694c77fe582474b76b3d65e00d1724e7b4699078317bf12bfaa0554804224\": container with ID starting with ad6694c77fe582474b76b3d65e00d1724e7b4699078317bf12bfaa0554804224 not found: ID does not exist" containerID="ad6694c77fe582474b76b3d65e00d1724e7b4699078317bf12bfaa0554804224"
Sep 10 23:14:41.739990 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.739911    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad6694c77fe582474b76b3d65e00d1724e7b4699078317bf12bfaa0554804224"} err="failed to get container status \"ad6694c77fe582474b76b3d65e00d1724e7b4699078317bf12bfaa0554804224\": rpc error: code = NotFound desc = could not find container \"ad6694c77fe582474b76b3d65e00d1724e7b4699078317bf12bfaa0554804224\": container with ID starting with ad6694c77fe582474b76b3d65e00d1724e7b4699078317bf12bfaa0554804224 not found: ID does not exist"
Sep 10 23:14:41.753023 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.752996    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"]
Sep 10 23:14:41.757150 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:41.757128    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-e5ec8ad4-667576d5cd-jj5xr"]
Sep 10 23:14:42.342186 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:42.342152    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2205d298-c033-4fbc-bae0-7d8a0bf6daba" path="/var/lib/kubelet/pods/2205d298-c033-4fbc-bae0-7d8a0bf6daba/volumes"
Sep 10 23:14:45.267630 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.267593    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"]
Sep 10 23:14:45.268414 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.268371    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx" podUID="81423e3d-7662-402d-85de-d2b757202c30" containerName="payload-pre-processing" containerID="cri-o://071d5c349f129487e77b9ab9e3b929d9c93658451a9ddb38ebbfb0dc6f9d83cb" gracePeriod=30
Sep 10 23:14:45.456463 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.456425    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6"]
Sep 10 23:14:45.460467 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.460439    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-3a438f-w6ld6"]
Sep 10 23:14:45.545758 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.545456    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"
Sep 10 23:14:45.602310 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.602280    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81423e3d-7662-402d-85de-d2b757202c30-plugins-config-volume\") pod \"81423e3d-7662-402d-85de-d2b757202c30\" (UID: \"81423e3d-7662-402d-85de-d2b757202c30\") "
Sep 10 23:14:45.602467 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.602355    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69q47\" (UniqueName: \"kubernetes.io/projected/81423e3d-7662-402d-85de-d2b757202c30-kube-api-access-69q47\") pod \"81423e3d-7662-402d-85de-d2b757202c30\" (UID: \"81423e3d-7662-402d-85de-d2b757202c30\") "
Sep 10 23:14:45.602762 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.602727    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81423e3d-7662-402d-85de-d2b757202c30-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "81423e3d-7662-402d-85de-d2b757202c30" (UID: "81423e3d-7662-402d-85de-d2b757202c30"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:14:45.604447 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.604426    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81423e3d-7662-402d-85de-d2b757202c30-kube-api-access-69q47" (OuterVolumeSpecName: "kube-api-access-69q47") pod "81423e3d-7662-402d-85de-d2b757202c30" (UID: "81423e3d-7662-402d-85de-d2b757202c30"). InnerVolumeSpecName "kube-api-access-69q47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:14:45.703842 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.703804    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69q47\" (UniqueName: \"kubernetes.io/projected/81423e3d-7662-402d-85de-d2b757202c30-kube-api-access-69q47\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:45.703842 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.703836    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81423e3d-7662-402d-85de-d2b757202c30-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:45.755410 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.755373    2585 generic.go:356] "Generic (PLEG): container finished" podID="81423e3d-7662-402d-85de-d2b757202c30" containerID="071d5c349f129487e77b9ab9e3b929d9c93658451a9ddb38ebbfb0dc6f9d83cb" exitCode=0
Sep 10 23:14:45.755592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.755431    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"
Sep 10 23:14:45.755592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.755429    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx" event={"ID":"81423e3d-7662-402d-85de-d2b757202c30","Type":"ContainerDied","Data":"071d5c349f129487e77b9ab9e3b929d9c93658451a9ddb38ebbfb0dc6f9d83cb"}
Sep 10 23:14:45.755592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.755497    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx" event={"ID":"81423e3d-7662-402d-85de-d2b757202c30","Type":"ContainerDied","Data":"bd38ad73cd238259968533b453c6dc2cae10ec44f7d37dcfe33b6be1b9079474"}
Sep 10 23:14:45.755592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.755528    2585 scope.go:117] "RemoveContainer" containerID="071d5c349f129487e77b9ab9e3b929d9c93658451a9ddb38ebbfb0dc6f9d83cb"
Sep 10 23:14:45.765418 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.765400    2585 scope.go:117] "RemoveContainer" containerID="071d5c349f129487e77b9ab9e3b929d9c93658451a9ddb38ebbfb0dc6f9d83cb"
Sep 10 23:14:45.765719 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:14:45.765697    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"071d5c349f129487e77b9ab9e3b929d9c93658451a9ddb38ebbfb0dc6f9d83cb\": container with ID starting with 071d5c349f129487e77b9ab9e3b929d9c93658451a9ddb38ebbfb0dc6f9d83cb not found: ID does not exist" containerID="071d5c349f129487e77b9ab9e3b929d9c93658451a9ddb38ebbfb0dc6f9d83cb"
Sep 10 23:14:45.765800 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.765726    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"071d5c349f129487e77b9ab9e3b929d9c93658451a9ddb38ebbfb0dc6f9d83cb"} err="failed to get container status \"071d5c349f129487e77b9ab9e3b929d9c93658451a9ddb38ebbfb0dc6f9d83cb\": rpc error: code = NotFound desc = could not find container \"071d5c349f129487e77b9ab9e3b929d9c93658451a9ddb38ebbfb0dc6f9d83cb\": container with ID starting with 071d5c349f129487e77b9ab9e3b929d9c93658451a9ddb38ebbfb0dc6f9d83cb not found: ID does not exist"
Sep 10 23:14:45.782351 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.782325    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"]
Sep 10 23:14:45.787115 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:45.787094    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-3a438f-64cd976f66-lfbnx"]
Sep 10 23:14:46.346439 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.346405    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13f92aa3-2486-408a-8a3d-b30afe011c0f" path="/var/lib/kubelet/pods/13f92aa3-2486-408a-8a3d-b30afe011c0f/volumes"
Sep 10 23:14:46.346892 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.346796    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81423e3d-7662-402d-85de-d2b757202c30" path="/var/lib/kubelet/pods/81423e3d-7662-402d-85de-d2b757202c30/volumes"
Sep 10 23:14:46.544634 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.544608    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:46.611399 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.611315    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-istio-data\") pod \"ada9ab88-6501-467e-ac77-03b080640251\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") "
Sep 10 23:14:46.611399 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.611379    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-workload-certs\") pod \"ada9ab88-6501-467e-ac77-03b080640251\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") "
Sep 10 23:14:46.611641 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.611404    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pv79\" (UniqueName: \"kubernetes.io/projected/ada9ab88-6501-467e-ac77-03b080640251-kube-api-access-9pv79\") pod \"ada9ab88-6501-467e-ac77-03b080640251\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") "
Sep 10 23:14:46.611641 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.611433    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ada9ab88-6501-467e-ac77-03b080640251-istio-token\") pod \"ada9ab88-6501-467e-ac77-03b080640251\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") "
Sep 10 23:14:46.611641 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.611452    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-workload-socket\") pod \"ada9ab88-6501-467e-ac77-03b080640251\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") "
Sep 10 23:14:46.611641 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.611495    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-istio-envoy\") pod \"ada9ab88-6501-467e-ac77-03b080640251\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") "
Sep 10 23:14:46.611641 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.611530    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-credential-socket\") pod \"ada9ab88-6501-467e-ac77-03b080640251\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") "
Sep 10 23:14:46.611641 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.611614    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-istio-data" (OuterVolumeSpecName: "istio-data") pod "ada9ab88-6501-467e-ac77-03b080640251" (UID: "ada9ab88-6501-467e-ac77-03b080640251"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:14:46.611934 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.611672    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ada9ab88-6501-467e-ac77-03b080640251-istio-podinfo\") pod \"ada9ab88-6501-467e-ac77-03b080640251\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") "
Sep 10 23:14:46.611934 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.611729    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ada9ab88-6501-467e-ac77-03b080640251-istiod-ca-cert\") pod \"ada9ab88-6501-467e-ac77-03b080640251\" (UID: \"ada9ab88-6501-467e-ac77-03b080640251\") "
Sep 10 23:14:46.611934 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.611671    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ada9ab88-6501-467e-ac77-03b080640251" (UID: "ada9ab88-6501-467e-ac77-03b080640251"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:14:46.611934 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.611871    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ada9ab88-6501-467e-ac77-03b080640251" (UID: "ada9ab88-6501-467e-ac77-03b080640251"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:14:46.612108 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.611960    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ada9ab88-6501-467e-ac77-03b080640251" (UID: "ada9ab88-6501-467e-ac77-03b080640251"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:14:46.612108 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.612057    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ada9ab88-6501-467e-ac77-03b080640251-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ada9ab88-6501-467e-ac77-03b080640251" (UID: "ada9ab88-6501-467e-ac77-03b080640251"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:14:46.612180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.612132    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ada9ab88-6501-467e-ac77-03b080640251-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:46.612180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.612150    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:46.612180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.612164    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:46.612180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.612176    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:46.612326 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.612189    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:46.613798 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.613764    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ada9ab88-6501-467e-ac77-03b080640251-istio-token" (OuterVolumeSpecName: "istio-token") pod "ada9ab88-6501-467e-ac77-03b080640251" (UID: "ada9ab88-6501-467e-ac77-03b080640251"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:14:46.613930 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.613862    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ada9ab88-6501-467e-ac77-03b080640251-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ada9ab88-6501-467e-ac77-03b080640251" (UID: "ada9ab88-6501-467e-ac77-03b080640251"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:14:46.614181 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.614156    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ada9ab88-6501-467e-ac77-03b080640251" (UID: "ada9ab88-6501-467e-ac77-03b080640251"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:14:46.614181 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.614162    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ada9ab88-6501-467e-ac77-03b080640251-kube-api-access-9pv79" (OuterVolumeSpecName: "kube-api-access-9pv79") pod "ada9ab88-6501-467e-ac77-03b080640251" (UID: "ada9ab88-6501-467e-ac77-03b080640251"). InnerVolumeSpecName "kube-api-access-9pv79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:14:46.713633 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.713585    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pv79\" (UniqueName: \"kubernetes.io/projected/ada9ab88-6501-467e-ac77-03b080640251-kube-api-access-9pv79\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:46.713633 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.713628    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ada9ab88-6501-467e-ac77-03b080640251-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:46.713633 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.713637    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ada9ab88-6501-467e-ac77-03b080640251-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:46.713633 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.713645    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ada9ab88-6501-467e-ac77-03b080640251-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:14:46.763931 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.763886    2585 generic.go:356] "Generic (PLEG): container finished" podID="ada9ab88-6501-467e-ac77-03b080640251" containerID="6d1a3a03c354e4f6036df6c1dac6ea35fba81c9334cdaf5b722f31773d99f80a" exitCode=0
Sep 10 23:14:46.764089 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.763947    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"
Sep 10 23:14:46.764089 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.763974    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" event={"ID":"ada9ab88-6501-467e-ac77-03b080640251","Type":"ContainerDied","Data":"6d1a3a03c354e4f6036df6c1dac6ea35fba81c9334cdaf5b722f31773d99f80a"}
Sep 10 23:14:46.764089 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.764033    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh" event={"ID":"ada9ab88-6501-467e-ac77-03b080640251","Type":"ContainerDied","Data":"6eeb4281a76eaeab15bf932943016caf13549452a199da204fab6a98470008c6"}
Sep 10 23:14:46.764089 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.764056    2585 scope.go:117] "RemoveContainer" containerID="6d1a3a03c354e4f6036df6c1dac6ea35fba81c9334cdaf5b722f31773d99f80a"
Sep 10 23:14:46.773763 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.773745    2585 scope.go:117] "RemoveContainer" containerID="7ee417ab76a080116c373af08b59e61ee265c078b5884e802a884fd41e9fba6a"
Sep 10 23:14:46.782176 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.782155    2585 scope.go:117] "RemoveContainer" containerID="6d1a3a03c354e4f6036df6c1dac6ea35fba81c9334cdaf5b722f31773d99f80a"
Sep 10 23:14:46.782441 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:14:46.782422    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d1a3a03c354e4f6036df6c1dac6ea35fba81c9334cdaf5b722f31773d99f80a\": container with ID starting with 6d1a3a03c354e4f6036df6c1dac6ea35fba81c9334cdaf5b722f31773d99f80a not found: ID does not exist" containerID="6d1a3a03c354e4f6036df6c1dac6ea35fba81c9334cdaf5b722f31773d99f80a"
Sep 10 23:14:46.782511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.782453    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d1a3a03c354e4f6036df6c1dac6ea35fba81c9334cdaf5b722f31773d99f80a"} err="failed to get container status \"6d1a3a03c354e4f6036df6c1dac6ea35fba81c9334cdaf5b722f31773d99f80a\": rpc error: code = NotFound desc = could not find container \"6d1a3a03c354e4f6036df6c1dac6ea35fba81c9334cdaf5b722f31773d99f80a\": container with ID starting with 6d1a3a03c354e4f6036df6c1dac6ea35fba81c9334cdaf5b722f31773d99f80a not found: ID does not exist"
Sep 10 23:14:46.782511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.782477    2585 scope.go:117] "RemoveContainer" containerID="7ee417ab76a080116c373af08b59e61ee265c078b5884e802a884fd41e9fba6a"
Sep 10 23:14:46.782777 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:14:46.782759    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ee417ab76a080116c373af08b59e61ee265c078b5884e802a884fd41e9fba6a\": container with ID starting with 7ee417ab76a080116c373af08b59e61ee265c078b5884e802a884fd41e9fba6a not found: ID does not exist" containerID="7ee417ab76a080116c373af08b59e61ee265c078b5884e802a884fd41e9fba6a"
Sep 10 23:14:46.782822 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.782784    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ee417ab76a080116c373af08b59e61ee265c078b5884e802a884fd41e9fba6a"} err="failed to get container status \"7ee417ab76a080116c373af08b59e61ee265c078b5884e802a884fd41e9fba6a\": rpc error: code = NotFound desc = could not find container \"7ee417ab76a080116c373af08b59e61ee265c078b5884e802a884fd41e9fba6a\": container with ID starting with 7ee417ab76a080116c373af08b59e61ee265c078b5884e802a884fd41e9fba6a not found: ID does not exist"
Sep 10 23:14:46.788360 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.788336    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"]
Sep 10 23:14:46.793163 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:46.793141    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-e5ec8ad4-openshift-default-69cffbc6b8-v6qkh"]
Sep 10 23:14:48.341680 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:14:48.341647    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ada9ab88-6501-467e-ac77-03b080640251" path="/var/lib/kubelet/pods/ada9ab88-6501-467e-ac77-03b080640251/volumes"
Sep 10 23:15:00.145332 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.145289    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95"]
Sep 10 23:15:00.145917 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.145896    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2205d298-c033-4fbc-bae0-7d8a0bf6daba" containerName="payload-pre-processing"
Sep 10 23:15:00.146005 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.145920    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2205d298-c033-4fbc-bae0-7d8a0bf6daba" containerName="payload-pre-processing"
Sep 10 23:15:00.146005 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.145939    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13f92aa3-2486-408a-8a3d-b30afe011c0f" containerName="revoke-keys"
Sep 10 23:15:00.146005 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.145948    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="13f92aa3-2486-408a-8a3d-b30afe011c0f" containerName="revoke-keys"
Sep 10 23:15:00.146005 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.145975    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada9ab88-6501-467e-ac77-03b080640251" containerName="istio-proxy"
Sep 10 23:15:00.146005 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.145985    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada9ab88-6501-467e-ac77-03b080640251" containerName="istio-proxy"
Sep 10 23:15:00.146005 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.146002    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81423e3d-7662-402d-85de-d2b757202c30" containerName="payload-pre-processing"
Sep 10 23:15:00.146301 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.146010    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="81423e3d-7662-402d-85de-d2b757202c30" containerName="payload-pre-processing"
Sep 10 23:15:00.146301 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.146139    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada9ab88-6501-467e-ac77-03b080640251" containerName="istio-proxy"
Sep 10 23:15:00.146301 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.146154    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="13f92aa3-2486-408a-8a3d-b30afe011c0f" containerName="revoke-keys"
Sep 10 23:15:00.146301 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.146165    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="81423e3d-7662-402d-85de-d2b757202c30" containerName="payload-pre-processing"
Sep 10 23:15:00.146301 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.146178    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2205d298-c033-4fbc-bae0-7d8a0bf6daba" containerName="payload-pre-processing"
Sep 10 23:15:00.149602 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.149554    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95"
Sep 10 23:15:00.150833 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.150807    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818035-djws8"]
Sep 10 23:15:00.151354 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.151334    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada9ab88-6501-467e-ac77-03b080640251" containerName="istio-proxy"
Sep 10 23:15:00.151409 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.151360    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada9ab88-6501-467e-ac77-03b080640251" containerName="istio-proxy"
Sep 10 23:15:00.151472 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.151459    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada9ab88-6501-467e-ac77-03b080640251" containerName="istio-proxy"
Sep 10 23:15:00.151908 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.151890    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:15:00.155054 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.155034    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818035-djws8"
Sep 10 23:15:00.157132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.157105    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95"]
Sep 10 23:15:00.165208 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.165174    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818035-djws8"]
Sep 10 23:15:00.168241 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.168221    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95"
Sep 10 23:15:00.174025 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.174005    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818035-djws8"
Sep 10 23:15:00.455043 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.455020    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95"]
Sep 10 23:15:00.456083 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:15:00.456057    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcdebbda_3447_4e33_9bf0_5bceb846b972.slice/crio-6b79e0490f295490f9b079cea7ea5bbd3330a1b2a3ad5930ead90c80f85f158a WatchSource:0}: Error finding container 6b79e0490f295490f9b079cea7ea5bbd3330a1b2a3ad5930ead90c80f85f158a: Status 404 returned error can't find the container with id 6b79e0490f295490f9b079cea7ea5bbd3330a1b2a3ad5930ead90c80f85f158a
Sep 10 23:15:00.467138 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.467118    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818035-djws8"]
Sep 10 23:15:00.470283 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:15:00.470250    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38eff99_82e9_460f_ab21_e75623b52921.slice/crio-1a63062567638a4b4ca10d49f253155c09125e78b920ef4eb633efd30d422d07 WatchSource:0}: Error finding container 1a63062567638a4b4ca10d49f253155c09125e78b920ef4eb633efd30d422d07: Status 404 returned error can't find the container with id 1a63062567638a4b4ca10d49f253155c09125e78b920ef4eb633efd30d422d07
Sep 10 23:15:00.851956 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.851907    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95" event={"ID":"fcdebbda-3447-4e33-9bf0-5bceb846b972","Type":"ContainerStarted","Data":"49e38f3b9ce093e57b38210a4a34c6bed9a38d2367f4103b57ae6c2699eb5e60"}
Sep 10 23:15:00.852116 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.852013    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95" event={"ID":"fcdebbda-3447-4e33-9bf0-5bceb846b972","Type":"ContainerStarted","Data":"6b79e0490f295490f9b079cea7ea5bbd3330a1b2a3ad5930ead90c80f85f158a"}
Sep 10 23:15:00.853503 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.853476    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818035-djws8" event={"ID":"b38eff99-82e9-460f-ab21-e75623b52921","Type":"ContainerStarted","Data":"82ddf831962794c3b0e89210aa1836cb47860aa2edf22c28318c894d32bfb527"}
Sep 10 23:15:00.853633 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.853523    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818035-djws8" event={"ID":"b38eff99-82e9-460f-ab21-e75623b52921","Type":"ContainerStarted","Data":"1a63062567638a4b4ca10d49f253155c09125e78b920ef4eb633efd30d422d07"}
Sep 10 23:15:00.876845 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.876791    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95" podStartSLOduration=0.876776634 podStartE2EDuration="876.776634ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:15:00.875112665 +0000 UTC m=+1013.053983638" watchObservedRunningTime="2026-09-10 23:15:00.876776634 +0000 UTC m=+1013.055647597"
Sep 10 23:15:00.899039 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:00.898990    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818035-djws8" podStartSLOduration=0.898976676 podStartE2EDuration="898.976676ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:15:00.897449168 +0000 UTC m=+1013.076320133" watchObservedRunningTime="2026-09-10 23:15:00.898976676 +0000 UTC m=+1013.077847638"
Sep 10 23:15:01.860882 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:01.860849    2585 generic.go:356] "Generic (PLEG): container finished" podID="fcdebbda-3447-4e33-9bf0-5bceb846b972" containerID="49e38f3b9ce093e57b38210a4a34c6bed9a38d2367f4103b57ae6c2699eb5e60" exitCode=0
Sep 10 23:15:01.861276 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:01.860928    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95" event={"ID":"fcdebbda-3447-4e33-9bf0-5bceb846b972","Type":"ContainerDied","Data":"49e38f3b9ce093e57b38210a4a34c6bed9a38d2367f4103b57ae6c2699eb5e60"}
Sep 10 23:15:01.862605 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:01.862585    2585 generic.go:356] "Generic (PLEG): container finished" podID="b38eff99-82e9-460f-ab21-e75623b52921" containerID="82ddf831962794c3b0e89210aa1836cb47860aa2edf22c28318c894d32bfb527" exitCode=0
Sep 10 23:15:01.862726 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:01.862669    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818035-djws8" event={"ID":"b38eff99-82e9-460f-ab21-e75623b52921","Type":"ContainerDied","Data":"82ddf831962794c3b0e89210aa1836cb47860aa2edf22c28318c894d32bfb527"}
Sep 10 23:15:03.030784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:03.030762    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818035-djws8"
Sep 10 23:15:03.034488 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:03.034471    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95"
Sep 10 23:15:03.875190 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:03.875158    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818035-djws8"
Sep 10 23:15:03.875396 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:03.875192    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818035-djws8" event={"ID":"b38eff99-82e9-460f-ab21-e75623b52921","Type":"ContainerDied","Data":"1a63062567638a4b4ca10d49f253155c09125e78b920ef4eb633efd30d422d07"}
Sep 10 23:15:03.875396 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:03.875248    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a63062567638a4b4ca10d49f253155c09125e78b920ef4eb633efd30d422d07"
Sep 10 23:15:03.876631 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:03.876597    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95" event={"ID":"fcdebbda-3447-4e33-9bf0-5bceb846b972","Type":"ContainerDied","Data":"6b79e0490f295490f9b079cea7ea5bbd3330a1b2a3ad5930ead90c80f85f158a"}
Sep 10 23:15:03.876751 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:03.876649    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b79e0490f295490f9b079cea7ea5bbd3330a1b2a3ad5930ead90c80f85f158a"
Sep 10 23:15:03.876751 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:03.876613    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95"
Sep 10 23:15:28.141874 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.141830    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"]
Sep 10 23:15:28.142465 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.142092    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy" containerID="cri-o://9db8751ceda4d8d226659a3e2248857bea5a4d1a7dc15bd823ee2e493bf69f93" gracePeriod=30
Sep 10 23:15:28.854350 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.854305    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"]
Sep 10 23:15:28.854748 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.854729    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcdebbda-3447-4e33-9bf0-5bceb846b972" containerName="cleanup"
Sep 10 23:15:28.854748 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.854748    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcdebbda-3447-4e33-9bf0-5bceb846b972" containerName="cleanup"
Sep 10 23:15:28.854922 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.854767    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b38eff99-82e9-460f-ab21-e75623b52921" containerName="cleanup"
Sep 10 23:15:28.854922 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.854772    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b38eff99-82e9-460f-ab21-e75623b52921" containerName="cleanup"
Sep 10 23:15:28.854922 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.854865    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b38eff99-82e9-460f-ab21-e75623b52921" containerName="cleanup"
Sep 10 23:15:28.854922 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.854875    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcdebbda-3447-4e33-9bf0-5bceb846b972" containerName="cleanup"
Sep 10 23:15:28.861791 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.861766    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:28.864306 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.864285    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-8972e2-openshift-default-dockercfg-nz266\""
Sep 10 23:15:28.872911 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.872888    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"]
Sep 10 23:15:28.913173 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.913134    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-data\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:28.913362 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.913187    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-podinfo\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:28.913362 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.913237    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istiod-ca-cert\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:28.913362 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.913270    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-workload-socket\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:28.913362 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.913340    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-workload-certs\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:28.913686 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.913374    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-token\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:28.913686 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.913447    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-credential-socket\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:28.913686 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.913473    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrrg6\" (UniqueName: \"kubernetes.io/projected/ac12ccaa-b46e-4792-a443-8d495fb1ead5-kube-api-access-xrrg6\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:28.913686 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:28.913503    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-envoy\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.014833 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.014794    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-workload-certs\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.015188 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.015159    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-token\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.015616 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.015590    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-workload-certs\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.015778 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.015714    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-credential-socket\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.015923 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.015905    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-credential-socket\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.016065 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.016049    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrrg6\" (UniqueName: \"kubernetes.io/projected/ac12ccaa-b46e-4792-a443-8d495fb1ead5-kube-api-access-xrrg6\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.016185 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.016172    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-envoy\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.016709 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.016688    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-data\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.016821 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.016752    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-podinfo\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.017086 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.017062    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-data\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.017317 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.017297    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istiod-ca-cert\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.017498 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.017482    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-workload-socket\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.018016 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.017989    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istiod-ca-cert\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.018175 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.017894    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-workload-socket\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.021884 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.021856    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-podinfo\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.028579 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.024823    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-envoy\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.028579 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.026901    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrrg6\" (UniqueName: \"kubernetes.io/projected/ac12ccaa-b46e-4792-a443-8d495fb1ead5-kube-api-access-xrrg6\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.028579 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.027403    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-token\") pod \"e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") " pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.174064 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.173973    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:29.477420 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.477326    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"]
Sep 10 23:15:29.480391 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:15:29.480366    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac12ccaa_b46e_4792_a443_8d495fb1ead5.slice/crio-c7279d31752bd2ac80f7f3153ade8ae503fe4815edf986e27b20efcb01ddb895 WatchSource:0}: Error finding container c7279d31752bd2ac80f7f3153ade8ae503fe4815edf986e27b20efcb01ddb895: Status 404 returned error can't find the container with id c7279d31752bd2ac80f7f3153ade8ae503fe4815edf986e27b20efcb01ddb895
Sep 10 23:15:29.482751 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.482715    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:15:29.482854 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.482796    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:15:29.482854 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:29.482827    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:15:30.039051 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:30.039017    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg" event={"ID":"ac12ccaa-b46e-4792-a443-8d495fb1ead5","Type":"ContainerStarted","Data":"c65e3583d76c77b03ff2f4bb990702ba02c8156ba64ac3b730b6719b5f061fb0"}
Sep 10 23:15:30.039219 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:30.039072    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg" event={"ID":"ac12ccaa-b46e-4792-a443-8d495fb1ead5","Type":"ContainerStarted","Data":"c7279d31752bd2ac80f7f3153ade8ae503fe4815edf986e27b20efcb01ddb895"}
Sep 10 23:15:30.064858 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:30.064804    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg" podStartSLOduration=2.064786867 podStartE2EDuration="2.064786867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:15:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:15:30.062691011 +0000 UTC m=+1042.241561975" watchObservedRunningTime="2026-09-10 23:15:30.064786867 +0000 UTC m=+1042.243657881"
Sep 10 23:15:30.174907 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:30.174876    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:30.185494 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:30.185462    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:30.390812 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:30.390766    2585 patch_prober.go:28] interesting pod/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 23:15:30.390987 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:30.390831    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 23:15:31.045413 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:31.045373    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:31.046445 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:31.046426    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:33.408188 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.408123    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:15:33.463474 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.463445    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-envoy\") pod \"d47af31a-10c8-4c41-bc32-fb56e3447c25\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") "
Sep 10 23:15:33.463474 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.463481    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d47af31a-10c8-4c41-bc32-fb56e3447c25-istiod-ca-cert\") pod \"d47af31a-10c8-4c41-bc32-fb56e3447c25\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") "
Sep 10 23:15:33.463749 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.463514    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-token\") pod \"d47af31a-10c8-4c41-bc32-fb56e3447c25\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") "
Sep 10 23:15:33.463749 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.463544    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-credential-socket\") pod \"d47af31a-10c8-4c41-bc32-fb56e3447c25\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") "
Sep 10 23:15:33.463749 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.463662    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-workload-certs\") pod \"d47af31a-10c8-4c41-bc32-fb56e3447c25\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") "
Sep 10 23:15:33.463749 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.463698    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhs5r\" (UniqueName: \"kubernetes.io/projected/d47af31a-10c8-4c41-bc32-fb56e3447c25-kube-api-access-dhs5r\") pod \"d47af31a-10c8-4c41-bc32-fb56e3447c25\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") "
Sep 10 23:15:33.463749 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.463725    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-workload-socket\") pod \"d47af31a-10c8-4c41-bc32-fb56e3447c25\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") "
Sep 10 23:15:33.464031 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.463760    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-data\") pod \"d47af31a-10c8-4c41-bc32-fb56e3447c25\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") "
Sep 10 23:15:33.464031 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.463829    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-podinfo\") pod \"d47af31a-10c8-4c41-bc32-fb56e3447c25\" (UID: \"d47af31a-10c8-4c41-bc32-fb56e3447c25\") "
Sep 10 23:15:33.464031 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.463911    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d47af31a-10c8-4c41-bc32-fb56e3447c25" (UID: "d47af31a-10c8-4c41-bc32-fb56e3447c25"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:15:33.464031 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.463932    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d47af31a-10c8-4c41-bc32-fb56e3447c25-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d47af31a-10c8-4c41-bc32-fb56e3447c25" (UID: "d47af31a-10c8-4c41-bc32-fb56e3447c25"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:15:33.464240 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.464044    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d47af31a-10c8-4c41-bc32-fb56e3447c25" (UID: "d47af31a-10c8-4c41-bc32-fb56e3447c25"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:15:33.464240 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.464127    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d47af31a-10c8-4c41-bc32-fb56e3447c25" (UID: "d47af31a-10c8-4c41-bc32-fb56e3447c25"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:15:33.464377 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.464345    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d47af31a-10c8-4c41-bc32-fb56e3447c25-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:15:33.464377 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.464372    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:15:33.464488 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.464386    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:15:33.464488 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.464390    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-data" (OuterVolumeSpecName: "istio-data") pod "d47af31a-10c8-4c41-bc32-fb56e3447c25" (UID: "d47af31a-10c8-4c41-bc32-fb56e3447c25"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:15:33.464488 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.464398    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:15:33.466042 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.466010    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-token" (OuterVolumeSpecName: "istio-token") pod "d47af31a-10c8-4c41-bc32-fb56e3447c25" (UID: "d47af31a-10c8-4c41-bc32-fb56e3447c25"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:15:33.466431 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.466404    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d47af31a-10c8-4c41-bc32-fb56e3447c25" (UID: "d47af31a-10c8-4c41-bc32-fb56e3447c25"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:15:33.466534 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.466445    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d47af31a-10c8-4c41-bc32-fb56e3447c25" (UID: "d47af31a-10c8-4c41-bc32-fb56e3447c25"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:15:33.466719 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.466690    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d47af31a-10c8-4c41-bc32-fb56e3447c25-kube-api-access-dhs5r" (OuterVolumeSpecName: "kube-api-access-dhs5r") pod "d47af31a-10c8-4c41-bc32-fb56e3447c25" (UID: "d47af31a-10c8-4c41-bc32-fb56e3447c25"). InnerVolumeSpecName "kube-api-access-dhs5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:15:33.565653 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.565613    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhs5r\" (UniqueName: \"kubernetes.io/projected/d47af31a-10c8-4c41-bc32-fb56e3447c25-kube-api-access-dhs5r\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:15:33.565653 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.565645    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:15:33.565653 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.565658    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:15:33.565884 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.565669    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:15:33.565884 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.565683    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d47af31a-10c8-4c41-bc32-fb56e3447c25-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:15:33.799344 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.799309    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"]
Sep 10 23:15:33.799775 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.799760    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy"
Sep 10 23:15:33.799775 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.799775    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy"
Sep 10 23:15:33.799950 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.799792    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy"
Sep 10 23:15:33.799950 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.799799    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy"
Sep 10 23:15:33.799950 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.799870    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy"
Sep 10 23:15:33.799950 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.799878    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerName="istio-proxy"
Sep 10 23:15:33.803375 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.803352    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"
Sep 10 23:15:33.805786 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.805766    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-8972e2\""
Sep 10 23:15:33.805909 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.805883    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-8972e2-dockercfg-9xkrf\""
Sep 10 23:15:33.815374 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.815350    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"]
Sep 10 23:15:33.832017 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.831984    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"]
Sep 10 23:15:33.835318 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.835300    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"
Sep 10 23:15:33.843261 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.843234    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"]
Sep 10 23:15:33.868875 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.868840    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svv7j\" (UniqueName: \"kubernetes.io/projected/f9b662f8-8caf-4ec9-80d9-3da912c29a91-kube-api-access-svv7j\") pod \"payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh\" (UID: \"f9b662f8-8caf-4ec9-80d9-3da912c29a91\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"
Sep 10 23:15:33.869015 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.868880    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b662f8-8caf-4ec9-80d9-3da912c29a91-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh\" (UID: \"f9b662f8-8caf-4ec9-80d9-3da912c29a91\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"
Sep 10 23:15:33.969743 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.969707    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svv7j\" (UniqueName: \"kubernetes.io/projected/f9b662f8-8caf-4ec9-80d9-3da912c29a91-kube-api-access-svv7j\") pod \"payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh\" (UID: \"f9b662f8-8caf-4ec9-80d9-3da912c29a91\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"
Sep 10 23:15:33.969920 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.969749    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b662f8-8caf-4ec9-80d9-3da912c29a91-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh\" (UID: \"f9b662f8-8caf-4ec9-80d9-3da912c29a91\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"
Sep 10 23:15:33.969920 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.969796    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrx7q\" (UniqueName: \"kubernetes.io/projected/2ec3c2cd-c635-418b-b331-9fd62a860b04-kube-api-access-vrx7q\") pod \"payload-processing-e2e-explicit-8972e2-687979c689-7w7sb\" (UID: \"2ec3c2cd-c635-418b-b331-9fd62a860b04\") " pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"
Sep 10 23:15:33.969920 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.969864    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ec3c2cd-c635-418b-b331-9fd62a860b04-plugins-config-volume\") pod \"payload-processing-e2e-explicit-8972e2-687979c689-7w7sb\" (UID: \"2ec3c2cd-c635-418b-b331-9fd62a860b04\") " pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"
Sep 10 23:15:33.970498 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.970479    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b662f8-8caf-4ec9-80d9-3da912c29a91-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh\" (UID: \"f9b662f8-8caf-4ec9-80d9-3da912c29a91\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"
Sep 10 23:15:33.978620 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:33.978591    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svv7j\" (UniqueName: \"kubernetes.io/projected/f9b662f8-8caf-4ec9-80d9-3da912c29a91-kube-api-access-svv7j\") pod \"payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh\" (UID: \"f9b662f8-8caf-4ec9-80d9-3da912c29a91\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"
Sep 10 23:15:34.065341 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.065250    2585 generic.go:356] "Generic (PLEG): container finished" podID="d47af31a-10c8-4c41-bc32-fb56e3447c25" containerID="9db8751ceda4d8d226659a3e2248857bea5a4d1a7dc15bd823ee2e493bf69f93" exitCode=0
Sep 10 23:15:34.065341 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.065304    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"
Sep 10 23:15:34.065592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.065337    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" event={"ID":"d47af31a-10c8-4c41-bc32-fb56e3447c25","Type":"ContainerDied","Data":"9db8751ceda4d8d226659a3e2248857bea5a4d1a7dc15bd823ee2e493bf69f93"}
Sep 10 23:15:34.065592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.065393    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p" event={"ID":"d47af31a-10c8-4c41-bc32-fb56e3447c25","Type":"ContainerDied","Data":"667c12c80d0b79830f9e18c8d7c72faad6d2f79174465b0730252c81bd2f5510"}
Sep 10 23:15:34.065592 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.065418    2585 scope.go:117] "RemoveContainer" containerID="9db8751ceda4d8d226659a3e2248857bea5a4d1a7dc15bd823ee2e493bf69f93"
Sep 10 23:15:34.070495 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.070473    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrx7q\" (UniqueName: \"kubernetes.io/projected/2ec3c2cd-c635-418b-b331-9fd62a860b04-kube-api-access-vrx7q\") pod \"payload-processing-e2e-explicit-8972e2-687979c689-7w7sb\" (UID: \"2ec3c2cd-c635-418b-b331-9fd62a860b04\") " pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"
Sep 10 23:15:34.070615 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.070522    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ec3c2cd-c635-418b-b331-9fd62a860b04-plugins-config-volume\") pod \"payload-processing-e2e-explicit-8972e2-687979c689-7w7sb\" (UID: \"2ec3c2cd-c635-418b-b331-9fd62a860b04\") " pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"
Sep 10 23:15:34.071139 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.071122    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ec3c2cd-c635-418b-b331-9fd62a860b04-plugins-config-volume\") pod \"payload-processing-e2e-explicit-8972e2-687979c689-7w7sb\" (UID: \"2ec3c2cd-c635-418b-b331-9fd62a860b04\") " pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"
Sep 10 23:15:34.075246 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.075225    2585 scope.go:117] "RemoveContainer" containerID="02efee2b5aba997ae259d95b666d4591d20c886be553f2934db6dee02667f76a"
Sep 10 23:15:34.079517 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.079499    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrx7q\" (UniqueName: \"kubernetes.io/projected/2ec3c2cd-c635-418b-b331-9fd62a860b04-kube-api-access-vrx7q\") pod \"payload-processing-e2e-explicit-8972e2-687979c689-7w7sb\" (UID: \"2ec3c2cd-c635-418b-b331-9fd62a860b04\") " pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"
Sep 10 23:15:34.083761 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.083745    2585 scope.go:117] "RemoveContainer" containerID="9db8751ceda4d8d226659a3e2248857bea5a4d1a7dc15bd823ee2e493bf69f93"
Sep 10 23:15:34.084034 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:15:34.084016    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9db8751ceda4d8d226659a3e2248857bea5a4d1a7dc15bd823ee2e493bf69f93\": container with ID starting with 9db8751ceda4d8d226659a3e2248857bea5a4d1a7dc15bd823ee2e493bf69f93 not found: ID does not exist" containerID="9db8751ceda4d8d226659a3e2248857bea5a4d1a7dc15bd823ee2e493bf69f93"
Sep 10 23:15:34.084097 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.084041    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9db8751ceda4d8d226659a3e2248857bea5a4d1a7dc15bd823ee2e493bf69f93"} err="failed to get container status \"9db8751ceda4d8d226659a3e2248857bea5a4d1a7dc15bd823ee2e493bf69f93\": rpc error: code = NotFound desc = could not find container \"9db8751ceda4d8d226659a3e2248857bea5a4d1a7dc15bd823ee2e493bf69f93\": container with ID starting with 9db8751ceda4d8d226659a3e2248857bea5a4d1a7dc15bd823ee2e493bf69f93 not found: ID does not exist"
Sep 10 23:15:34.084097 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.084060    2585 scope.go:117] "RemoveContainer" containerID="02efee2b5aba997ae259d95b666d4591d20c886be553f2934db6dee02667f76a"
Sep 10 23:15:34.084317 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:15:34.084302    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02efee2b5aba997ae259d95b666d4591d20c886be553f2934db6dee02667f76a\": container with ID starting with 02efee2b5aba997ae259d95b666d4591d20c886be553f2934db6dee02667f76a not found: ID does not exist" containerID="02efee2b5aba997ae259d95b666d4591d20c886be553f2934db6dee02667f76a"
Sep 10 23:15:34.084354 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.084321    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02efee2b5aba997ae259d95b666d4591d20c886be553f2934db6dee02667f76a"} err="failed to get container status \"02efee2b5aba997ae259d95b666d4591d20c886be553f2934db6dee02667f76a\": rpc error: code = NotFound desc = could not find container \"02efee2b5aba997ae259d95b666d4591d20c886be553f2934db6dee02667f76a\": container with ID starting with 02efee2b5aba997ae259d95b666d4591d20c886be553f2934db6dee02667f76a not found: ID does not exist"
Sep 10 23:15:34.090091 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.090063    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"]
Sep 10 23:15:34.094005 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.093981    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-3a438f-openshift-default-7bc5cb9f7b-vcl6p"]
Sep 10 23:15:34.116149 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.116125    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"
Sep 10 23:15:34.147324 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.147294    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"
Sep 10 23:15:34.342747 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.342669    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d47af31a-10c8-4c41-bc32-fb56e3447c25" path="/var/lib/kubelet/pods/d47af31a-10c8-4c41-bc32-fb56e3447c25/volumes"
Sep 10 23:15:34.399210 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.399081    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"]
Sep 10 23:15:34.438002 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:34.437974    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"]
Sep 10 23:15:34.439723 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:15:34.439700    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec3c2cd_c635_418b_b331_9fd62a860b04.slice/crio-4259328498d9e7dc2a16705f2d30033493fe8d618ea8bf697331f49fbb29d708 WatchSource:0}: Error finding container 4259328498d9e7dc2a16705f2d30033493fe8d618ea8bf697331f49fbb29d708: Status 404 returned error can't find the container with id 4259328498d9e7dc2a16705f2d30033493fe8d618ea8bf697331f49fbb29d708
Sep 10 23:15:35.077540 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:35.077489    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb" event={"ID":"2ec3c2cd-c635-418b-b331-9fd62a860b04","Type":"ContainerStarted","Data":"206de02967aabd8676461ff64f83ac4411bc1d019d3c5aac9965f1ce8ad870dd"}
Sep 10 23:15:35.077774 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:35.077570    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"
Sep 10 23:15:35.077774 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:35.077598    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb" event={"ID":"2ec3c2cd-c635-418b-b331-9fd62a860b04","Type":"ContainerStarted","Data":"4259328498d9e7dc2a16705f2d30033493fe8d618ea8bf697331f49fbb29d708"}
Sep 10 23:15:35.079077 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:35.079055    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh" event={"ID":"f9b662f8-8caf-4ec9-80d9-3da912c29a91","Type":"ContainerStarted","Data":"8729c571f7462613bb9dcf69a1fad64ee3915ba5159bcaa6a33e48ed3470cf5f"}
Sep 10 23:15:35.079191 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:35.079091    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh" event={"ID":"f9b662f8-8caf-4ec9-80d9-3da912c29a91","Type":"ContainerStarted","Data":"fd9a92b943a392f15d51b3c59344d8ae220f76fa9207560c51c00fc84eb1e65e"}
Sep 10 23:15:35.079191 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:35.079131    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"
Sep 10 23:15:35.099634 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:35.099590    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb" podStartSLOduration=2.099556293 podStartE2EDuration="2.099556293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:15:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:15:35.096702095 +0000 UTC m=+1047.275573082" watchObservedRunningTime="2026-09-10 23:15:35.099556293 +0000 UTC m=+1047.278427255"
Sep 10 23:15:35.122209 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:35.118035    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh" podStartSLOduration=2.118004142 podStartE2EDuration="2.118004142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:15:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:15:35.112976739 +0000 UTC m=+1047.291847701" watchObservedRunningTime="2026-09-10 23:15:35.118004142 +0000 UTC m=+1047.296875110"
Sep 10 23:15:46.088118 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:46.088085    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"
Sep 10 23:15:46.088551 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:46.088245    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"
Sep 10 23:15:51.188790 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:51.188751    2585 generic.go:356] "Generic (PLEG): container finished" podID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerID="c65e3583d76c77b03ff2f4bb990702ba02c8156ba64ac3b730b6719b5f061fb0" exitCode=0
Sep 10 23:15:51.189498 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:51.188826    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg" event={"ID":"ac12ccaa-b46e-4792-a443-8d495fb1ead5","Type":"ContainerDied","Data":"c65e3583d76c77b03ff2f4bb990702ba02c8156ba64ac3b730b6719b5f061fb0"}
Sep 10 23:15:51.189498 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:51.189219    2585 scope.go:117] "RemoveContainer" containerID="c65e3583d76c77b03ff2f4bb990702ba02c8156ba64ac3b730b6719b5f061fb0"
Sep 10 23:15:51.190309 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:51.190271    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:15:51.190407 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:51.190358    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:15:51.190407 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:51.190392    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:15:52.211974 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:52.210230    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg" event={"ID":"ac12ccaa-b46e-4792-a443-8d495fb1ead5","Type":"ContainerStarted","Data":"d3f015a1edc8d8a14cb668084d70a12d3e9f3b37a0fe0a485fbca672aa741e62"}
Sep 10 23:15:53.174788 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:53.174753    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:53.175075 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:53.175052    2585 patch_prober.go:28] interesting pod/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 23:15:53.175139 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:53.175105    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg" podUID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 23:15:54.174649 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:54.174613    2585 patch_prober.go:28] interesting pod/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 23:15:54.175055 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:54.174668    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg" podUID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 23:15:55.174578 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:55.174532    2585 patch_prober.go:28] interesting pod/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 23:15:55.174799 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:55.174632    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg" podUID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 23:15:56.174940 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:56.174900    2585 patch_prober.go:28] interesting pod/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 23:15:56.175340 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:56.174958    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg" podUID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 23:15:57.174511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:57.174465    2585 patch_prober.go:28] interesting pod/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 10 23:15:57.174725 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:57.174546    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg" podUID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 10 23:15:58.179125 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:58.179090    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:58.179624 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:58.179494    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:15:58.180163 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:15:58.180142    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:16:18.548829 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:18.548794    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27"]
Sep 10 23:16:18.553778 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:18.553753    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27"
Sep 10 23:16:18.556365 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:18.556339    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:16:18.556480 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:18.556344    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:16:18.560822 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:18.560773    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27"]
Sep 10 23:16:18.647603 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:18.647542    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5573b11-a76e-43ca-82c4-9fdd50528873-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-8972e2-8cx27\" (UID: \"d5573b11-a76e-43ca-82c4-9fdd50528873\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27"
Sep 10 23:16:18.748542 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:18.748501    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5573b11-a76e-43ca-82c4-9fdd50528873-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-8972e2-8cx27\" (UID: \"d5573b11-a76e-43ca-82c4-9fdd50528873\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27"
Sep 10 23:16:18.749195 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:18.749173    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5573b11-a76e-43ca-82c4-9fdd50528873-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-8972e2-8cx27\" (UID: \"d5573b11-a76e-43ca-82c4-9fdd50528873\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27"
Sep 10 23:16:18.866801 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:18.866717    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27"
Sep 10 23:16:19.156950 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:19.156916    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27"]
Sep 10 23:16:19.158596 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:16:19.158547    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5573b11_a76e_43ca_82c4_9fdd50528873.slice/crio-1347a17007c35d22ca260ed47f16e469f58f4b6bf8558ba6d59381ce41c07404 WatchSource:0}: Error finding container 1347a17007c35d22ca260ed47f16e469f58f4b6bf8558ba6d59381ce41c07404: Status 404 returned error can't find the container with id 1347a17007c35d22ca260ed47f16e469f58f4b6bf8558ba6d59381ce41c07404
Sep 10 23:16:19.385219 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:19.385183    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27" event={"ID":"d5573b11-a76e-43ca-82c4-9fdd50528873","Type":"ContainerStarted","Data":"1347a17007c35d22ca260ed47f16e469f58f4b6bf8558ba6d59381ce41c07404"}
Sep 10 23:16:20.324366 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.324317    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"]
Sep 10 23:16:20.327892 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.327876    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.330287 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.330264    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1f90a11e-openshift-default-dockercfg-2gl8n\""
Sep 10 23:16:20.344502 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.344476    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"]
Sep 10 23:16:20.372947 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.372916    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-workload-socket\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.392173 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.392140    2585 generic.go:356] "Generic (PLEG): container finished" podID="d5573b11-a76e-43ca-82c4-9fdd50528873" containerID="18fde01ceeed61614f949126a9feabdc67ac8a232dea909b2b14b05b635ec51c" exitCode=0
Sep 10 23:16:20.392331 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.392224    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27" event={"ID":"d5573b11-a76e-43ca-82c4-9fdd50528873","Type":"ContainerDied","Data":"18fde01ceeed61614f949126a9feabdc67ac8a232dea909b2b14b05b635ec51c"}
Sep 10 23:16:20.473982 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.473950    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/652f16f3-8942-4366-9f07-15322b5c326e-istio-podinfo\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.473982 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.473987    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-workload-certs\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.474248 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.474017    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-istio-data\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.474248 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.474044    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-workload-socket\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.474248 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.474081    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-credential-socket\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.474248 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.474111    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mch92\" (UniqueName: \"kubernetes.io/projected/652f16f3-8942-4366-9f07-15322b5c326e-kube-api-access-mch92\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.474248 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.474160    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/652f16f3-8942-4366-9f07-15322b5c326e-istiod-ca-cert\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.474479 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.474289    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-istio-envoy\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.474479 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.474319    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/652f16f3-8942-4366-9f07-15322b5c326e-istio-token\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.474479 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.474407    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-workload-socket\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.574980 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.574882    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-istio-envoy\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.574980 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.574921    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/652f16f3-8942-4366-9f07-15322b5c326e-istio-token\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.574980 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.574960    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/652f16f3-8942-4366-9f07-15322b5c326e-istio-podinfo\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.574980 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.574980    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-workload-certs\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.575341 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.575008    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-istio-data\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.575341 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.575050    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-credential-socket\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.575341 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.575095    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mch92\" (UniqueName: \"kubernetes.io/projected/652f16f3-8942-4366-9f07-15322b5c326e-kube-api-access-mch92\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.575341 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.575115    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/652f16f3-8942-4366-9f07-15322b5c326e-istiod-ca-cert\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.575518 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.575382    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-istio-data\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.575637 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.575612    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-workload-certs\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.575718 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.575694    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-credential-socket\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.575922 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.575897    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/652f16f3-8942-4366-9f07-15322b5c326e-istiod-ca-cert\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.577376 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.577354    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-istio-envoy\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.577503 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.577481    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/652f16f3-8942-4366-9f07-15322b5c326e-istio-podinfo\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.583943 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.583907    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mch92\" (UniqueName: \"kubernetes.io/projected/652f16f3-8942-4366-9f07-15322b5c326e-kube-api-access-mch92\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.584127 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.584107    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/652f16f3-8942-4366-9f07-15322b5c326e-istio-token\") pod \"e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") " pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.640096 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.640059    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:20.923352 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.923321    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"]
Sep 10 23:16:20.924438 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:16:20.924414    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod652f16f3_8942_4366_9f07_15322b5c326e.slice/crio-7e7054050a2860bba19b3280d2ca28fb274d453ea7939c9a2166893adaab2167 WatchSource:0}: Error finding container 7e7054050a2860bba19b3280d2ca28fb274d453ea7939c9a2166893adaab2167: Status 404 returned error can't find the container with id 7e7054050a2860bba19b3280d2ca28fb274d453ea7939c9a2166893adaab2167
Sep 10 23:16:20.926772 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.926735    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:16:20.926882 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.926817    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:16:20.926882 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:20.926863    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:16:21.400714 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:21.400672    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" event={"ID":"652f16f3-8942-4366-9f07-15322b5c326e","Type":"ContainerStarted","Data":"ac697fe72d9476d5592030f20dba6c3b3d1d5680a9a1007113e2c45f334e0003"}
Sep 10 23:16:21.401175 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:21.400744    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" event={"ID":"652f16f3-8942-4366-9f07-15322b5c326e","Type":"ContainerStarted","Data":"7e7054050a2860bba19b3280d2ca28fb274d453ea7939c9a2166893adaab2167"}
Sep 10 23:16:21.429113 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:21.429053    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" podStartSLOduration=1.429035577 podStartE2EDuration="1.429035577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:16:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:16:21.426025264 +0000 UTC m=+1093.604896227" watchObservedRunningTime="2026-09-10 23:16:21.429035577 +0000 UTC m=+1093.607906539"
Sep 10 23:16:21.545340 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:21.545044    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27"
Sep 10 23:16:21.583536 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:21.583500    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5573b11-a76e-43ca-82c4-9fdd50528873-maas-api-service-ca\") pod \"d5573b11-a76e-43ca-82c4-9fdd50528873\" (UID: \"d5573b11-a76e-43ca-82c4-9fdd50528873\") "
Sep 10 23:16:21.583924 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:21.583885    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5573b11-a76e-43ca-82c4-9fdd50528873-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d5573b11-a76e-43ca-82c4-9fdd50528873" (UID: "d5573b11-a76e-43ca-82c4-9fdd50528873"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:16:21.640547 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:21.640516    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:21.645439 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:21.645413    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:21.684951 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:21.684886    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5573b11-a76e-43ca-82c4-9fdd50528873-maas-api-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:22.409277 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:22.409243    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27"
Sep 10 23:16:22.409694 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:22.409276    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27" event={"ID":"d5573b11-a76e-43ca-82c4-9fdd50528873","Type":"ContainerDied","Data":"1347a17007c35d22ca260ed47f16e469f58f4b6bf8558ba6d59381ce41c07404"}
Sep 10 23:16:22.409694 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:22.409328    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1347a17007c35d22ca260ed47f16e469f58f4b6bf8558ba6d59381ce41c07404"
Sep 10 23:16:22.409694 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:22.409643    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:22.410769 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:22.410749    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:25.277866 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.277833    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"]
Sep 10 23:16:25.278259 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.278246    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5573b11-a76e-43ca-82c4-9fdd50528873" containerName="revoke-keys"
Sep 10 23:16:25.278302 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.278260    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5573b11-a76e-43ca-82c4-9fdd50528873" containerName="revoke-keys"
Sep 10 23:16:25.278355 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.278346    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5573b11-a76e-43ca-82c4-9fdd50528873" containerName="revoke-keys"
Sep 10 23:16:25.281568 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.281543    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"
Sep 10 23:16:25.284055 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.284033    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-1f90a11e\""
Sep 10 23:16:25.284162 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.284100    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-1f90a11e-dockercfg-4qd29\""
Sep 10 23:16:25.291144 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.291116    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"]
Sep 10 23:16:25.322380 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.322328    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d4979ad-cae5-4ec0-9957-32ba30ba335f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4\" (UID: \"9d4979ad-cae5-4ec0-9957-32ba30ba335f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"
Sep 10 23:16:25.322621 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.322425    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psmg6\" (UniqueName: \"kubernetes.io/projected/9d4979ad-cae5-4ec0-9957-32ba30ba335f-kube-api-access-psmg6\") pod \"payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4\" (UID: \"9d4979ad-cae5-4ec0-9957-32ba30ba335f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"
Sep 10 23:16:25.423857 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.423830    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d4979ad-cae5-4ec0-9957-32ba30ba335f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4\" (UID: \"9d4979ad-cae5-4ec0-9957-32ba30ba335f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"
Sep 10 23:16:25.424039 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.423901    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psmg6\" (UniqueName: \"kubernetes.io/projected/9d4979ad-cae5-4ec0-9957-32ba30ba335f-kube-api-access-psmg6\") pod \"payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4\" (UID: \"9d4979ad-cae5-4ec0-9957-32ba30ba335f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"
Sep 10 23:16:25.424521 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.424503    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d4979ad-cae5-4ec0-9957-32ba30ba335f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4\" (UID: \"9d4979ad-cae5-4ec0-9957-32ba30ba335f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"
Sep 10 23:16:25.434616 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.434590    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psmg6\" (UniqueName: \"kubernetes.io/projected/9d4979ad-cae5-4ec0-9957-32ba30ba335f-kube-api-access-psmg6\") pod \"payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4\" (UID: \"9d4979ad-cae5-4ec0-9957-32ba30ba335f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"
Sep 10 23:16:25.593052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.593012    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"
Sep 10 23:16:25.900878 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:25.900847    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"]
Sep 10 23:16:25.902788 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:16:25.902759    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d4979ad_cae5_4ec0_9957_32ba30ba335f.slice/crio-cb0e2f399d57cda68209397afd624c9e165da321420f9c0eb4278458d70d2074 WatchSource:0}: Error finding container cb0e2f399d57cda68209397afd624c9e165da321420f9c0eb4278458d70d2074: Status 404 returned error can't find the container with id cb0e2f399d57cda68209397afd624c9e165da321420f9c0eb4278458d70d2074
Sep 10 23:16:26.439963 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:26.439923    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4" event={"ID":"9d4979ad-cae5-4ec0-9957-32ba30ba335f","Type":"ContainerStarted","Data":"04ef52b125bd65428ad1dbed3021767e4f685464231597e3cc2cd8b22353a97d"}
Sep 10 23:16:26.440419 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:26.439990    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4" event={"ID":"9d4979ad-cae5-4ec0-9957-32ba30ba335f","Type":"ContainerStarted","Data":"cb0e2f399d57cda68209397afd624c9e165da321420f9c0eb4278458d70d2074"}
Sep 10 23:16:26.440419 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:26.440100    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"
Sep 10 23:16:26.466285 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:26.466235    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4" podStartSLOduration=1.466219273 podStartE2EDuration="1.466219273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:16:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:16:26.464774983 +0000 UTC m=+1098.643645957" watchObservedRunningTime="2026-09-10 23:16:26.466219273 +0000 UTC m=+1098.645090235"
Sep 10 23:16:29.332025 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.331977    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"]
Sep 10 23:16:29.332506 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.332243    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb" podUID="2ec3c2cd-c635-418b-b331-9fd62a860b04" containerName="payload-processing" containerID="cri-o://206de02967aabd8676461ff64f83ac4411bc1d019d3c5aac9965f1ce8ad870dd" gracePeriod=30
Sep 10 23:16:29.336980 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.336952    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"]
Sep 10 23:16:29.337391 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.337340    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh" podUID="f9b662f8-8caf-4ec9-80d9-3da912c29a91" containerName="payload-pre-processing" containerID="cri-o://8729c571f7462613bb9dcf69a1fad64ee3915ba5159bcaa6a33e48ed3470cf5f" gracePeriod=30
Sep 10 23:16:29.467214 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.467139    2585 generic.go:356] "Generic (PLEG): container finished" podID="2ec3c2cd-c635-418b-b331-9fd62a860b04" containerID="206de02967aabd8676461ff64f83ac4411bc1d019d3c5aac9965f1ce8ad870dd" exitCode=0
Sep 10 23:16:29.467214 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.467168    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb" event={"ID":"2ec3c2cd-c635-418b-b331-9fd62a860b04","Type":"ContainerDied","Data":"206de02967aabd8676461ff64f83ac4411bc1d019d3c5aac9965f1ce8ad870dd"}
Sep 10 23:16:29.469268 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.469200    2585 generic.go:356] "Generic (PLEG): container finished" podID="f9b662f8-8caf-4ec9-80d9-3da912c29a91" containerID="8729c571f7462613bb9dcf69a1fad64ee3915ba5159bcaa6a33e48ed3470cf5f" exitCode=0
Sep 10 23:16:29.469268 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.469255    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh" event={"ID":"f9b662f8-8caf-4ec9-80d9-3da912c29a91","Type":"ContainerDied","Data":"8729c571f7462613bb9dcf69a1fad64ee3915ba5159bcaa6a33e48ed3470cf5f"}
Sep 10 23:16:29.490187 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.490150    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27"]
Sep 10 23:16:29.494029 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.494004    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-8972e2-8cx27"]
Sep 10 23:16:29.639833 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.639805    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"
Sep 10 23:16:29.668282 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.668253    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"
Sep 10 23:16:29.668766 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.668747    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrx7q\" (UniqueName: \"kubernetes.io/projected/2ec3c2cd-c635-418b-b331-9fd62a860b04-kube-api-access-vrx7q\") pod \"2ec3c2cd-c635-418b-b331-9fd62a860b04\" (UID: \"2ec3c2cd-c635-418b-b331-9fd62a860b04\") "
Sep 10 23:16:29.668893 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.668828    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ec3c2cd-c635-418b-b331-9fd62a860b04-plugins-config-volume\") pod \"2ec3c2cd-c635-418b-b331-9fd62a860b04\" (UID: \"2ec3c2cd-c635-418b-b331-9fd62a860b04\") "
Sep 10 23:16:29.669273 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.669246    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ec3c2cd-c635-418b-b331-9fd62a860b04-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2ec3c2cd-c635-418b-b331-9fd62a860b04" (UID: "2ec3c2cd-c635-418b-b331-9fd62a860b04"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:16:29.671020 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.670994    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec3c2cd-c635-418b-b331-9fd62a860b04-kube-api-access-vrx7q" (OuterVolumeSpecName: "kube-api-access-vrx7q") pod "2ec3c2cd-c635-418b-b331-9fd62a860b04" (UID: "2ec3c2cd-c635-418b-b331-9fd62a860b04"). InnerVolumeSpecName "kube-api-access-vrx7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:16:29.770010 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.769977    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b662f8-8caf-4ec9-80d9-3da912c29a91-plugins-config-volume\") pod \"f9b662f8-8caf-4ec9-80d9-3da912c29a91\" (UID: \"f9b662f8-8caf-4ec9-80d9-3da912c29a91\") "
Sep 10 23:16:29.770183 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.770174    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svv7j\" (UniqueName: \"kubernetes.io/projected/f9b662f8-8caf-4ec9-80d9-3da912c29a91-kube-api-access-svv7j\") pod \"f9b662f8-8caf-4ec9-80d9-3da912c29a91\" (UID: \"f9b662f8-8caf-4ec9-80d9-3da912c29a91\") "
Sep 10 23:16:29.770400 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.770370    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9b662f8-8caf-4ec9-80d9-3da912c29a91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9b662f8-8caf-4ec9-80d9-3da912c29a91" (UID: "f9b662f8-8caf-4ec9-80d9-3da912c29a91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:16:29.770482 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.770380    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrx7q\" (UniqueName: \"kubernetes.io/projected/2ec3c2cd-c635-418b-b331-9fd62a860b04-kube-api-access-vrx7q\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:29.770482 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.770436    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ec3c2cd-c635-418b-b331-9fd62a860b04-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:29.772162 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.772137    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9b662f8-8caf-4ec9-80d9-3da912c29a91-kube-api-access-svv7j" (OuterVolumeSpecName: "kube-api-access-svv7j") pod "f9b662f8-8caf-4ec9-80d9-3da912c29a91" (UID: "f9b662f8-8caf-4ec9-80d9-3da912c29a91"). InnerVolumeSpecName "kube-api-access-svv7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:16:29.872110 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.872012    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svv7j\" (UniqueName: \"kubernetes.io/projected/f9b662f8-8caf-4ec9-80d9-3da912c29a91-kube-api-access-svv7j\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:29.872110 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:29.872050    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9b662f8-8caf-4ec9-80d9-3da912c29a91-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:30.342221 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:30.342182    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5573b11-a76e-43ca-82c4-9fdd50528873" path="/var/lib/kubelet/pods/d5573b11-a76e-43ca-82c4-9fdd50528873/volumes"
Sep 10 23:16:30.476906 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:30.476872    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"
Sep 10 23:16:30.477129 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:30.476913    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb" event={"ID":"2ec3c2cd-c635-418b-b331-9fd62a860b04","Type":"ContainerDied","Data":"4259328498d9e7dc2a16705f2d30033493fe8d618ea8bf697331f49fbb29d708"}
Sep 10 23:16:30.477129 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:30.476994    2585 scope.go:117] "RemoveContainer" containerID="206de02967aabd8676461ff64f83ac4411bc1d019d3c5aac9965f1ce8ad870dd"
Sep 10 23:16:30.479385 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:30.479018    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh" event={"ID":"f9b662f8-8caf-4ec9-80d9-3da912c29a91","Type":"ContainerDied","Data":"fd9a92b943a392f15d51b3c59344d8ae220f76fa9207560c51c00fc84eb1e65e"}
Sep 10 23:16:30.479385 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:30.479116    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"
Sep 10 23:16:30.488658 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:30.488637    2585 scope.go:117] "RemoveContainer" containerID="8729c571f7462613bb9dcf69a1fad64ee3915ba5159bcaa6a33e48ed3470cf5f"
Sep 10 23:16:30.501129 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:30.501104    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"]
Sep 10 23:16:30.505619 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:30.505592    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-8972e2-84ddbdb898-5d9lh"]
Sep 10 23:16:30.515849 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:30.515821    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"]
Sep 10 23:16:30.520326 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:30.520305    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-8972e2-687979c689-7w7sb"]
Sep 10 23:16:32.341709 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:32.341676    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ec3c2cd-c635-418b-b331-9fd62a860b04" path="/var/lib/kubelet/pods/2ec3c2cd-c635-418b-b331-9fd62a860b04/volumes"
Sep 10 23:16:32.342105 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:32.342050    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9b662f8-8caf-4ec9-80d9-3da912c29a91" path="/var/lib/kubelet/pods/f9b662f8-8caf-4ec9-80d9-3da912c29a91/volumes"
Sep 10 23:16:36.222258 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:36.222224    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"]
Sep 10 23:16:36.223027 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:36.222996    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg" podUID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerName="istio-proxy" containerID="cri-o://d3f015a1edc8d8a14cb668084d70a12d3e9f3b37a0fe0a485fbca672aa741e62" gracePeriod=30
Sep 10 23:16:36.947877 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:36.947838    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"]
Sep 10 23:16:36.948284 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:36.948268    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9b662f8-8caf-4ec9-80d9-3da912c29a91" containerName="payload-pre-processing"
Sep 10 23:16:36.948339 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:36.948288    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9b662f8-8caf-4ec9-80d9-3da912c29a91" containerName="payload-pre-processing"
Sep 10 23:16:36.948339 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:36.948300    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec3c2cd-c635-418b-b331-9fd62a860b04" containerName="payload-processing"
Sep 10 23:16:36.948339 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:36.948306    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec3c2cd-c635-418b-b331-9fd62a860b04" containerName="payload-processing"
Sep 10 23:16:36.948439 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:36.948374    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ec3c2cd-c635-418b-b331-9fd62a860b04" containerName="payload-processing"
Sep 10 23:16:36.948439 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:36.948383    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9b662f8-8caf-4ec9-80d9-3da912c29a91" containerName="payload-pre-processing"
Sep 10 23:16:36.955201 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:36.952993    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:36.957478 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:36.957455    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-5ea2db-openshift-default-dockercfg-fp7r4\""
Sep 10 23:16:36.963469 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:36.963443    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"]
Sep 10 23:16:37.045057 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.045018    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdad65f5-77de-46b3-8d3c-46608760f15b-istiod-ca-cert\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.045226 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.045136    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d9lp\" (UniqueName: \"kubernetes.io/projected/bdad65f5-77de-46b3-8d3c-46608760f15b-kube-api-access-4d9lp\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.045226 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.045207    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-envoy\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.045304 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.045254    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-token\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.045304 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.045281    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-podinfo\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.045371 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.045321    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-workload-certs\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.045415 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.045395    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-workload-socket\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.045451 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.045428    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-data\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.045483 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.045474    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-credential-socket\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.146073 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.146041    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d9lp\" (UniqueName: \"kubernetes.io/projected/bdad65f5-77de-46b3-8d3c-46608760f15b-kube-api-access-4d9lp\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.146253 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.146090    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-envoy\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.146253 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.146113    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-token\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.146253 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.146131    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-podinfo\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.146253 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.146147    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-workload-certs\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.146253 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.146185    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-workload-socket\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.146253 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.146212    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-data\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.146507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.146294    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-credential-socket\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.146507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.146367    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdad65f5-77de-46b3-8d3c-46608760f15b-istiod-ca-cert\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.146839 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.146815    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-workload-socket\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.146923 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.146833    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-workload-certs\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.146923 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.146876    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-data\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.147016 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.147003    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-credential-socket\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.147373 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.147346    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdad65f5-77de-46b3-8d3c-46608760f15b-istiod-ca-cert\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.148854 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.148833    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-envoy\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.148987 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.148968    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-podinfo\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.154981 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.154955    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-token\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.155166 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.155149    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d9lp\" (UniqueName: \"kubernetes.io/projected/bdad65f5-77de-46b3-8d3c-46608760f15b-kube-api-access-4d9lp\") pod \"e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") " pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.271477 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.271378    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:37.454448 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.454417    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"
Sep 10 23:16:37.570805 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.570773    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"]
Sep 10 23:16:37.571825 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:16:37.571797    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdad65f5_77de_46b3_8d3c_46608760f15b.slice/crio-9520ff024985f7af84f7bff4d0848a4cd58e3e9eb70108dfc998debe7ba31ad9 WatchSource:0}: Error finding container 9520ff024985f7af84f7bff4d0848a4cd58e3e9eb70108dfc998debe7ba31ad9: Status 404 returned error can't find the container with id 9520ff024985f7af84f7bff4d0848a4cd58e3e9eb70108dfc998debe7ba31ad9
Sep 10 23:16:37.574162 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.574132    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:16:37.574230 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.574195    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:16:37.574271 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:37.574228    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:16:38.542300 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:38.542258    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l" event={"ID":"bdad65f5-77de-46b3-8d3c-46608760f15b","Type":"ContainerStarted","Data":"3da6abdaa15a9878958fac2fffee6e455cb6f3e2f9a548382315cd152775e6db"}
Sep 10 23:16:38.542871 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:38.542337    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l" event={"ID":"bdad65f5-77de-46b3-8d3c-46608760f15b","Type":"ContainerStarted","Data":"9520ff024985f7af84f7bff4d0848a4cd58e3e9eb70108dfc998debe7ba31ad9"}
Sep 10 23:16:38.566073 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:38.566014    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l" podStartSLOduration=2.565996563 podStartE2EDuration="2.565996563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:16:38.562944539 +0000 UTC m=+1110.741815501" watchObservedRunningTime="2026-09-10 23:16:38.565996563 +0000 UTC m=+1110.744867526"
Sep 10 23:16:39.272585 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:39.272520    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:39.277429 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:39.277398    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:39.550308 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:39.550280    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:39.551960 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:39.551938    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:16:41.390990 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.390964    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:16:41.492672 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.492584    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-workload-socket\") pod \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") "
Sep 10 23:16:41.492672 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.492650    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-data\") pod \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") "
Sep 10 23:16:41.492868 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.492677    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-workload-certs\") pod \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") "
Sep 10 23:16:41.492868 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.492777    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrrg6\" (UniqueName: \"kubernetes.io/projected/ac12ccaa-b46e-4792-a443-8d495fb1ead5-kube-api-access-xrrg6\") pod \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") "
Sep 10 23:16:41.492868 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.492835    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-envoy\") pod \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") "
Sep 10 23:16:41.493022 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.492881    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-podinfo\") pod \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") "
Sep 10 23:16:41.493022 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.492909    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac12ccaa-b46e-4792-a443-8d495fb1ead5" (UID: "ac12ccaa-b46e-4792-a443-8d495fb1ead5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:16:41.493022 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.492940    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-token\") pod \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") "
Sep 10 23:16:41.493022 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.492974    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac12ccaa-b46e-4792-a443-8d495fb1ead5" (UID: "ac12ccaa-b46e-4792-a443-8d495fb1ead5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:16:41.493022 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.492987    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac12ccaa-b46e-4792-a443-8d495fb1ead5" (UID: "ac12ccaa-b46e-4792-a443-8d495fb1ead5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:16:41.493022 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.493004    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istiod-ca-cert\") pod \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") "
Sep 10 23:16:41.493355 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.493046    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-credential-socket\") pod \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\" (UID: \"ac12ccaa-b46e-4792-a443-8d495fb1ead5\") "
Sep 10 23:16:41.493412 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.493355    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac12ccaa-b46e-4792-a443-8d495fb1ead5" (UID: "ac12ccaa-b46e-4792-a443-8d495fb1ead5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:16:41.493412 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.493384    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac12ccaa-b46e-4792-a443-8d495fb1ead5" (UID: "ac12ccaa-b46e-4792-a443-8d495fb1ead5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:16:41.493626 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.493606    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:41.493626 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.493627    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:41.493766 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.493636    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:41.493766 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.493644    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:41.493766 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.493652    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:41.495355 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.495321    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac12ccaa-b46e-4792-a443-8d495fb1ead5" (UID: "ac12ccaa-b46e-4792-a443-8d495fb1ead5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:16:41.495744 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.495715    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac12ccaa-b46e-4792-a443-8d495fb1ead5-kube-api-access-xrrg6" (OuterVolumeSpecName: "kube-api-access-xrrg6") pod "ac12ccaa-b46e-4792-a443-8d495fb1ead5" (UID: "ac12ccaa-b46e-4792-a443-8d495fb1ead5"). InnerVolumeSpecName "kube-api-access-xrrg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:16:41.495838 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.495785    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac12ccaa-b46e-4792-a443-8d495fb1ead5" (UID: "ac12ccaa-b46e-4792-a443-8d495fb1ead5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:16:41.495881 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.495846    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac12ccaa-b46e-4792-a443-8d495fb1ead5" (UID: "ac12ccaa-b46e-4792-a443-8d495fb1ead5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:16:41.567000 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.566964    2585 generic.go:356] "Generic (PLEG): container finished" podID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerID="d3f015a1edc8d8a14cb668084d70a12d3e9f3b37a0fe0a485fbca672aa741e62" exitCode=0
Sep 10 23:16:41.567158 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.567017    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"
Sep 10 23:16:41.567158 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.567049    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg" event={"ID":"ac12ccaa-b46e-4792-a443-8d495fb1ead5","Type":"ContainerDied","Data":"d3f015a1edc8d8a14cb668084d70a12d3e9f3b37a0fe0a485fbca672aa741e62"}
Sep 10 23:16:41.567158 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.567108    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg" event={"ID":"ac12ccaa-b46e-4792-a443-8d495fb1ead5","Type":"ContainerDied","Data":"c7279d31752bd2ac80f7f3153ade8ae503fe4815edf986e27b20efcb01ddb895"}
Sep 10 23:16:41.567158 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.567132    2585 scope.go:117] "RemoveContainer" containerID="d3f015a1edc8d8a14cb668084d70a12d3e9f3b37a0fe0a485fbca672aa741e62"
Sep 10 23:16:41.577371 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.577350    2585 scope.go:117] "RemoveContainer" containerID="c65e3583d76c77b03ff2f4bb990702ba02c8156ba64ac3b730b6719b5f061fb0"
Sep 10 23:16:41.587964 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.587940    2585 scope.go:117] "RemoveContainer" containerID="d3f015a1edc8d8a14cb668084d70a12d3e9f3b37a0fe0a485fbca672aa741e62"
Sep 10 23:16:41.588260 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:16:41.588234    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3f015a1edc8d8a14cb668084d70a12d3e9f3b37a0fe0a485fbca672aa741e62\": container with ID starting with d3f015a1edc8d8a14cb668084d70a12d3e9f3b37a0fe0a485fbca672aa741e62 not found: ID does not exist" containerID="d3f015a1edc8d8a14cb668084d70a12d3e9f3b37a0fe0a485fbca672aa741e62"
Sep 10 23:16:41.588354 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.588268    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3f015a1edc8d8a14cb668084d70a12d3e9f3b37a0fe0a485fbca672aa741e62"} err="failed to get container status \"d3f015a1edc8d8a14cb668084d70a12d3e9f3b37a0fe0a485fbca672aa741e62\": rpc error: code = NotFound desc = could not find container \"d3f015a1edc8d8a14cb668084d70a12d3e9f3b37a0fe0a485fbca672aa741e62\": container with ID starting with d3f015a1edc8d8a14cb668084d70a12d3e9f3b37a0fe0a485fbca672aa741e62 not found: ID does not exist"
Sep 10 23:16:41.588354 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.588286    2585 scope.go:117] "RemoveContainer" containerID="c65e3583d76c77b03ff2f4bb990702ba02c8156ba64ac3b730b6719b5f061fb0"
Sep 10 23:16:41.588586 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:16:41.588552    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c65e3583d76c77b03ff2f4bb990702ba02c8156ba64ac3b730b6719b5f061fb0\": container with ID starting with c65e3583d76c77b03ff2f4bb990702ba02c8156ba64ac3b730b6719b5f061fb0 not found: ID does not exist" containerID="c65e3583d76c77b03ff2f4bb990702ba02c8156ba64ac3b730b6719b5f061fb0"
Sep 10 23:16:41.588653 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.588590    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c65e3583d76c77b03ff2f4bb990702ba02c8156ba64ac3b730b6719b5f061fb0"} err="failed to get container status \"c65e3583d76c77b03ff2f4bb990702ba02c8156ba64ac3b730b6719b5f061fb0\": rpc error: code = NotFound desc = could not find container \"c65e3583d76c77b03ff2f4bb990702ba02c8156ba64ac3b730b6719b5f061fb0\": container with ID starting with c65e3583d76c77b03ff2f4bb990702ba02c8156ba64ac3b730b6719b5f061fb0 not found: ID does not exist"
Sep 10 23:16:41.592926 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.592898    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"]
Sep 10 23:16:41.594488 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.594458    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrrg6\" (UniqueName: \"kubernetes.io/projected/ac12ccaa-b46e-4792-a443-8d495fb1ead5-kube-api-access-xrrg6\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:41.594488 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.594484    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:41.594662 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.594495    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:41.594662 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.594502    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac12ccaa-b46e-4792-a443-8d495fb1ead5-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:41.596800 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:41.596774    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-8972e2-openshift-default-59c58d7d48-wxrjg"]
Sep 10 23:16:42.342483 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:42.342449    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" path="/var/lib/kubelet/pods/ac12ccaa-b46e-4792-a443-8d495fb1ead5/volumes"
Sep 10 23:16:43.582234 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:43.582203    2585 generic.go:356] "Generic (PLEG): container finished" podID="652f16f3-8942-4366-9f07-15322b5c326e" containerID="ac697fe72d9476d5592030f20dba6c3b3d1d5680a9a1007113e2c45f334e0003" exitCode=0
Sep 10 23:16:43.582697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:43.582257    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" event={"ID":"652f16f3-8942-4366-9f07-15322b5c326e","Type":"ContainerDied","Data":"ac697fe72d9476d5592030f20dba6c3b3d1d5680a9a1007113e2c45f334e0003"}
Sep 10 23:16:43.582697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:43.582671    2585 scope.go:117] "RemoveContainer" containerID="ac697fe72d9476d5592030f20dba6c3b3d1d5680a9a1007113e2c45f334e0003"
Sep 10 23:16:43.583815 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:43.583788    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:16:43.583895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:43.583855    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:16:43.583895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:43.583886    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:16:44.589385 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:44.589352    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" event={"ID":"652f16f3-8942-4366-9f07-15322b5c326e","Type":"ContainerStarted","Data":"37184921cfcb673f805faafa2952c5394a0e70b35047f7a155bb657d4961a63d"}
Sep 10 23:16:44.641149 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:44.641111    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:44.641357 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:44.641266    2585 patch_prober.go:28] interesting pod/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 10 23:16:44.641357 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:44.641335    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" podUID="652f16f3-8942-4366-9f07-15322b5c326e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 10 23:16:45.640875 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:45.640838    2585 patch_prober.go:28] interesting pod/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 10 23:16:45.641259 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:45.640893    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" podUID="652f16f3-8942-4366-9f07-15322b5c326e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 10 23:16:46.641093 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:46.641051    2585 patch_prober.go:28] interesting pod/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 10 23:16:46.641503 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:46.641125    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" podUID="652f16f3-8942-4366-9f07-15322b5c326e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 10 23:16:47.641500 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:47.641463    2585 patch_prober.go:28] interesting pod/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 10 23:16:47.641910 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:47.641535    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" podUID="652f16f3-8942-4366-9f07-15322b5c326e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 10 23:16:48.640467 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:48.640424    2585 patch_prober.go:28] interesting pod/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 10 23:16:48.640684 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:48.640488    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" podUID="652f16f3-8942-4366-9f07-15322b5c326e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 10 23:16:49.641353 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:49.641321    2585 patch_prober.go:28] interesting pod/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 10 23:16:49.641768 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:49.641373    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" podUID="652f16f3-8942-4366-9f07-15322b5c326e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 10 23:16:50.644634 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:50.644605    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:50.645001 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:50.644928    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:50.645514 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:50.645495    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:16:55.865361 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:55.865327    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf"]
Sep 10 23:16:55.865797 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:55.865782    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerName="istio-proxy"
Sep 10 23:16:55.865885 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:55.865798    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerName="istio-proxy"
Sep 10 23:16:55.865885 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:55.865815    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerName="istio-proxy"
Sep 10 23:16:55.865885 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:55.865820    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerName="istio-proxy"
Sep 10 23:16:55.865885 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:55.865882    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerName="istio-proxy"
Sep 10 23:16:55.870193 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:55.870175    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf"
Sep 10 23:16:55.873134 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:55.873109    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:16:55.873327 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:55.873113    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:16:55.879328 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:55.879299    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf"]
Sep 10 23:16:56.038656 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:56.038619    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2913b838-6757-42d9-b621-40664c054b3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf\" (UID: \"2913b838-6757-42d9-b621-40664c054b3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf"
Sep 10 23:16:56.139983 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:56.139887    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2913b838-6757-42d9-b621-40664c054b3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf\" (UID: \"2913b838-6757-42d9-b621-40664c054b3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf"
Sep 10 23:16:56.140859 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:56.140830    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2913b838-6757-42d9-b621-40664c054b3c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf\" (UID: \"2913b838-6757-42d9-b621-40664c054b3c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf"
Sep 10 23:16:56.187519 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:56.187494    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf"
Sep 10 23:16:56.481682 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:56.481652    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf"]
Sep 10 23:16:56.483525 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:16:56.483494    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2913b838_6757_42d9_b621_40664c054b3c.slice/crio-8f890fdcbba4d3709a6ef61879478e86329a06ca6102f9716a6cea91acfe985f WatchSource:0}: Error finding container 8f890fdcbba4d3709a6ef61879478e86329a06ca6102f9716a6cea91acfe985f: Status 404 returned error can't find the container with id 8f890fdcbba4d3709a6ef61879478e86329a06ca6102f9716a6cea91acfe985f
Sep 10 23:16:56.676631 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:56.676596    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf" event={"ID":"2913b838-6757-42d9-b621-40664c054b3c","Type":"ContainerStarted","Data":"8f890fdcbba4d3709a6ef61879478e86329a06ca6102f9716a6cea91acfe985f"}
Sep 10 23:16:57.684778 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:57.684687    2585 generic.go:356] "Generic (PLEG): container finished" podID="2913b838-6757-42d9-b621-40664c054b3c" containerID="ce970bd99ce9dbd0d07c1896aac69f3ca7fd5378e4fc33d51c786602e5784582" exitCode=0
Sep 10 23:16:57.685153 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:57.684778    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf" event={"ID":"2913b838-6757-42d9-b621-40664c054b3c","Type":"ContainerDied","Data":"ce970bd99ce9dbd0d07c1896aac69f3ca7fd5378e4fc33d51c786602e5784582"}
Sep 10 23:16:58.827361 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:58.827334    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf"
Sep 10 23:16:58.969004 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:58.968915    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2913b838-6757-42d9-b621-40664c054b3c-maas-api-service-ca\") pod \"2913b838-6757-42d9-b621-40664c054b3c\" (UID: \"2913b838-6757-42d9-b621-40664c054b3c\") "
Sep 10 23:16:58.969317 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:58.969295    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2913b838-6757-42d9-b621-40664c054b3c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2913b838-6757-42d9-b621-40664c054b3c" (UID: "2913b838-6757-42d9-b621-40664c054b3c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:16:59.070087 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:59.070056    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2913b838-6757-42d9-b621-40664c054b3c-maas-api-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:16:59.699480 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:59.699437    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf" event={"ID":"2913b838-6757-42d9-b621-40664c054b3c","Type":"ContainerDied","Data":"8f890fdcbba4d3709a6ef61879478e86329a06ca6102f9716a6cea91acfe985f"}
Sep 10 23:16:59.699480 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:59.699468    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf"
Sep 10 23:16:59.699732 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:16:59.699499    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f890fdcbba4d3709a6ef61879478e86329a06ca6102f9716a6cea91acfe985f"
Sep 10 23:17:06.357142 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.357104    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"]
Sep 10 23:17:06.357902 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.357868    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4" podUID="9d4979ad-cae5-4ec0-9957-32ba30ba335f" containerName="payload-pre-processing" containerID="cri-o://04ef52b125bd65428ad1dbed3021767e4f685464231597e3cc2cd8b22353a97d" gracePeriod=30
Sep 10 23:17:06.561472 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.561439    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf"]
Sep 10 23:17:06.565775 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.565738    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f90a11e-pzvmf"]
Sep 10 23:17:06.651854 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.651829    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"
Sep 10 23:17:06.748246 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.748210    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psmg6\" (UniqueName: \"kubernetes.io/projected/9d4979ad-cae5-4ec0-9957-32ba30ba335f-kube-api-access-psmg6\") pod \"9d4979ad-cae5-4ec0-9957-32ba30ba335f\" (UID: \"9d4979ad-cae5-4ec0-9957-32ba30ba335f\") "
Sep 10 23:17:06.748453 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.748292    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d4979ad-cae5-4ec0-9957-32ba30ba335f-plugins-config-volume\") pod \"9d4979ad-cae5-4ec0-9957-32ba30ba335f\" (UID: \"9d4979ad-cae5-4ec0-9957-32ba30ba335f\") "
Sep 10 23:17:06.748745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.748715    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d4979ad-cae5-4ec0-9957-32ba30ba335f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9d4979ad-cae5-4ec0-9957-32ba30ba335f" (UID: "9d4979ad-cae5-4ec0-9957-32ba30ba335f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:17:06.750463 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.750436    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d4979ad-cae5-4ec0-9957-32ba30ba335f-kube-api-access-psmg6" (OuterVolumeSpecName: "kube-api-access-psmg6") pod "9d4979ad-cae5-4ec0-9957-32ba30ba335f" (UID: "9d4979ad-cae5-4ec0-9957-32ba30ba335f"). InnerVolumeSpecName "kube-api-access-psmg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:17:06.752409 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.752385    2585 generic.go:356] "Generic (PLEG): container finished" podID="9d4979ad-cae5-4ec0-9957-32ba30ba335f" containerID="04ef52b125bd65428ad1dbed3021767e4f685464231597e3cc2cd8b22353a97d" exitCode=0
Sep 10 23:17:06.752500 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.752434    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"
Sep 10 23:17:06.752500 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.752445    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4" event={"ID":"9d4979ad-cae5-4ec0-9957-32ba30ba335f","Type":"ContainerDied","Data":"04ef52b125bd65428ad1dbed3021767e4f685464231597e3cc2cd8b22353a97d"}
Sep 10 23:17:06.752618 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.752520    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4" event={"ID":"9d4979ad-cae5-4ec0-9957-32ba30ba335f","Type":"ContainerDied","Data":"cb0e2f399d57cda68209397afd624c9e165da321420f9c0eb4278458d70d2074"}
Sep 10 23:17:06.752618 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.752546    2585 scope.go:117] "RemoveContainer" containerID="04ef52b125bd65428ad1dbed3021767e4f685464231597e3cc2cd8b22353a97d"
Sep 10 23:17:06.763572 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.763542    2585 scope.go:117] "RemoveContainer" containerID="04ef52b125bd65428ad1dbed3021767e4f685464231597e3cc2cd8b22353a97d"
Sep 10 23:17:06.763963 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:17:06.763827    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04ef52b125bd65428ad1dbed3021767e4f685464231597e3cc2cd8b22353a97d\": container with ID starting with 04ef52b125bd65428ad1dbed3021767e4f685464231597e3cc2cd8b22353a97d not found: ID does not exist" containerID="04ef52b125bd65428ad1dbed3021767e4f685464231597e3cc2cd8b22353a97d"
Sep 10 23:17:06.763963 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.763863    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04ef52b125bd65428ad1dbed3021767e4f685464231597e3cc2cd8b22353a97d"} err="failed to get container status \"04ef52b125bd65428ad1dbed3021767e4f685464231597e3cc2cd8b22353a97d\": rpc error: code = NotFound desc = could not find container \"04ef52b125bd65428ad1dbed3021767e4f685464231597e3cc2cd8b22353a97d\": container with ID starting with 04ef52b125bd65428ad1dbed3021767e4f685464231597e3cc2cd8b22353a97d not found: ID does not exist"
Sep 10 23:17:06.778472 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.778444    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"]
Sep 10 23:17:06.781074 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.781054    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-1f90a11e-7b4dd4fff4-98mk4"]
Sep 10 23:17:06.849768 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.849730    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psmg6\" (UniqueName: \"kubernetes.io/projected/9d4979ad-cae5-4ec0-9957-32ba30ba335f-kube-api-access-psmg6\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:06.849768 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:06.849760    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9d4979ad-cae5-4ec0-9957-32ba30ba335f-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:08.342551 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:08.342521    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2913b838-6757-42d9-b621-40664c054b3c" path="/var/lib/kubelet/pods/2913b838-6757-42d9-b621-40664c054b3c/volumes"
Sep 10 23:17:08.342920 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:08.342887    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d4979ad-cae5-4ec0-9957-32ba30ba335f" path="/var/lib/kubelet/pods/9d4979ad-cae5-4ec0-9957-32ba30ba335f/volumes"
Sep 10 23:17:13.297257 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:13.297218    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"]
Sep 10 23:17:13.297997 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:13.297500    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" podUID="652f16f3-8942-4366-9f07-15322b5c326e" containerName="istio-proxy" containerID="cri-o://37184921cfcb673f805faafa2952c5394a0e70b35047f7a155bb657d4961a63d" gracePeriod=30
Sep 10 23:17:18.554487 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.554461    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:17:18.661710 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.661628    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-istio-envoy\") pod \"652f16f3-8942-4366-9f07-15322b5c326e\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") "
Sep 10 23:17:18.661710 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.661672    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-workload-socket\") pod \"652f16f3-8942-4366-9f07-15322b5c326e\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") "
Sep 10 23:17:18.661710 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.661689    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-istio-data\") pod \"652f16f3-8942-4366-9f07-15322b5c326e\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") "
Sep 10 23:17:18.661971 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.661721    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/652f16f3-8942-4366-9f07-15322b5c326e-istiod-ca-cert\") pod \"652f16f3-8942-4366-9f07-15322b5c326e\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") "
Sep 10 23:17:18.661971 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.661745    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/652f16f3-8942-4366-9f07-15322b5c326e-istio-token\") pod \"652f16f3-8942-4366-9f07-15322b5c326e\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") "
Sep 10 23:17:18.661971 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.661768    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-credential-socket\") pod \"652f16f3-8942-4366-9f07-15322b5c326e\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") "
Sep 10 23:17:18.661971 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.661817    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-workload-certs\") pod \"652f16f3-8942-4366-9f07-15322b5c326e\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") "
Sep 10 23:17:18.661971 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.661889    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/652f16f3-8942-4366-9f07-15322b5c326e-istio-podinfo\") pod \"652f16f3-8942-4366-9f07-15322b5c326e\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") "
Sep 10 23:17:18.661971 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.661918    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mch92\" (UniqueName: \"kubernetes.io/projected/652f16f3-8942-4366-9f07-15322b5c326e-kube-api-access-mch92\") pod \"652f16f3-8942-4366-9f07-15322b5c326e\" (UID: \"652f16f3-8942-4366-9f07-15322b5c326e\") "
Sep 10 23:17:18.662290 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.661952    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "652f16f3-8942-4366-9f07-15322b5c326e" (UID: "652f16f3-8942-4366-9f07-15322b5c326e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:18.662290 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.661994    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-istio-data" (OuterVolumeSpecName: "istio-data") pod "652f16f3-8942-4366-9f07-15322b5c326e" (UID: "652f16f3-8942-4366-9f07-15322b5c326e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:18.662290 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.662117    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "652f16f3-8942-4366-9f07-15322b5c326e" (UID: "652f16f3-8942-4366-9f07-15322b5c326e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:18.662290 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.662147    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "652f16f3-8942-4366-9f07-15322b5c326e" (UID: "652f16f3-8942-4366-9f07-15322b5c326e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:18.662290 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.662238    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/652f16f3-8942-4366-9f07-15322b5c326e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "652f16f3-8942-4366-9f07-15322b5c326e" (UID: "652f16f3-8942-4366-9f07-15322b5c326e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:17:18.662290 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.662271    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:18.662290 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.662285    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:18.662290 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.662294    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:18.662705 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.662302    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:18.664050 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.664028    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/652f16f3-8942-4366-9f07-15322b5c326e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "652f16f3-8942-4366-9f07-15322b5c326e" (UID: "652f16f3-8942-4366-9f07-15322b5c326e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:17:18.664157 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.664118    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/652f16f3-8942-4366-9f07-15322b5c326e-kube-api-access-mch92" (OuterVolumeSpecName: "kube-api-access-mch92") pod "652f16f3-8942-4366-9f07-15322b5c326e" (UID: "652f16f3-8942-4366-9f07-15322b5c326e"). InnerVolumeSpecName "kube-api-access-mch92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:17:18.664365 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.664342    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "652f16f3-8942-4366-9f07-15322b5c326e" (UID: "652f16f3-8942-4366-9f07-15322b5c326e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:18.664465 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.664362    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/652f16f3-8942-4366-9f07-15322b5c326e-istio-token" (OuterVolumeSpecName: "istio-token") pod "652f16f3-8942-4366-9f07-15322b5c326e" (UID: "652f16f3-8942-4366-9f07-15322b5c326e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:17:18.763288 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.763242    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/652f16f3-8942-4366-9f07-15322b5c326e-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:18.763288 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.763286    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/652f16f3-8942-4366-9f07-15322b5c326e-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:18.763288 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.763295    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/652f16f3-8942-4366-9f07-15322b5c326e-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:18.763288 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.763304    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mch92\" (UniqueName: \"kubernetes.io/projected/652f16f3-8942-4366-9f07-15322b5c326e-kube-api-access-mch92\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:18.763616 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.763314    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/652f16f3-8942-4366-9f07-15322b5c326e-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:18.831067 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.831027    2585 generic.go:356] "Generic (PLEG): container finished" podID="652f16f3-8942-4366-9f07-15322b5c326e" containerID="37184921cfcb673f805faafa2952c5394a0e70b35047f7a155bb657d4961a63d" exitCode=0
Sep 10 23:17:18.831231 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.831088    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"
Sep 10 23:17:18.831231 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.831091    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" event={"ID":"652f16f3-8942-4366-9f07-15322b5c326e","Type":"ContainerDied","Data":"37184921cfcb673f805faafa2952c5394a0e70b35047f7a155bb657d4961a63d"}
Sep 10 23:17:18.831231 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.831143    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl" event={"ID":"652f16f3-8942-4366-9f07-15322b5c326e","Type":"ContainerDied","Data":"7e7054050a2860bba19b3280d2ca28fb274d453ea7939c9a2166893adaab2167"}
Sep 10 23:17:18.831231 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.831174    2585 scope.go:117] "RemoveContainer" containerID="37184921cfcb673f805faafa2952c5394a0e70b35047f7a155bb657d4961a63d"
Sep 10 23:17:18.841026 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.841006    2585 scope.go:117] "RemoveContainer" containerID="ac697fe72d9476d5592030f20dba6c3b3d1d5680a9a1007113e2c45f334e0003"
Sep 10 23:17:18.849594 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.849555    2585 scope.go:117] "RemoveContainer" containerID="37184921cfcb673f805faafa2952c5394a0e70b35047f7a155bb657d4961a63d"
Sep 10 23:17:18.849890 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:17:18.849872    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37184921cfcb673f805faafa2952c5394a0e70b35047f7a155bb657d4961a63d\": container with ID starting with 37184921cfcb673f805faafa2952c5394a0e70b35047f7a155bb657d4961a63d not found: ID does not exist" containerID="37184921cfcb673f805faafa2952c5394a0e70b35047f7a155bb657d4961a63d"
Sep 10 23:17:18.849981 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.849899    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37184921cfcb673f805faafa2952c5394a0e70b35047f7a155bb657d4961a63d"} err="failed to get container status \"37184921cfcb673f805faafa2952c5394a0e70b35047f7a155bb657d4961a63d\": rpc error: code = NotFound desc = could not find container \"37184921cfcb673f805faafa2952c5394a0e70b35047f7a155bb657d4961a63d\": container with ID starting with 37184921cfcb673f805faafa2952c5394a0e70b35047f7a155bb657d4961a63d not found: ID does not exist"
Sep 10 23:17:18.849981 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.849917    2585 scope.go:117] "RemoveContainer" containerID="ac697fe72d9476d5592030f20dba6c3b3d1d5680a9a1007113e2c45f334e0003"
Sep 10 23:17:18.850161 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:17:18.850141    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac697fe72d9476d5592030f20dba6c3b3d1d5680a9a1007113e2c45f334e0003\": container with ID starting with ac697fe72d9476d5592030f20dba6c3b3d1d5680a9a1007113e2c45f334e0003 not found: ID does not exist" containerID="ac697fe72d9476d5592030f20dba6c3b3d1d5680a9a1007113e2c45f334e0003"
Sep 10 23:17:18.850201 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.850167    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac697fe72d9476d5592030f20dba6c3b3d1d5680a9a1007113e2c45f334e0003"} err="failed to get container status \"ac697fe72d9476d5592030f20dba6c3b3d1d5680a9a1007113e2c45f334e0003\": rpc error: code = NotFound desc = could not find container \"ac697fe72d9476d5592030f20dba6c3b3d1d5680a9a1007113e2c45f334e0003\": container with ID starting with ac697fe72d9476d5592030f20dba6c3b3d1d5680a9a1007113e2c45f334e0003 not found: ID does not exist"
Sep 10 23:17:18.856249 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.856224    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"]
Sep 10 23:17:18.860485 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:18.860456    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1f90a11e-openshift-default-b8b865dd4-bhcrl"]
Sep 10 23:17:20.342767 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:20.342737    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="652f16f3-8942-4366-9f07-15322b5c326e" path="/var/lib/kubelet/pods/652f16f3-8942-4366-9f07-15322b5c326e/volumes"
Sep 10 23:17:27.505689 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.505649    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"]
Sep 10 23:17:27.506833 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.506808    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d4979ad-cae5-4ec0-9957-32ba30ba335f" containerName="payload-pre-processing"
Sep 10 23:17:27.506981 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.506969    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d4979ad-cae5-4ec0-9957-32ba30ba335f" containerName="payload-pre-processing"
Sep 10 23:17:27.507089 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.507078    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2913b838-6757-42d9-b621-40664c054b3c" containerName="revoke-keys"
Sep 10 23:17:27.507235 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.507224    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2913b838-6757-42d9-b621-40664c054b3c" containerName="revoke-keys"
Sep 10 23:17:27.507322 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.507312    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="652f16f3-8942-4366-9f07-15322b5c326e" containerName="istio-proxy"
Sep 10 23:17:27.507394 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.507385    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="652f16f3-8942-4366-9f07-15322b5c326e" containerName="istio-proxy"
Sep 10 23:17:27.507628 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.507613    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d4979ad-cae5-4ec0-9957-32ba30ba335f" containerName="payload-pre-processing"
Sep 10 23:17:27.507730 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.507718    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac12ccaa-b46e-4792-a443-8d495fb1ead5" containerName="istio-proxy"
Sep 10 23:17:27.507815 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.507806    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2913b838-6757-42d9-b621-40664c054b3c" containerName="revoke-keys"
Sep 10 23:17:27.507898 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.507879    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="652f16f3-8942-4366-9f07-15322b5c326e" containerName="istio-proxy"
Sep 10 23:17:27.507976 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.507966    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="652f16f3-8942-4366-9f07-15322b5c326e" containerName="istio-proxy"
Sep 10 23:17:27.512952 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.512898    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.515674 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.515655    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-94f305-openshift-default-dockercfg-hq47f\""
Sep 10 23:17:27.527239 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.527185    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"]
Sep 10 23:17:27.561981 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.561943    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"]
Sep 10 23:17:27.562420 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.562370    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l" podUID="bdad65f5-77de-46b3-8d3c-46608760f15b" containerName="istio-proxy" containerID="cri-o://3da6abdaa15a9878958fac2fffee6e455cb6f3e2f9a548382315cd152775e6db" gracePeriod=30
Sep 10 23:17:27.657583 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.654665    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-data\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.657583 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.654708    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-token\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.657583 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.654735    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-envoy\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.657583 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.654758    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-workload-certs\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.657583 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.654784    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc8vr\" (UniqueName: \"kubernetes.io/projected/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-kube-api-access-vc8vr\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.657583 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.654826    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-credential-socket\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.657583 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.654863    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istiod-ca-cert\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.657583 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.654900    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-workload-socket\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.657583 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.654923    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-podinfo\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.755799 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.755709    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-workload-socket\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.755799 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.755753    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-podinfo\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.756054 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.755809    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-data\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.756054 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.755826    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-token\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.756054 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.755847    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-envoy\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.756054 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.755874    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-workload-certs\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.756054 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.756024    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc8vr\" (UniqueName: \"kubernetes.io/projected/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-kube-api-access-vc8vr\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.756319 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.756094    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-credential-socket\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.756319 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.756136    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istiod-ca-cert\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.756319 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.756179    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-workload-socket\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.756319 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.756200    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-workload-certs\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.756756 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.756730    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istiod-ca-cert\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.756860 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.756757    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-data\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.756913 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.756857    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-credential-socket\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.758461 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.758442    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-envoy\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.758553 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.758507    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-podinfo\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.764072 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.764049    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-token\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.764191 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.764081    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc8vr\" (UniqueName: \"kubernetes.io/projected/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-kube-api-access-vc8vr\") pod \"e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") " pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:27.828147 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:27.828114    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:28.108746 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.108718    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"]
Sep 10 23:17:28.110367 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:17:28.110339    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8858a7ed_e0f6_4e74_9fd2_3e117542dbf3.slice/crio-f1714311ccb6ff8e20c126a615a218d01e2b348adbab8942ded1d782e6d905ca WatchSource:0}: Error finding container f1714311ccb6ff8e20c126a615a218d01e2b348adbab8942ded1d782e6d905ca: Status 404 returned error can't find the container with id f1714311ccb6ff8e20c126a615a218d01e2b348adbab8942ded1d782e6d905ca
Sep 10 23:17:28.112764 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.112726    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:17:28.112847 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.112800    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:17:28.112847 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.112829    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:17:28.758175 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.758124    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd"]
Sep 10 23:17:28.759322 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.759292    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="652f16f3-8942-4366-9f07-15322b5c326e" containerName="istio-proxy"
Sep 10 23:17:28.759453 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.759392    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="652f16f3-8942-4366-9f07-15322b5c326e" containerName="istio-proxy"
Sep 10 23:17:28.763184 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.763152    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd"
Sep 10 23:17:28.766047 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.765487    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:17:28.766047 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.765757    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:17:28.767248 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.767225    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd"]
Sep 10 23:17:28.867968 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.867931    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4219d8f-fc7c-40c2-b98a-85df737e6fd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd\" (UID: \"e4219d8f-fc7c-40c2-b98a-85df737e6fd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd"
Sep 10 23:17:28.897159 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.897118    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" event={"ID":"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3","Type":"ContainerStarted","Data":"0b8edc7bac6ba6588d78308e225ae6830f39fae3981bd823f45fc6961bd49b34"}
Sep 10 23:17:28.897334 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.897186    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" event={"ID":"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3","Type":"ContainerStarted","Data":"f1714311ccb6ff8e20c126a615a218d01e2b348adbab8942ded1d782e6d905ca"}
Sep 10 23:17:28.919151 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.919100    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" podStartSLOduration=1.919083282 podStartE2EDuration="1.919083282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:17:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:17:28.915863125 +0000 UTC m=+1161.094734099" watchObservedRunningTime="2026-09-10 23:17:28.919083282 +0000 UTC m=+1161.097954245"
Sep 10 23:17:28.969363 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.969331    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4219d8f-fc7c-40c2-b98a-85df737e6fd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd\" (UID: \"e4219d8f-fc7c-40c2-b98a-85df737e6fd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd"
Sep 10 23:17:28.969943 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:28.969922    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4219d8f-fc7c-40c2-b98a-85df737e6fd0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd\" (UID: \"e4219d8f-fc7c-40c2-b98a-85df737e6fd0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd"
Sep 10 23:17:29.082148 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:29.082115    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd"
Sep 10 23:17:29.357355 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:29.357319    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd"]
Sep 10 23:17:29.358808 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:17:29.358783    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4219d8f_fc7c_40c2_b98a_85df737e6fd0.slice/crio-af00f55723564fdb7edbc5fda2b12de8f84bca3513b22152c46f0c17d2688ffd WatchSource:0}: Error finding container af00f55723564fdb7edbc5fda2b12de8f84bca3513b22152c46f0c17d2688ffd: Status 404 returned error can't find the container with id af00f55723564fdb7edbc5fda2b12de8f84bca3513b22152c46f0c17d2688ffd
Sep 10 23:17:29.828276 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:29.828242    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:29.833459 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:29.833433    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:29.906789 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:29.906703    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd" event={"ID":"e4219d8f-fc7c-40c2-b98a-85df737e6fd0","Type":"ContainerStarted","Data":"4c76c1368710fd8aa150854669159ea394f1d9ddf38adb3738f821e94d6ece9d"}
Sep 10 23:17:29.906789 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:29.906760    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd" event={"ID":"e4219d8f-fc7c-40c2-b98a-85df737e6fd0","Type":"ContainerStarted","Data":"af00f55723564fdb7edbc5fda2b12de8f84bca3513b22152c46f0c17d2688ffd"}
Sep 10 23:17:29.907073 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:29.907049    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:29.908182 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:29.908167    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:29.922156 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:29.922101    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd" podStartSLOduration=1.922083201 podStartE2EDuration="1.922083201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:17:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:17:29.921526674 +0000 UTC m=+1162.100397651" watchObservedRunningTime="2026-09-10 23:17:29.922083201 +0000 UTC m=+1162.100954164"
Sep 10 23:17:30.922200 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:30.922117    2585 generic.go:356] "Generic (PLEG): container finished" podID="e4219d8f-fc7c-40c2-b98a-85df737e6fd0" containerID="4c76c1368710fd8aa150854669159ea394f1d9ddf38adb3738f821e94d6ece9d" exitCode=0
Sep 10 23:17:30.922603 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:30.922195    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd" event={"ID":"e4219d8f-fc7c-40c2-b98a-85df737e6fd0","Type":"ContainerDied","Data":"4c76c1368710fd8aa150854669159ea394f1d9ddf38adb3738f821e94d6ece9d"}
Sep 10 23:17:32.072824 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.072797    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd"
Sep 10 23:17:32.200868 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.200779    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4219d8f-fc7c-40c2-b98a-85df737e6fd0-maas-api-service-ca\") pod \"e4219d8f-fc7c-40c2-b98a-85df737e6fd0\" (UID: \"e4219d8f-fc7c-40c2-b98a-85df737e6fd0\") "
Sep 10 23:17:32.201160 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.201135    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4219d8f-fc7c-40c2-b98a-85df737e6fd0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e4219d8f-fc7c-40c2-b98a-85df737e6fd0" (UID: "e4219d8f-fc7c-40c2-b98a-85df737e6fd0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:17:32.302058 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.302017    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e4219d8f-fc7c-40c2-b98a-85df737e6fd0-maas-api-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:32.703945 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.703907    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"]
Sep 10 23:17:32.704394 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.704374    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4219d8f-fc7c-40c2-b98a-85df737e6fd0" containerName="revoke-keys"
Sep 10 23:17:32.704394 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.704396    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4219d8f-fc7c-40c2-b98a-85df737e6fd0" containerName="revoke-keys"
Sep 10 23:17:32.704543 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.704488    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4219d8f-fc7c-40c2-b98a-85df737e6fd0" containerName="revoke-keys"
Sep 10 23:17:32.707700 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.707680    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"
Sep 10 23:17:32.710402 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.710377    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-94f305-dockercfg-9brpk\""
Sep 10 23:17:32.710504 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.710410    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-94f305\""
Sep 10 23:17:32.717917 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.717893    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"]
Sep 10 23:17:32.729187 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.729157    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"]
Sep 10 23:17:32.733154 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.733135    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"
Sep 10 23:17:32.740869 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.740835    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"]
Sep 10 23:17:32.810063 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.809687    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt64s\" (UniqueName: \"kubernetes.io/projected/53531aa0-28e3-4bd0-bab7-ebcaab2dd058-kube-api-access-pt64s\") pod \"payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g\" (UID: \"53531aa0-28e3-4bd0-bab7-ebcaab2dd058\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"
Sep 10 23:17:32.810063 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.809853    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80b22500-c489-45b4-ad71-0d84333208d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs\" (UID: \"80b22500-c489-45b4-ad71-0d84333208d5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"
Sep 10 23:17:32.810063 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.809891    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpct2\" (UniqueName: \"kubernetes.io/projected/80b22500-c489-45b4-ad71-0d84333208d5-kube-api-access-vpct2\") pod \"payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs\" (UID: \"80b22500-c489-45b4-ad71-0d84333208d5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"
Sep 10 23:17:32.810063 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.809945    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53531aa0-28e3-4bd0-bab7-ebcaab2dd058-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g\" (UID: \"53531aa0-28e3-4bd0-bab7-ebcaab2dd058\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"
Sep 10 23:17:32.854950 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.854923    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:17:32.911378 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.911337    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt64s\" (UniqueName: \"kubernetes.io/projected/53531aa0-28e3-4bd0-bab7-ebcaab2dd058-kube-api-access-pt64s\") pod \"payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g\" (UID: \"53531aa0-28e3-4bd0-bab7-ebcaab2dd058\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"
Sep 10 23:17:32.911605 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.911487    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80b22500-c489-45b4-ad71-0d84333208d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs\" (UID: \"80b22500-c489-45b4-ad71-0d84333208d5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"
Sep 10 23:17:32.911605 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.911521    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpct2\" (UniqueName: \"kubernetes.io/projected/80b22500-c489-45b4-ad71-0d84333208d5-kube-api-access-vpct2\") pod \"payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs\" (UID: \"80b22500-c489-45b4-ad71-0d84333208d5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"
Sep 10 23:17:32.911605 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.911586    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53531aa0-28e3-4bd0-bab7-ebcaab2dd058-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g\" (UID: \"53531aa0-28e3-4bd0-bab7-ebcaab2dd058\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"
Sep 10 23:17:32.912333 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.912308    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80b22500-c489-45b4-ad71-0d84333208d5-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs\" (UID: \"80b22500-c489-45b4-ad71-0d84333208d5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"
Sep 10 23:17:32.912437 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.912335    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53531aa0-28e3-4bd0-bab7-ebcaab2dd058-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g\" (UID: \"53531aa0-28e3-4bd0-bab7-ebcaab2dd058\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"
Sep 10 23:17:32.919782 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.919757    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt64s\" (UniqueName: \"kubernetes.io/projected/53531aa0-28e3-4bd0-bab7-ebcaab2dd058-kube-api-access-pt64s\") pod \"payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g\" (UID: \"53531aa0-28e3-4bd0-bab7-ebcaab2dd058\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"
Sep 10 23:17:32.919862 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.919825    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpct2\" (UniqueName: \"kubernetes.io/projected/80b22500-c489-45b4-ad71-0d84333208d5-kube-api-access-vpct2\") pod \"payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs\" (UID: \"80b22500-c489-45b4-ad71-0d84333208d5\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"
Sep 10 23:17:32.934692 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.934672    2585 generic.go:356] "Generic (PLEG): container finished" podID="bdad65f5-77de-46b3-8d3c-46608760f15b" containerID="3da6abdaa15a9878958fac2fffee6e455cb6f3e2f9a548382315cd152775e6db" exitCode=0
Sep 10 23:17:32.934800 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.934725    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"
Sep 10 23:17:32.934800 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.934762    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l" event={"ID":"bdad65f5-77de-46b3-8d3c-46608760f15b","Type":"ContainerDied","Data":"3da6abdaa15a9878958fac2fffee6e455cb6f3e2f9a548382315cd152775e6db"}
Sep 10 23:17:32.934893 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.934820    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l" event={"ID":"bdad65f5-77de-46b3-8d3c-46608760f15b","Type":"ContainerDied","Data":"9520ff024985f7af84f7bff4d0848a4cd58e3e9eb70108dfc998debe7ba31ad9"}
Sep 10 23:17:32.934893 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.934849    2585 scope.go:117] "RemoveContainer" containerID="3da6abdaa15a9878958fac2fffee6e455cb6f3e2f9a548382315cd152775e6db"
Sep 10 23:17:32.936164 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.936144    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd" event={"ID":"e4219d8f-fc7c-40c2-b98a-85df737e6fd0","Type":"ContainerDied","Data":"af00f55723564fdb7edbc5fda2b12de8f84bca3513b22152c46f0c17d2688ffd"}
Sep 10 23:17:32.936257 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.936166    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd"
Sep 10 23:17:32.936257 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.936186    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af00f55723564fdb7edbc5fda2b12de8f84bca3513b22152c46f0c17d2688ffd"
Sep 10 23:17:32.943998 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.943981    2585 scope.go:117] "RemoveContainer" containerID="3da6abdaa15a9878958fac2fffee6e455cb6f3e2f9a548382315cd152775e6db"
Sep 10 23:17:32.944248 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:17:32.944230    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3da6abdaa15a9878958fac2fffee6e455cb6f3e2f9a548382315cd152775e6db\": container with ID starting with 3da6abdaa15a9878958fac2fffee6e455cb6f3e2f9a548382315cd152775e6db not found: ID does not exist" containerID="3da6abdaa15a9878958fac2fffee6e455cb6f3e2f9a548382315cd152775e6db"
Sep 10 23:17:32.944314 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:32.944254    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3da6abdaa15a9878958fac2fffee6e455cb6f3e2f9a548382315cd152775e6db"} err="failed to get container status \"3da6abdaa15a9878958fac2fffee6e455cb6f3e2f9a548382315cd152775e6db\": rpc error: code = NotFound desc = could not find container \"3da6abdaa15a9878958fac2fffee6e455cb6f3e2f9a548382315cd152775e6db\": container with ID starting with 3da6abdaa15a9878958fac2fffee6e455cb6f3e2f9a548382315cd152775e6db not found: ID does not exist"
Sep 10 23:17:33.012729 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.012696    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdad65f5-77de-46b3-8d3c-46608760f15b-istiod-ca-cert\") pod \"bdad65f5-77de-46b3-8d3c-46608760f15b\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") "
Sep 10 23:17:33.012886 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.012749    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-workload-certs\") pod \"bdad65f5-77de-46b3-8d3c-46608760f15b\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") "
Sep 10 23:17:33.012886 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.012791    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-workload-socket\") pod \"bdad65f5-77de-46b3-8d3c-46608760f15b\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") "
Sep 10 23:17:33.012998 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.012890    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d9lp\" (UniqueName: \"kubernetes.io/projected/bdad65f5-77de-46b3-8d3c-46608760f15b-kube-api-access-4d9lp\") pod \"bdad65f5-77de-46b3-8d3c-46608760f15b\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") "
Sep 10 23:17:33.012998 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.012948    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-envoy\") pod \"bdad65f5-77de-46b3-8d3c-46608760f15b\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") "
Sep 10 23:17:33.013113 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013015    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bdad65f5-77de-46b3-8d3c-46608760f15b" (UID: "bdad65f5-77de-46b3-8d3c-46608760f15b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:33.013113 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013029    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bdad65f5-77de-46b3-8d3c-46608760f15b" (UID: "bdad65f5-77de-46b3-8d3c-46608760f15b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:33.013113 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013021    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-credential-socket\") pod \"bdad65f5-77de-46b3-8d3c-46608760f15b\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") "
Sep 10 23:17:33.013113 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013085    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdad65f5-77de-46b3-8d3c-46608760f15b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bdad65f5-77de-46b3-8d3c-46608760f15b" (UID: "bdad65f5-77de-46b3-8d3c-46608760f15b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:17:33.013324 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013153    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-token\") pod \"bdad65f5-77de-46b3-8d3c-46608760f15b\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") "
Sep 10 23:17:33.013324 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013242    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-podinfo\") pod \"bdad65f5-77de-46b3-8d3c-46608760f15b\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") "
Sep 10 23:17:33.013324 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013255    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bdad65f5-77de-46b3-8d3c-46608760f15b" (UID: "bdad65f5-77de-46b3-8d3c-46608760f15b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:33.013324 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013286    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-data\") pod \"bdad65f5-77de-46b3-8d3c-46608760f15b\" (UID: \"bdad65f5-77de-46b3-8d3c-46608760f15b\") "
Sep 10 23:17:33.013530 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013514    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-data" (OuterVolumeSpecName: "istio-data") pod "bdad65f5-77de-46b3-8d3c-46608760f15b" (UID: "bdad65f5-77de-46b3-8d3c-46608760f15b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:33.013678 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013662    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:33.013741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013679    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bdad65f5-77de-46b3-8d3c-46608760f15b-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:33.013741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013689    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:33.013741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013701    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:33.013741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.013715    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:33.015091 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.015069    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdad65f5-77de-46b3-8d3c-46608760f15b-kube-api-access-4d9lp" (OuterVolumeSpecName: "kube-api-access-4d9lp") pod "bdad65f5-77de-46b3-8d3c-46608760f15b" (UID: "bdad65f5-77de-46b3-8d3c-46608760f15b"). InnerVolumeSpecName "kube-api-access-4d9lp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:17:33.015217 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.015202    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bdad65f5-77de-46b3-8d3c-46608760f15b" (UID: "bdad65f5-77de-46b3-8d3c-46608760f15b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:17:33.015471 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.015445    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bdad65f5-77de-46b3-8d3c-46608760f15b" (UID: "bdad65f5-77de-46b3-8d3c-46608760f15b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:33.015471 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.015457    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-token" (OuterVolumeSpecName: "istio-token") pod "bdad65f5-77de-46b3-8d3c-46608760f15b" (UID: "bdad65f5-77de-46b3-8d3c-46608760f15b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:17:33.020640 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.020619    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"
Sep 10 23:17:33.044887 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.044861    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"
Sep 10 23:17:33.116131 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.114757    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:33.116131 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.114789    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:33.116131 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.114805    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d9lp\" (UniqueName: \"kubernetes.io/projected/bdad65f5-77de-46b3-8d3c-46608760f15b-kube-api-access-4d9lp\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:33.116131 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.114821    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bdad65f5-77de-46b3-8d3c-46608760f15b-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:33.262935 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.262906    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"]
Sep 10 23:17:33.266860 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.266837    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-5ea2db-openshift-default-5bcbdfb758-xr86l"]
Sep 10 23:17:33.315364 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.315337    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"]
Sep 10 23:17:33.316797 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:17:33.316768    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80b22500_c489_45b4_ad71_0d84333208d5.slice/crio-3822b89a99ba5d76243a1fb74610a0c1fa80c8e4c44a0e0c64259a6cbcd5b21a WatchSource:0}: Error finding container 3822b89a99ba5d76243a1fb74610a0c1fa80c8e4c44a0e0c64259a6cbcd5b21a: Status 404 returned error can't find the container with id 3822b89a99ba5d76243a1fb74610a0c1fa80c8e4c44a0e0c64259a6cbcd5b21a
Sep 10 23:17:33.352936 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.352912    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"]
Sep 10 23:17:33.356594 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:17:33.355979    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53531aa0_28e3_4bd0_bab7_ebcaab2dd058.slice/crio-d9460d356332870ecd17770dc16b64a9293f45756e0d0ecadb0beb7dfc028fec WatchSource:0}: Error finding container d9460d356332870ecd17770dc16b64a9293f45756e0d0ecadb0beb7dfc028fec: Status 404 returned error can't find the container with id d9460d356332870ecd17770dc16b64a9293f45756e0d0ecadb0beb7dfc028fec
Sep 10 23:17:33.945035 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.944992    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g" event={"ID":"53531aa0-28e3-4bd0-bab7-ebcaab2dd058","Type":"ContainerStarted","Data":"10a97716a1ea0b71d850ecb1336dbf8481d583b5ed505e32ca984b87235e0f14"}
Sep 10 23:17:33.945200 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.945058    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g" event={"ID":"53531aa0-28e3-4bd0-bab7-ebcaab2dd058","Type":"ContainerStarted","Data":"d9460d356332870ecd17770dc16b64a9293f45756e0d0ecadb0beb7dfc028fec"}
Sep 10 23:17:33.945269 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.945196    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"
Sep 10 23:17:33.946634 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.946612    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs" event={"ID":"80b22500-c489-45b4-ad71-0d84333208d5","Type":"ContainerStarted","Data":"b8949225e1a24103393e4082a3f89bf11b9b536076fadf373bd799987d37cdf4"}
Sep 10 23:17:33.946751 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.946648    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs" event={"ID":"80b22500-c489-45b4-ad71-0d84333208d5","Type":"ContainerStarted","Data":"3822b89a99ba5d76243a1fb74610a0c1fa80c8e4c44a0e0c64259a6cbcd5b21a"}
Sep 10 23:17:33.946751 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.946729    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"
Sep 10 23:17:33.961601 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.961541    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g" podStartSLOduration=1.961527317 podStartE2EDuration="1.961527317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:17:33.960516893 +0000 UTC m=+1166.139387877" watchObservedRunningTime="2026-09-10 23:17:33.961527317 +0000 UTC m=+1166.140398280"
Sep 10 23:17:33.978524 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:33.978480    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs" podStartSLOduration=1.978464979 podStartE2EDuration="1.978464979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:17:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:17:33.975551177 +0000 UTC m=+1166.154422157" watchObservedRunningTime="2026-09-10 23:17:33.978464979 +0000 UTC m=+1166.157335941"
Sep 10 23:17:34.341881 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:34.341848    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdad65f5-77de-46b3-8d3c-46608760f15b" path="/var/lib/kubelet/pods/bdad65f5-77de-46b3-8d3c-46608760f15b/volumes"
Sep 10 23:17:39.538899 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.536924    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"]
Sep 10 23:17:39.538899 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.537791    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr" podUID="40aa4734-f044-416c-bb45-226b0ebf6a54" containerName="payload-processing" containerID="cri-o://4e4a8bb37558a7bf6153a4764a4abf3f67782ee9a1d1a2be57e112b978bad6a9" gracePeriod=30
Sep 10 23:17:39.541591 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.541536    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"]
Sep 10 23:17:39.542089 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.542060    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt" podUID="e50f01d8-2de3-4691-acad-2bdfcd262a41" containerName="payload-pre-processing" containerID="cri-o://9fe1720cbd5bd2dcf88468727bccfe194359db9ec7d560516166a034e444eef2" gracePeriod=30
Sep 10 23:17:39.673829 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.673613    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd"]
Sep 10 23:17:39.676151 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.676124    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-28dbae-78nnd"]
Sep 10 23:17:39.861289 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.861263    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"
Sep 10 23:17:39.885156 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.885128    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"
Sep 10 23:17:39.985783 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.985754    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"
Sep 10 23:17:39.985783 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.985764    2585 generic.go:356] "Generic (PLEG): container finished" podID="40aa4734-f044-416c-bb45-226b0ebf6a54" containerID="4e4a8bb37558a7bf6153a4764a4abf3f67782ee9a1d1a2be57e112b978bad6a9" exitCode=0
Sep 10 23:17:39.985783 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.985783    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr" event={"ID":"40aa4734-f044-416c-bb45-226b0ebf6a54","Type":"ContainerDied","Data":"4e4a8bb37558a7bf6153a4764a4abf3f67782ee9a1d1a2be57e112b978bad6a9"}
Sep 10 23:17:39.986013 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.985835    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr" event={"ID":"40aa4734-f044-416c-bb45-226b0ebf6a54","Type":"ContainerDied","Data":"f25457f0ac53d2af3e7c0fe06fbb08c81857f6bdb1a3f50d3467c3f61159a146"}
Sep 10 23:17:39.986013 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.985859    2585 scope.go:117] "RemoveContainer" containerID="4e4a8bb37558a7bf6153a4764a4abf3f67782ee9a1d1a2be57e112b978bad6a9"
Sep 10 23:17:39.986013 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.985996    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40aa4734-f044-416c-bb45-226b0ebf6a54-plugins-config-volume\") pod \"40aa4734-f044-416c-bb45-226b0ebf6a54\" (UID: \"40aa4734-f044-416c-bb45-226b0ebf6a54\") "
Sep 10 23:17:39.986112 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.986089    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e50f01d8-2de3-4691-acad-2bdfcd262a41-plugins-config-volume\") pod \"e50f01d8-2de3-4691-acad-2bdfcd262a41\" (UID: \"e50f01d8-2de3-4691-acad-2bdfcd262a41\") "
Sep 10 23:17:39.986150 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.986117    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7j8g\" (UniqueName: \"kubernetes.io/projected/e50f01d8-2de3-4691-acad-2bdfcd262a41-kube-api-access-v7j8g\") pod \"e50f01d8-2de3-4691-acad-2bdfcd262a41\" (UID: \"e50f01d8-2de3-4691-acad-2bdfcd262a41\") "
Sep 10 23:17:39.986184 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.986151    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79cnk\" (UniqueName: \"kubernetes.io/projected/40aa4734-f044-416c-bb45-226b0ebf6a54-kube-api-access-79cnk\") pod \"40aa4734-f044-416c-bb45-226b0ebf6a54\" (UID: \"40aa4734-f044-416c-bb45-226b0ebf6a54\") "
Sep 10 23:17:39.986610 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.986500    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e50f01d8-2de3-4691-acad-2bdfcd262a41-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e50f01d8-2de3-4691-acad-2bdfcd262a41" (UID: "e50f01d8-2de3-4691-acad-2bdfcd262a41"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:17:39.986610 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.986579    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40aa4734-f044-416c-bb45-226b0ebf6a54-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "40aa4734-f044-416c-bb45-226b0ebf6a54" (UID: "40aa4734-f044-416c-bb45-226b0ebf6a54"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:17:39.987668 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.987641    2585 generic.go:356] "Generic (PLEG): container finished" podID="e50f01d8-2de3-4691-acad-2bdfcd262a41" containerID="9fe1720cbd5bd2dcf88468727bccfe194359db9ec7d560516166a034e444eef2" exitCode=0
Sep 10 23:17:39.987722 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.987696    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt" event={"ID":"e50f01d8-2de3-4691-acad-2bdfcd262a41","Type":"ContainerDied","Data":"9fe1720cbd5bd2dcf88468727bccfe194359db9ec7d560516166a034e444eef2"}
Sep 10 23:17:39.987764 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.987737    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt" event={"ID":"e50f01d8-2de3-4691-acad-2bdfcd262a41","Type":"ContainerDied","Data":"86d43824568dd76de11bd7faf6d264b348a935f02acd4d9b093fcba4fd2af95e"}
Sep 10 23:17:39.987796 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.987757    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"
Sep 10 23:17:39.988447 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.988425    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e50f01d8-2de3-4691-acad-2bdfcd262a41-kube-api-access-v7j8g" (OuterVolumeSpecName: "kube-api-access-v7j8g") pod "e50f01d8-2de3-4691-acad-2bdfcd262a41" (UID: "e50f01d8-2de3-4691-acad-2bdfcd262a41"). InnerVolumeSpecName "kube-api-access-v7j8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:17:39.988524 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:39.988462    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40aa4734-f044-416c-bb45-226b0ebf6a54-kube-api-access-79cnk" (OuterVolumeSpecName: "kube-api-access-79cnk") pod "40aa4734-f044-416c-bb45-226b0ebf6a54" (UID: "40aa4734-f044-416c-bb45-226b0ebf6a54"). InnerVolumeSpecName "kube-api-access-79cnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:17:40.008242 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.008218    2585 scope.go:117] "RemoveContainer" containerID="4e4a8bb37558a7bf6153a4764a4abf3f67782ee9a1d1a2be57e112b978bad6a9"
Sep 10 23:17:40.009010 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:17:40.008884    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4a8bb37558a7bf6153a4764a4abf3f67782ee9a1d1a2be57e112b978bad6a9\": container with ID starting with 4e4a8bb37558a7bf6153a4764a4abf3f67782ee9a1d1a2be57e112b978bad6a9 not found: ID does not exist" containerID="4e4a8bb37558a7bf6153a4764a4abf3f67782ee9a1d1a2be57e112b978bad6a9"
Sep 10 23:17:40.009010 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.008921    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4a8bb37558a7bf6153a4764a4abf3f67782ee9a1d1a2be57e112b978bad6a9"} err="failed to get container status \"4e4a8bb37558a7bf6153a4764a4abf3f67782ee9a1d1a2be57e112b978bad6a9\": rpc error: code = NotFound desc = could not find container \"4e4a8bb37558a7bf6153a4764a4abf3f67782ee9a1d1a2be57e112b978bad6a9\": container with ID starting with 4e4a8bb37558a7bf6153a4764a4abf3f67782ee9a1d1a2be57e112b978bad6a9 not found: ID does not exist"
Sep 10 23:17:40.009010 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.008946    2585 scope.go:117] "RemoveContainer" containerID="9fe1720cbd5bd2dcf88468727bccfe194359db9ec7d560516166a034e444eef2"
Sep 10 23:17:40.030976 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.030956    2585 scope.go:117] "RemoveContainer" containerID="9fe1720cbd5bd2dcf88468727bccfe194359db9ec7d560516166a034e444eef2"
Sep 10 23:17:40.031266 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:17:40.031249    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9fe1720cbd5bd2dcf88468727bccfe194359db9ec7d560516166a034e444eef2\": container with ID starting with 9fe1720cbd5bd2dcf88468727bccfe194359db9ec7d560516166a034e444eef2 not found: ID does not exist" containerID="9fe1720cbd5bd2dcf88468727bccfe194359db9ec7d560516166a034e444eef2"
Sep 10 23:17:40.031319 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.031273    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9fe1720cbd5bd2dcf88468727bccfe194359db9ec7d560516166a034e444eef2"} err="failed to get container status \"9fe1720cbd5bd2dcf88468727bccfe194359db9ec7d560516166a034e444eef2\": rpc error: code = NotFound desc = could not find container \"9fe1720cbd5bd2dcf88468727bccfe194359db9ec7d560516166a034e444eef2\": container with ID starting with 9fe1720cbd5bd2dcf88468727bccfe194359db9ec7d560516166a034e444eef2 not found: ID does not exist"
Sep 10 23:17:40.088060 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.087956    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40aa4734-f044-416c-bb45-226b0ebf6a54-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:40.088060 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.088002    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e50f01d8-2de3-4691-acad-2bdfcd262a41-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:40.088060 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.088012    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7j8g\" (UniqueName: \"kubernetes.io/projected/e50f01d8-2de3-4691-acad-2bdfcd262a41-kube-api-access-v7j8g\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:40.088060 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.088022    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79cnk\" (UniqueName: \"kubernetes.io/projected/40aa4734-f044-416c-bb45-226b0ebf6a54-kube-api-access-79cnk\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:40.318804 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.318763    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"]
Sep 10 23:17:40.327764 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.327727    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-28dbae-5b6d54b6f7-vrmmr"]
Sep 10 23:17:40.342741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.342629    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40aa4734-f044-416c-bb45-226b0ebf6a54" path="/var/lib/kubelet/pods/40aa4734-f044-416c-bb45-226b0ebf6a54/volumes"
Sep 10 23:17:40.343217 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.343155    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4219d8f-fc7c-40c2-b98a-85df737e6fd0" path="/var/lib/kubelet/pods/e4219d8f-fc7c-40c2-b98a-85df737e6fd0/volumes"
Sep 10 23:17:40.343611 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.343590    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"]
Sep 10 23:17:40.343700 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:40.343633    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-28dbae-5cb4ccbdf4-2tqbt"]
Sep 10 23:17:42.346239 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:42.346193    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e50f01d8-2de3-4691-acad-2bdfcd262a41" path="/var/lib/kubelet/pods/e50f01d8-2de3-4691-acad-2bdfcd262a41/volumes"
Sep 10 23:17:44.955084 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:44.955049    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"
Sep 10 23:17:44.955599 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:44.955254    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"
Sep 10 23:17:45.948801 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:45.948756    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 23:17:45.948964 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:45.948854    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:17:46.474007 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.473261    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"]
Sep 10 23:17:46.474007 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.473522    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" podUID="09798020-4363-4103-9577-fca7a6aba795" containerName="istio-proxy" containerID="cri-o://8c8dc8d7e427e17306436cee718eae23aa668fe296145ed762ce32f5f44a77cb" gracePeriod=30
Sep 10 23:17:46.816481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.816438    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj"]
Sep 10 23:17:46.816949 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.816929    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40aa4734-f044-416c-bb45-226b0ebf6a54" containerName="payload-processing"
Sep 10 23:17:46.817050 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.816951    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="40aa4734-f044-416c-bb45-226b0ebf6a54" containerName="payload-processing"
Sep 10 23:17:46.817050 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.816968    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50f01d8-2de3-4691-acad-2bdfcd262a41" containerName="payload-pre-processing"
Sep 10 23:17:46.817050 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.816975    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50f01d8-2de3-4691-acad-2bdfcd262a41" containerName="payload-pre-processing"
Sep 10 23:17:46.817050 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.817015    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdad65f5-77de-46b3-8d3c-46608760f15b" containerName="istio-proxy"
Sep 10 23:17:46.817050 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.817023    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdad65f5-77de-46b3-8d3c-46608760f15b" containerName="istio-proxy"
Sep 10 23:17:46.817297 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.817119    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="40aa4734-f044-416c-bb45-226b0ebf6a54" containerName="payload-processing"
Sep 10 23:17:46.817297 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.817132    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdad65f5-77de-46b3-8d3c-46608760f15b" containerName="istio-proxy"
Sep 10 23:17:46.817297 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.817142    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e50f01d8-2de3-4691-acad-2bdfcd262a41" containerName="payload-pre-processing"
Sep 10 23:17:46.821872 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.821850    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj"
Sep 10 23:17:46.824346 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.824326    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:17:46.824462 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.824404    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:17:46.828820 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.828793    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj"]
Sep 10 23:17:46.962579 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:46.962529    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj\" (UID: \"a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj"
Sep 10 23:17:47.064096 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:47.064058    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj\" (UID: \"a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj"
Sep 10 23:17:47.064737 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:47.064715    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj\" (UID: \"a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj"
Sep 10 23:17:47.135337 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:47.135255    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj"
Sep 10 23:17:47.425823 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:47.425796    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj"]
Sep 10 23:17:47.463635 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:17:47.463596    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda804f8eb_d90b_4aa5_82f2_5dfa5df6b6ec.slice/crio-7f1a759ccb9653a1c28292cb6f924816c7bae3dc4483165f8d2f61aaf58284f9 WatchSource:0}: Error finding container 7f1a759ccb9653a1c28292cb6f924816c7bae3dc4483165f8d2f61aaf58284f9: Status 404 returned error can't find the container with id 7f1a759ccb9653a1c28292cb6f924816c7bae3dc4483165f8d2f61aaf58284f9
Sep 10 23:17:48.057762 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:48.057719    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj" event={"ID":"a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec","Type":"ContainerStarted","Data":"20182c53a066acd905c47143630db6a8567e2e94c5af29fb220c293b79844207"}
Sep 10 23:17:48.058281 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:48.057827    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj" event={"ID":"a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec","Type":"ContainerStarted","Data":"7f1a759ccb9653a1c28292cb6f924816c7bae3dc4483165f8d2f61aaf58284f9"}
Sep 10 23:17:48.059498 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:48.059475    2585 generic.go:356] "Generic (PLEG): container finished" podID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerID="0b8edc7bac6ba6588d78308e225ae6830f39fae3981bd823f45fc6961bd49b34" exitCode=0
Sep 10 23:17:48.059591 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:48.059527    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" event={"ID":"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3","Type":"ContainerDied","Data":"0b8edc7bac6ba6588d78308e225ae6830f39fae3981bd823f45fc6961bd49b34"}
Sep 10 23:17:48.059908 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:48.059894    2585 scope.go:117] "RemoveContainer" containerID="0b8edc7bac6ba6588d78308e225ae6830f39fae3981bd823f45fc6961bd49b34"
Sep 10 23:17:48.060935 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:48.060903    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:17:48.061062 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:48.060992    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:17:48.061062 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:48.061041    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:17:48.074598 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:48.074532    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj" podStartSLOduration=2.074515925 podStartE2EDuration="2.074515925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:17:48.072185167 +0000 UTC m=+1180.251056132" watchObservedRunningTime="2026-09-10 23:17:48.074515925 +0000 UTC m=+1180.253386887"
Sep 10 23:17:49.067686 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:49.067645    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" event={"ID":"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3","Type":"ContainerStarted","Data":"c8dbd3a56102e085bb11e5d2868ad1aeb25c970bacd34f2b80958c72d2f4a3ab"}
Sep 10 23:17:49.069243 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:49.069217    2585 generic.go:356] "Generic (PLEG): container finished" podID="a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec" containerID="20182c53a066acd905c47143630db6a8567e2e94c5af29fb220c293b79844207" exitCode=0
Sep 10 23:17:49.069355 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:49.069253    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj" event={"ID":"a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec","Type":"ContainerDied","Data":"20182c53a066acd905c47143630db6a8567e2e94c5af29fb220c293b79844207"}
Sep 10 23:17:49.828949 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:49.828906    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:49.829205 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:49.829178    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 23:17:49.829299 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:49.829240    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 23:17:50.267114 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:50.267090    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj"
Sep 10 23:17:50.412634 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:50.411947    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec-maas-api-service-ca\") pod \"a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec\" (UID: \"a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec\") "
Sep 10 23:17:50.412816 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:50.412657    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec" (UID: "a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:17:50.513609 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:50.513571    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec-maas-api-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:50.829362 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:50.829328    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 23:17:50.829593 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:50.829392    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 23:17:51.084423 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.084341    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj"
Sep 10 23:17:51.084423 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.084384    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj" event={"ID":"a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec","Type":"ContainerDied","Data":"7f1a759ccb9653a1c28292cb6f924816c7bae3dc4483165f8d2f61aaf58284f9"}
Sep 10 23:17:51.084641 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.084431    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7f1a759ccb9653a1c28292cb6f924816c7bae3dc4483165f8d2f61aaf58284f9"
Sep 10 23:17:51.770555 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.770529    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:17:51.829146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.829105    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 23:17:51.829318 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.829177    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 23:17:51.930372 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.930338    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld4hf\" (UniqueName: \"kubernetes.io/projected/09798020-4363-4103-9577-fca7a6aba795-kube-api-access-ld4hf\") pod \"09798020-4363-4103-9577-fca7a6aba795\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") "
Sep 10 23:17:51.931132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.930381    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-workload-socket\") pod \"09798020-4363-4103-9577-fca7a6aba795\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") "
Sep 10 23:17:51.931132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.930419    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-istio-envoy\") pod \"09798020-4363-4103-9577-fca7a6aba795\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") "
Sep 10 23:17:51.931132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.930460    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-credential-socket\") pod \"09798020-4363-4103-9577-fca7a6aba795\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") "
Sep 10 23:17:51.931132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.930516    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-workload-certs\") pod \"09798020-4363-4103-9577-fca7a6aba795\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") "
Sep 10 23:17:51.931132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.930546    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09798020-4363-4103-9577-fca7a6aba795-istio-podinfo\") pod \"09798020-4363-4103-9577-fca7a6aba795\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") "
Sep 10 23:17:51.931132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.930593    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09798020-4363-4103-9577-fca7a6aba795-istiod-ca-cert\") pod \"09798020-4363-4103-9577-fca7a6aba795\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") "
Sep 10 23:17:51.931132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.930615    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-istio-data\") pod \"09798020-4363-4103-9577-fca7a6aba795\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") "
Sep 10 23:17:51.931132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.930760    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "09798020-4363-4103-9577-fca7a6aba795" (UID: "09798020-4363-4103-9577-fca7a6aba795"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:51.931132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.930797    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "09798020-4363-4103-9577-fca7a6aba795" (UID: "09798020-4363-4103-9577-fca7a6aba795"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:51.931132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.930854    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09798020-4363-4103-9577-fca7a6aba795-istio-token\") pod \"09798020-4363-4103-9577-fca7a6aba795\" (UID: \"09798020-4363-4103-9577-fca7a6aba795\") "
Sep 10 23:17:51.931132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.930863    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-istio-data" (OuterVolumeSpecName: "istio-data") pod "09798020-4363-4103-9577-fca7a6aba795" (UID: "09798020-4363-4103-9577-fca7a6aba795"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:51.931132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.930998    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "09798020-4363-4103-9577-fca7a6aba795" (UID: "09798020-4363-4103-9577-fca7a6aba795"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:51.931132 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.931035    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09798020-4363-4103-9577-fca7a6aba795-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "09798020-4363-4103-9577-fca7a6aba795" (UID: "09798020-4363-4103-9577-fca7a6aba795"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:17:51.931770 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.931228    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:51.931770 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.931248    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:51.931770 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.931261    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:51.931770 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.931274    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/09798020-4363-4103-9577-fca7a6aba795-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:51.931770 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.931287    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:51.933178 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.933148    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/09798020-4363-4103-9577-fca7a6aba795-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "09798020-4363-4103-9577-fca7a6aba795" (UID: "09798020-4363-4103-9577-fca7a6aba795"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:17:51.933327 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.933305    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "09798020-4363-4103-9577-fca7a6aba795" (UID: "09798020-4363-4103-9577-fca7a6aba795"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:17:51.933400 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.933325    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09798020-4363-4103-9577-fca7a6aba795-kube-api-access-ld4hf" (OuterVolumeSpecName: "kube-api-access-ld4hf") pod "09798020-4363-4103-9577-fca7a6aba795" (UID: "09798020-4363-4103-9577-fca7a6aba795"). InnerVolumeSpecName "kube-api-access-ld4hf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:17:51.933400 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:51.933339    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09798020-4363-4103-9577-fca7a6aba795-istio-token" (OuterVolumeSpecName: "istio-token") pod "09798020-4363-4103-9577-fca7a6aba795" (UID: "09798020-4363-4103-9577-fca7a6aba795"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:17:52.032143 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.032058    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/09798020-4363-4103-9577-fca7a6aba795-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:52.032143 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.032087    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/09798020-4363-4103-9577-fca7a6aba795-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:52.032143 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.032098    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld4hf\" (UniqueName: \"kubernetes.io/projected/09798020-4363-4103-9577-fca7a6aba795-kube-api-access-ld4hf\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:52.032143 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.032108    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/09798020-4363-4103-9577-fca7a6aba795-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:52.091978 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.091943    2585 generic.go:356] "Generic (PLEG): container finished" podID="09798020-4363-4103-9577-fca7a6aba795" containerID="8c8dc8d7e427e17306436cee718eae23aa668fe296145ed762ce32f5f44a77cb" exitCode=0
Sep 10 23:17:52.092180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.091995    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"
Sep 10 23:17:52.092180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.092016    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" event={"ID":"09798020-4363-4103-9577-fca7a6aba795","Type":"ContainerDied","Data":"8c8dc8d7e427e17306436cee718eae23aa668fe296145ed762ce32f5f44a77cb"}
Sep 10 23:17:52.092180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.092096    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr" event={"ID":"09798020-4363-4103-9577-fca7a6aba795","Type":"ContainerDied","Data":"7b6b24f611fa7f8fb26bb651772705414ecad52716e335100e23539de77767ce"}
Sep 10 23:17:52.092180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.092128    2585 scope.go:117] "RemoveContainer" containerID="8c8dc8d7e427e17306436cee718eae23aa668fe296145ed762ce32f5f44a77cb"
Sep 10 23:17:52.109400 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.109029    2585 scope.go:117] "RemoveContainer" containerID="6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6"
Sep 10 23:17:52.124398 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.124369    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"]
Sep 10 23:17:52.129149 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.129117    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-28dbae-openshift-default-6659c6d5bb-tnsgr"]
Sep 10 23:17:52.130441 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.130153    2585 scope.go:117] "RemoveContainer" containerID="8c8dc8d7e427e17306436cee718eae23aa668fe296145ed762ce32f5f44a77cb"
Sep 10 23:17:52.130680 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:17:52.130650    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c8dc8d7e427e17306436cee718eae23aa668fe296145ed762ce32f5f44a77cb\": container with ID starting with 8c8dc8d7e427e17306436cee718eae23aa668fe296145ed762ce32f5f44a77cb not found: ID does not exist" containerID="8c8dc8d7e427e17306436cee718eae23aa668fe296145ed762ce32f5f44a77cb"
Sep 10 23:17:52.130784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.130693    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c8dc8d7e427e17306436cee718eae23aa668fe296145ed762ce32f5f44a77cb"} err="failed to get container status \"8c8dc8d7e427e17306436cee718eae23aa668fe296145ed762ce32f5f44a77cb\": rpc error: code = NotFound desc = could not find container \"8c8dc8d7e427e17306436cee718eae23aa668fe296145ed762ce32f5f44a77cb\": container with ID starting with 8c8dc8d7e427e17306436cee718eae23aa668fe296145ed762ce32f5f44a77cb not found: ID does not exist"
Sep 10 23:17:52.130784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.130718    2585 scope.go:117] "RemoveContainer" containerID="6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6"
Sep 10 23:17:52.131186 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:17:52.131132    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6\": container with ID starting with 6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6 not found: ID does not exist" containerID="6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6"
Sep 10 23:17:52.131247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.131196    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6"} err="failed to get container status \"6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6\": rpc error: code = NotFound desc = could not find container \"6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6\": container with ID starting with 6efd1d7ce17c668b5c65020f03a8a3972da5bf52c932cd04075b50a9bceef3d6 not found: ID does not exist"
Sep 10 23:17:52.342016 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.341984    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09798020-4363-4103-9577-fca7a6aba795" path="/var/lib/kubelet/pods/09798020-4363-4103-9577-fca7a6aba795/volumes"
Sep 10 23:17:52.828845 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.828806    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 23:17:52.829265 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:52.828865    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 23:17:53.829119 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:53.829083    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused" start-of-body=
Sep 10 23:17:53.829595 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:53.829146    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.70:15021/healthz/ready\": dial tcp 10.134.0.70:15021: connect: connection refused"
Sep 10 23:17:54.832548 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:54.832511    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:54.832952 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:54.832807    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:54.833667 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:54.833626    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:17:56.389070 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.389037    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"]
Sep 10 23:17:56.389433 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.389418    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec" containerName="revoke-keys"
Sep 10 23:17:56.389433 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.389429    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec" containerName="revoke-keys"
Sep 10 23:17:56.389514 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.389439    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09798020-4363-4103-9577-fca7a6aba795" containerName="istio-proxy"
Sep 10 23:17:56.389514 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.389444    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="09798020-4363-4103-9577-fca7a6aba795" containerName="istio-proxy"
Sep 10 23:17:56.389514 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.389452    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09798020-4363-4103-9577-fca7a6aba795" containerName="istio-proxy"
Sep 10 23:17:56.389514 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.389458    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="09798020-4363-4103-9577-fca7a6aba795" containerName="istio-proxy"
Sep 10 23:17:56.389663 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.389521    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="09798020-4363-4103-9577-fca7a6aba795" containerName="istio-proxy"
Sep 10 23:17:56.389663 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.389527    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="09798020-4363-4103-9577-fca7a6aba795" containerName="istio-proxy"
Sep 10 23:17:56.389663 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.389537    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec" containerName="revoke-keys"
Sep 10 23:17:56.394021 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.393999    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.396404 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.396380    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-063e1d-openshift-default-dockercfg-p965k\""
Sep 10 23:17:56.407686 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.407659    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"]
Sep 10 23:17:56.474585 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.474513    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-podinfo\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.474766 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.474597    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxsbk\" (UniqueName: \"kubernetes.io/projected/d9fbe8c1-99be-4797-92a8-d889c80930b5-kube-api-access-pxsbk\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.474766 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.474638    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-data\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.474766 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.474668    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-workload-socket\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.474974 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.474761    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-workload-certs\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.474974 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.474829    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-token\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.474974 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.474862    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-credential-socket\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.474974 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.474912    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9fbe8c1-99be-4797-92a8-d889c80930b5-istiod-ca-cert\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.474974 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.474956    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-envoy\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.576464 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.576422    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-podinfo\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.576659 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.576488    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxsbk\" (UniqueName: \"kubernetes.io/projected/d9fbe8c1-99be-4797-92a8-d889c80930b5-kube-api-access-pxsbk\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.576659 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.576536    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-data\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.576659 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.576585    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-workload-socket\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.576659 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.576645    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-workload-certs\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.576911 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.576678    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-token\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.576911 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.576705    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-credential-socket\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.576911 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.576750    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9fbe8c1-99be-4797-92a8-d889c80930b5-istiod-ca-cert\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.576911 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.576782    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-envoy\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.577216 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.577183    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-workload-certs\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.577351 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.577237    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-credential-socket\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.577590 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.577553    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-data\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.577721 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.577695    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-workload-socket\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.578240 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.578160    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9fbe8c1-99be-4797-92a8-d889c80930b5-istiod-ca-cert\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.579309 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.579287    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-podinfo\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.579537 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.579514    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-envoy\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.586838 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.586813    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-token\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.587475 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.587452    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxsbk\" (UniqueName: \"kubernetes.io/projected/d9fbe8c1-99be-4797-92a8-d889c80930b5-kube-api-access-pxsbk\") pod \"e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") " pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.707492 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.707396    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:56.989642 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.989618    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"]
Sep 10 23:17:56.991151 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:17:56.991119    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9fbe8c1_99be_4797_92a8_d889c80930b5.slice/crio-0e8886b888efd516bb379513ba9bc2c94a17f8120564c910fce3e93c52a3cb5a WatchSource:0}: Error finding container 0e8886b888efd516bb379513ba9bc2c94a17f8120564c910fce3e93c52a3cb5a: Status 404 returned error can't find the container with id 0e8886b888efd516bb379513ba9bc2c94a17f8120564c910fce3e93c52a3cb5a
Sep 10 23:17:56.993428 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.993394    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:17:56.993499 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.993464    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:17:56.993499 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:56.993492    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:17:57.145770 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.145734    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" event={"ID":"d9fbe8c1-99be-4797-92a8-d889c80930b5","Type":"ContainerStarted","Data":"be05418e0bb0866279c94143d708ecbcd6a42c24eb4e6d425b9079fb58847ba1"}
Sep 10 23:17:57.145943 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.145787    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" event={"ID":"d9fbe8c1-99be-4797-92a8-d889c80930b5","Type":"ContainerStarted","Data":"0e8886b888efd516bb379513ba9bc2c94a17f8120564c910fce3e93c52a3cb5a"}
Sep 10 23:17:57.164495 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.164190    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" podStartSLOduration=1.164171268 podStartE2EDuration="1.164171268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:17:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:17:57.163290214 +0000 UTC m=+1189.342161177" watchObservedRunningTime="2026-09-10 23:17:57.164171268 +0000 UTC m=+1189.343042257"
Sep 10 23:17:57.542018 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.541988    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95"]
Sep 10 23:17:57.544356 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.544331    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-1f1f85-29818035-f6z95"]
Sep 10 23:17:57.576614 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.576579    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"]
Sep 10 23:17:57.576819 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.576796    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw" podUID="d8821535-249c-4e9b-91c8-572e0ac232eb" containerName="payload-pre-processing" containerID="cri-o://b7e1dd1363fc67923785d46b4cf74fc23ed2ad8f01f73533b8005cefa154ede7" gracePeriod=30
Sep 10 23:17:57.707519 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.707477    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:57.736753 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.736713    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj"]
Sep 10 23:17:57.739167 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.739139    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1f1f85-kpmnj"]
Sep 10 23:17:57.856029 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.855993    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"
Sep 10 23:17:57.890676 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.890638    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgggn\" (UniqueName: \"kubernetes.io/projected/d8821535-249c-4e9b-91c8-572e0ac232eb-kube-api-access-hgggn\") pod \"d8821535-249c-4e9b-91c8-572e0ac232eb\" (UID: \"d8821535-249c-4e9b-91c8-572e0ac232eb\") "
Sep 10 23:17:57.890866 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.890754    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8821535-249c-4e9b-91c8-572e0ac232eb-plugins-config-volume\") pod \"d8821535-249c-4e9b-91c8-572e0ac232eb\" (UID: \"d8821535-249c-4e9b-91c8-572e0ac232eb\") "
Sep 10 23:17:57.891127 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.891100    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8821535-249c-4e9b-91c8-572e0ac232eb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8821535-249c-4e9b-91c8-572e0ac232eb" (UID: "d8821535-249c-4e9b-91c8-572e0ac232eb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:17:57.892916 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.892885    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8821535-249c-4e9b-91c8-572e0ac232eb-kube-api-access-hgggn" (OuterVolumeSpecName: "kube-api-access-hgggn") pod "d8821535-249c-4e9b-91c8-572e0ac232eb" (UID: "d8821535-249c-4e9b-91c8-572e0ac232eb"). InnerVolumeSpecName "kube-api-access-hgggn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:17:57.991857 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.991815    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgggn\" (UniqueName: \"kubernetes.io/projected/d8821535-249c-4e9b-91c8-572e0ac232eb-kube-api-access-hgggn\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:57.991857 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:57.991849    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8821535-249c-4e9b-91c8-572e0ac232eb-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:17:58.154046 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:58.153958    2585 generic.go:356] "Generic (PLEG): container finished" podID="d8821535-249c-4e9b-91c8-572e0ac232eb" containerID="b7e1dd1363fc67923785d46b4cf74fc23ed2ad8f01f73533b8005cefa154ede7" exitCode=0
Sep 10 23:17:58.154046 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:58.154000    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"
Sep 10 23:17:58.154046 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:58.154036    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw" event={"ID":"d8821535-249c-4e9b-91c8-572e0ac232eb","Type":"ContainerDied","Data":"b7e1dd1363fc67923785d46b4cf74fc23ed2ad8f01f73533b8005cefa154ede7"}
Sep 10 23:17:58.154317 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:58.154105    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw" event={"ID":"d8821535-249c-4e9b-91c8-572e0ac232eb","Type":"ContainerDied","Data":"21ebc8dc24bd64d83d7a1e6c05698ff7529b9d95c29ba609fc15d0026d6ff383"}
Sep 10 23:17:58.154317 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:58.154138    2585 scope.go:117] "RemoveContainer" containerID="b7e1dd1363fc67923785d46b4cf74fc23ed2ad8f01f73533b8005cefa154ede7"
Sep 10 23:17:58.164302 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:58.164284    2585 scope.go:117] "RemoveContainer" containerID="b7e1dd1363fc67923785d46b4cf74fc23ed2ad8f01f73533b8005cefa154ede7"
Sep 10 23:17:58.164619 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:17:58.164602    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7e1dd1363fc67923785d46b4cf74fc23ed2ad8f01f73533b8005cefa154ede7\": container with ID starting with b7e1dd1363fc67923785d46b4cf74fc23ed2ad8f01f73533b8005cefa154ede7 not found: ID does not exist" containerID="b7e1dd1363fc67923785d46b4cf74fc23ed2ad8f01f73533b8005cefa154ede7"
Sep 10 23:17:58.164682 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:58.164627    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7e1dd1363fc67923785d46b4cf74fc23ed2ad8f01f73533b8005cefa154ede7"} err="failed to get container status \"b7e1dd1363fc67923785d46b4cf74fc23ed2ad8f01f73533b8005cefa154ede7\": rpc error: code = NotFound desc = could not find container \"b7e1dd1363fc67923785d46b4cf74fc23ed2ad8f01f73533b8005cefa154ede7\": container with ID starting with b7e1dd1363fc67923785d46b4cf74fc23ed2ad8f01f73533b8005cefa154ede7 not found: ID does not exist"
Sep 10 23:17:58.177935 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:58.177893    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"]
Sep 10 23:17:58.181847 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:58.181820    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-1f1f85-56dc85c874-z4gpw"]
Sep 10 23:17:58.343474 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:58.343439    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec" path="/var/lib/kubelet/pods/a804f8eb-d90b-4aa5-82f2-5dfa5df6b6ec/volumes"
Sep 10 23:17:58.343963 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:58.343946    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8821535-249c-4e9b-91c8-572e0ac232eb" path="/var/lib/kubelet/pods/d8821535-249c-4e9b-91c8-572e0ac232eb/volumes"
Sep 10 23:17:58.344280 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:58.344266    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcdebbda-3447-4e33-9bf0-5bceb846b972" path="/var/lib/kubelet/pods/fcdebbda-3447-4e33-9bf0-5bceb846b972/volumes"
Sep 10 23:17:58.712882 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:58.712854    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:59.161732 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:59.161694    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:17:59.162538 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:17:59.162518    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:18:00.810473 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:00.810408    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"]
Sep 10 23:18:00.811459 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:00.811027    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8821535-249c-4e9b-91c8-572e0ac232eb" containerName="payload-pre-processing"
Sep 10 23:18:00.811459 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:00.811049    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8821535-249c-4e9b-91c8-572e0ac232eb" containerName="payload-pre-processing"
Sep 10 23:18:00.811459 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:00.811168    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8821535-249c-4e9b-91c8-572e0ac232eb" containerName="payload-pre-processing"
Sep 10 23:18:00.815718 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:00.815693    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"
Sep 10 23:18:00.818145 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:00.818113    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-063e1d-dockercfg-fh96c\""
Sep 10 23:18:00.818145 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:00.818137    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-063e1d\""
Sep 10 23:18:00.824885 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:00.824856    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"]
Sep 10 23:18:00.923806 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:00.923773    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6snsv\" (UniqueName: \"kubernetes.io/projected/ffda0458-fa4b-485b-8d7d-ed8b5cb3f813-kube-api-access-6snsv\") pod \"payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn\" (UID: \"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"
Sep 10 23:18:00.924015 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:00.923829    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffda0458-fa4b-485b-8d7d-ed8b5cb3f813-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn\" (UID: \"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"
Sep 10 23:18:01.025374 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:01.025335    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffda0458-fa4b-485b-8d7d-ed8b5cb3f813-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn\" (UID: \"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"
Sep 10 23:18:01.025626 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:01.025486    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6snsv\" (UniqueName: \"kubernetes.io/projected/ffda0458-fa4b-485b-8d7d-ed8b5cb3f813-kube-api-access-6snsv\") pod \"payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn\" (UID: \"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"
Sep 10 23:18:01.026152 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:01.026131    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffda0458-fa4b-485b-8d7d-ed8b5cb3f813-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn\" (UID: \"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"
Sep 10 23:18:01.033807 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:01.033782    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6snsv\" (UniqueName: \"kubernetes.io/projected/ffda0458-fa4b-485b-8d7d-ed8b5cb3f813-kube-api-access-6snsv\") pod \"payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn\" (UID: \"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"
Sep 10 23:18:01.128467 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:01.128378    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"
Sep 10 23:18:01.403404 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:01.403370    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"]
Sep 10 23:18:01.403613 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:18:01.403583    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffda0458_fa4b_485b_8d7d_ed8b5cb3f813.slice/crio-b1853e1ae54e3d9064e0c1ee265e7140d24678cdca50a19a1a03865c34223300 WatchSource:0}: Error finding container b1853e1ae54e3d9064e0c1ee265e7140d24678cdca50a19a1a03865c34223300: Status 404 returned error can't find the container with id b1853e1ae54e3d9064e0c1ee265e7140d24678cdca50a19a1a03865c34223300
Sep 10 23:18:02.184925 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:02.184876    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn" event={"ID":"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813","Type":"ContainerStarted","Data":"f69bfc6463dcdd815bfe231aec8ae38eeb70c0c5a6a5945fcfcfcdd27109b2de"}
Sep 10 23:18:02.185386 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:02.185044    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"
Sep 10 23:18:02.185386 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:02.185073    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn" event={"ID":"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813","Type":"ContainerStarted","Data":"b1853e1ae54e3d9064e0c1ee265e7140d24678cdca50a19a1a03865c34223300"}
Sep 10 23:18:02.202389 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:02.202331    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn" podStartSLOduration=2.2023128180000002 podStartE2EDuration="2.202312818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:18:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:18:02.199782496 +0000 UTC m=+1194.378653476" watchObservedRunningTime="2026-09-10 23:18:02.202312818 +0000 UTC m=+1194.381183792"
Sep 10 23:18:04.391990 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:04.391957    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"]
Sep 10 23:18:04.392365 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:04.392200    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy" containerID="cri-o://0d408c036546d4cf40289398b09e293f1918dc7d097271de2fc46a90d54a34dc" gracePeriod=30
Sep 10 23:18:05.209441 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.209406    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"]
Sep 10 23:18:05.213247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.213223    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.215464 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.215437    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-2da572-openshift-default-dockercfg-h5czv\""
Sep 10 23:18:05.227351 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.227328    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"]
Sep 10 23:18:05.269396 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.269363    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-credential-socket\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.269396 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.269399    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istiod-ca-cert\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.269628 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.269418    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-envoy\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.269628 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.269446    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-data\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.269628 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.269507    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-workload-socket\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.269628 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.269614    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-podinfo\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.269767 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.269631    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-token\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.269767 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.269665    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-workload-certs\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.269767 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.269683    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fct5v\" (UniqueName: \"kubernetes.io/projected/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-kube-api-access-fct5v\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.370761 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.370720    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-podinfo\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.370761 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.370764    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-token\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.371028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.370806    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-workload-certs\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.371028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.370829    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fct5v\" (UniqueName: \"kubernetes.io/projected/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-kube-api-access-fct5v\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.371028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.370897    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-credential-socket\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.371028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.370925    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istiod-ca-cert\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.371028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.370952    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-envoy\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.371028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.370975    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-data\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.371028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.371014    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-workload-socket\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.371382 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.371268    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-workload-certs\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.371445 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.371395    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-workload-socket\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.371486 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.371443    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-data\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.371486 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.371472    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-credential-socket\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.371780 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.371756    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istiod-ca-cert\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.373244 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.373215    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-envoy\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.373345 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.373259    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-podinfo\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.378651 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.378627    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-token\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.378787 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.378770    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fct5v\" (UniqueName: \"kubernetes.io/projected/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-kube-api-access-fct5v\") pod \"e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") " pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.524403 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.524308    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:05.802643 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.802610    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"]
Sep 10 23:18:05.803467 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:18:05.803435    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode20fdc2c_bd2e_4cc1_905e_02b0817703d5.slice/crio-d39ded985bcdf5073b327e50bb87aba235ecea4c186fcb3a9d1ccae0b2292552 WatchSource:0}: Error finding container d39ded985bcdf5073b327e50bb87aba235ecea4c186fcb3a9d1ccae0b2292552: Status 404 returned error can't find the container with id d39ded985bcdf5073b327e50bb87aba235ecea4c186fcb3a9d1ccae0b2292552
Sep 10 23:18:05.806326 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.806293    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:05.806410 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.806371    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:05.806465 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:05.806418    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:06.217899 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:06.217817    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" event={"ID":"e20fdc2c-bd2e-4cc1-905e-02b0817703d5","Type":"ContainerStarted","Data":"1a200f2cbc0d1dc3ff8bc10e4b8906259bc55c3d17e06d79ad64f6e04b55784e"}
Sep 10 23:18:06.217899 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:06.217875    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" event={"ID":"e20fdc2c-bd2e-4cc1-905e-02b0817703d5","Type":"ContainerStarted","Data":"d39ded985bcdf5073b327e50bb87aba235ecea4c186fcb3a9d1ccae0b2292552"}
Sep 10 23:18:06.242080 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:06.242029    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" podStartSLOduration=1.242015398 podStartE2EDuration="1.242015398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:18:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:18:06.240144415 +0000 UTC m=+1198.419015405" watchObservedRunningTime="2026-09-10 23:18:06.242015398 +0000 UTC m=+1198.420886361"
Sep 10 23:18:06.524722 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:06.524638    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:06.529882 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:06.529862    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:07.243765 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:07.243723    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:07.253308 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:07.249602    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:08.370758 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:08.370721    2585 patch_prober.go:28] interesting pod/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 23:18:08.371174 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:08.370777    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 23:18:08.387292 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:08.387259    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:18:08.393706 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:08.393682    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:18:08.395039 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:08.395021    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:18:08.403125 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:08.403101    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:18:09.690180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.690154    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:18:09.828504 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.828466    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-token\") pod \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") "
Sep 10 23:18:09.828504 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.828512    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-data\") pod \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") "
Sep 10 23:18:09.828749 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.828603    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-workload-certs\") pod \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") "
Sep 10 23:18:09.828749 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.828644    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qkkl\" (UniqueName: \"kubernetes.io/projected/a6477081-85d0-4953-bdc7-e00a79e1e8f3-kube-api-access-4qkkl\") pod \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") "
Sep 10 23:18:09.828749 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.828682    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-envoy\") pod \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") "
Sep 10 23:18:09.828749 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.828736    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-credential-socket\") pod \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") "
Sep 10 23:18:09.828953 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.828777    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-workload-socket\") pod \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") "
Sep 10 23:18:09.828953 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.828834    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istiod-ca-cert\") pod \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") "
Sep 10 23:18:09.828953 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.828831    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "a6477081-85d0-4953-bdc7-e00a79e1e8f3" (UID: "a6477081-85d0-4953-bdc7-e00a79e1e8f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:18:09.828953 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.828862    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a6477081-85d0-4953-bdc7-e00a79e1e8f3" (UID: "a6477081-85d0-4953-bdc7-e00a79e1e8f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:18:09.829153 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.828954    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-podinfo\") pod \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\" (UID: \"a6477081-85d0-4953-bdc7-e00a79e1e8f3\") "
Sep 10 23:18:09.829153 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.829014    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a6477081-85d0-4953-bdc7-e00a79e1e8f3" (UID: "a6477081-85d0-4953-bdc7-e00a79e1e8f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:18:09.829153 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.828992    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a6477081-85d0-4953-bdc7-e00a79e1e8f3" (UID: "a6477081-85d0-4953-bdc7-e00a79e1e8f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:18:09.829316 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.829167    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a6477081-85d0-4953-bdc7-e00a79e1e8f3" (UID: "a6477081-85d0-4953-bdc7-e00a79e1e8f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:18:09.829370 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.829347    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:18:09.829426 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.829378    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:18:09.829426 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.829395    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:18:09.829426 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.829408    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:18:09.829426 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.829421    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:18:09.830938 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.830911    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6477081-85d0-4953-bdc7-e00a79e1e8f3-kube-api-access-4qkkl" (OuterVolumeSpecName: "kube-api-access-4qkkl") pod "a6477081-85d0-4953-bdc7-e00a79e1e8f3" (UID: "a6477081-85d0-4953-bdc7-e00a79e1e8f3"). InnerVolumeSpecName "kube-api-access-4qkkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:18:09.831084 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.831010    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a6477081-85d0-4953-bdc7-e00a79e1e8f3" (UID: "a6477081-85d0-4953-bdc7-e00a79e1e8f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:18:09.831311 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.831285    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a6477081-85d0-4953-bdc7-e00a79e1e8f3" (UID: "a6477081-85d0-4953-bdc7-e00a79e1e8f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:18:09.831417 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.831312    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "a6477081-85d0-4953-bdc7-e00a79e1e8f3" (UID: "a6477081-85d0-4953-bdc7-e00a79e1e8f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:18:09.930654 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.930541    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qkkl\" (UniqueName: \"kubernetes.io/projected/a6477081-85d0-4953-bdc7-e00a79e1e8f3-kube-api-access-4qkkl\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:18:09.930654 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.930594    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:18:09.930654 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.930605    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:18:09.930654 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:09.930615    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a6477081-85d0-4953-bdc7-e00a79e1e8f3-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:18:10.223654 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.221620    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"]
Sep 10 23:18:10.230370 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.230257    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy"
Sep 10 23:18:10.230370 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.230304    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy"
Sep 10 23:18:10.230370 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.230329    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy"
Sep 10 23:18:10.230370 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.230338    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy"
Sep 10 23:18:10.235198 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.235155    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy"
Sep 10 23:18:10.235198 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.235201    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerName="istio-proxy"
Sep 10 23:18:10.246229 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.246194    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"]
Sep 10 23:18:10.246395 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.246319    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"
Sep 10 23:18:10.249620 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.249594    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-2da572\""
Sep 10 23:18:10.250423 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.250395    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-2da572-dockercfg-76l4w\""
Sep 10 23:18:10.254684 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.254650    2585 generic.go:356] "Generic (PLEG): container finished" podID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" containerID="0d408c036546d4cf40289398b09e293f1918dc7d097271de2fc46a90d54a34dc" exitCode=0
Sep 10 23:18:10.254859 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.254720    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"
Sep 10 23:18:10.254859 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.254734    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" event={"ID":"a6477081-85d0-4953-bdc7-e00a79e1e8f3","Type":"ContainerDied","Data":"0d408c036546d4cf40289398b09e293f1918dc7d097271de2fc46a90d54a34dc"}
Sep 10 23:18:10.254859 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.254803    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4" event={"ID":"a6477081-85d0-4953-bdc7-e00a79e1e8f3","Type":"ContainerDied","Data":"c9ecae8a9060c5e39412061b646f6797b4b929934e76afc2cd1e57f5a0f31f2d"}
Sep 10 23:18:10.254859 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.254838    2585 scope.go:117] "RemoveContainer" containerID="0d408c036546d4cf40289398b09e293f1918dc7d097271de2fc46a90d54a34dc"
Sep 10 23:18:10.266402 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.266379    2585 scope.go:117] "RemoveContainer" containerID="c64767f63447555d7c60fbb6d4e95d62a5bdf8fd8272bbb40f2e5f23142c708a"
Sep 10 23:18:10.275742 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.275724    2585 scope.go:117] "RemoveContainer" containerID="0d408c036546d4cf40289398b09e293f1918dc7d097271de2fc46a90d54a34dc"
Sep 10 23:18:10.276107 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:18:10.276076    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d408c036546d4cf40289398b09e293f1918dc7d097271de2fc46a90d54a34dc\": container with ID starting with 0d408c036546d4cf40289398b09e293f1918dc7d097271de2fc46a90d54a34dc not found: ID does not exist" containerID="0d408c036546d4cf40289398b09e293f1918dc7d097271de2fc46a90d54a34dc"
Sep 10 23:18:10.276237 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.276118    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d408c036546d4cf40289398b09e293f1918dc7d097271de2fc46a90d54a34dc"} err="failed to get container status \"0d408c036546d4cf40289398b09e293f1918dc7d097271de2fc46a90d54a34dc\": rpc error: code = NotFound desc = could not find container \"0d408c036546d4cf40289398b09e293f1918dc7d097271de2fc46a90d54a34dc\": container with ID starting with 0d408c036546d4cf40289398b09e293f1918dc7d097271de2fc46a90d54a34dc not found: ID does not exist"
Sep 10 23:18:10.276237 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.276172    2585 scope.go:117] "RemoveContainer" containerID="c64767f63447555d7c60fbb6d4e95d62a5bdf8fd8272bbb40f2e5f23142c708a"
Sep 10 23:18:10.277477 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:18:10.277455    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c64767f63447555d7c60fbb6d4e95d62a5bdf8fd8272bbb40f2e5f23142c708a\": container with ID starting with c64767f63447555d7c60fbb6d4e95d62a5bdf8fd8272bbb40f2e5f23142c708a not found: ID does not exist" containerID="c64767f63447555d7c60fbb6d4e95d62a5bdf8fd8272bbb40f2e5f23142c708a"
Sep 10 23:18:10.277552 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.277482    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c64767f63447555d7c60fbb6d4e95d62a5bdf8fd8272bbb40f2e5f23142c708a"} err="failed to get container status \"c64767f63447555d7c60fbb6d4e95d62a5bdf8fd8272bbb40f2e5f23142c708a\": rpc error: code = NotFound desc = could not find container \"c64767f63447555d7c60fbb6d4e95d62a5bdf8fd8272bbb40f2e5f23142c708a\": container with ID starting with c64767f63447555d7c60fbb6d4e95d62a5bdf8fd8272bbb40f2e5f23142c708a not found: ID does not exist"
Sep 10 23:18:10.279478 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.279458    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"]
Sep 10 23:18:10.284096 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.284073    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-1f1f85-openshift-default-86c6c49954-gkjv4"]
Sep 10 23:18:10.344956 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.344888    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6477081-85d0-4953-bdc7-e00a79e1e8f3" path="/var/lib/kubelet/pods/a6477081-85d0-4953-bdc7-e00a79e1e8f3/volumes"
Sep 10 23:18:10.345703 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.345661    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgnp4\" (UniqueName: \"kubernetes.io/projected/45b13cd1-d0b1-4a96-bd78-ab426a88bc22-kube-api-access-hgnp4\") pod \"payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm\" (UID: \"45b13cd1-d0b1-4a96-bd78-ab426a88bc22\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"
Sep 10 23:18:10.345933 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.345912    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45b13cd1-d0b1-4a96-bd78-ab426a88bc22-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm\" (UID: \"45b13cd1-d0b1-4a96-bd78-ab426a88bc22\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"
Sep 10 23:18:10.447007 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.446963    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgnp4\" (UniqueName: \"kubernetes.io/projected/45b13cd1-d0b1-4a96-bd78-ab426a88bc22-kube-api-access-hgnp4\") pod \"payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm\" (UID: \"45b13cd1-d0b1-4a96-bd78-ab426a88bc22\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"
Sep 10 23:18:10.447170 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.447026    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45b13cd1-d0b1-4a96-bd78-ab426a88bc22-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm\" (UID: \"45b13cd1-d0b1-4a96-bd78-ab426a88bc22\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"
Sep 10 23:18:10.447694 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.447676    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45b13cd1-d0b1-4a96-bd78-ab426a88bc22-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm\" (UID: \"45b13cd1-d0b1-4a96-bd78-ab426a88bc22\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"
Sep 10 23:18:10.455601 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.455541    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgnp4\" (UniqueName: \"kubernetes.io/projected/45b13cd1-d0b1-4a96-bd78-ab426a88bc22-kube-api-access-hgnp4\") pod \"payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm\" (UID: \"45b13cd1-d0b1-4a96-bd78-ab426a88bc22\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"
Sep 10 23:18:10.560631 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.560590    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"
Sep 10 23:18:10.860953 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:10.860928    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"]
Sep 10 23:18:10.863331 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:18:10.863302    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45b13cd1_d0b1_4a96_bd78_ab426a88bc22.slice/crio-1c13accbc8a360f42a16ed89ba755207410e25d21cfdd6e769363c842e5c572b WatchSource:0}: Error finding container 1c13accbc8a360f42a16ed89ba755207410e25d21cfdd6e769363c842e5c572b: Status 404 returned error can't find the container with id 1c13accbc8a360f42a16ed89ba755207410e25d21cfdd6e769363c842e5c572b
Sep 10 23:18:11.262405 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:11.262290    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm" event={"ID":"45b13cd1-d0b1-4a96-bd78-ab426a88bc22","Type":"ContainerStarted","Data":"5082d33c833bdbd7b09912326a8497e0e9b1f48e5fa39a22a318a5b70268c3e5"}
Sep 10 23:18:11.262405 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:11.262356    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm" event={"ID":"45b13cd1-d0b1-4a96-bd78-ab426a88bc22","Type":"ContainerStarted","Data":"1c13accbc8a360f42a16ed89ba755207410e25d21cfdd6e769363c842e5c572b"}
Sep 10 23:18:11.262405 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:11.262386    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"
Sep 10 23:18:11.280389 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:11.280339    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm" podStartSLOduration=1.280321293 podStartE2EDuration="1.280321293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:18:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:18:11.279304135 +0000 UTC m=+1203.458175124" watchObservedRunningTime="2026-09-10 23:18:11.280321293 +0000 UTC m=+1203.459192288"
Sep 10 23:18:13.194199 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:13.194169    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"
Sep 10 23:18:15.203791 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:15.203743    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 23:18:15.204255 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:15.203816    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 23:18:18.327844 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:18.327808    2585 generic.go:356] "Generic (PLEG): container finished" podID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerID="be05418e0bb0866279c94143d708ecbcd6a42c24eb4e6d425b9079fb58847ba1" exitCode=0
Sep 10 23:18:18.328312 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:18.327882    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" event={"ID":"d9fbe8c1-99be-4797-92a8-d889c80930b5","Type":"ContainerDied","Data":"be05418e0bb0866279c94143d708ecbcd6a42c24eb4e6d425b9079fb58847ba1"}
Sep 10 23:18:18.328312 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:18.328281    2585 scope.go:117] "RemoveContainer" containerID="be05418e0bb0866279c94143d708ecbcd6a42c24eb4e6d425b9079fb58847ba1"
Sep 10 23:18:18.329308 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:18.329278    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:18.329368 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:18.329350    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:18.329408 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:18.329381    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:19.342005 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:19.341965    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" event={"ID":"d9fbe8c1-99be-4797-92a8-d889c80930b5","Type":"ContainerStarted","Data":"8d1a6b6d6f2b8c4bbaeb165692fa9cd84957d31055107cf5b99ba50297102f77"}
Sep 10 23:18:19.708281 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:19.708182    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:18:19.708642 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:19.708618    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:18:19.708814 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:19.708790    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 10 23:18:20.708305 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:20.708257    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:18:20.708834 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:20.708339    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 10 23:18:21.708646 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:21.708606    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:18:21.709246 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:21.709214    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 10 23:18:22.271056 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:22.271024    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"
Sep 10 23:18:22.707878 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:22.707839    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:18:22.708176 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:22.708141    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 10 23:18:23.708334 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:23.708287    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Sep 10 23:18:23.708858 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:23.708358    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Sep 10 23:18:24.713284 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:24.713253    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:18:24.713710 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:24.713604    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:18:24.714318 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:24.714300    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:18:24.773512 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:24.773450    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7655-7023d8"]
Sep 10 23:18:24.794235 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:24.794196    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7655-7023d8"]
Sep 10 23:18:24.794426 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:24.794321    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-7023d8"
Sep 10 23:18:24.798150 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:24.798122    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nn896\""
Sep 10 23:18:24.897210 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:24.897160    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cwsd\" (UniqueName: \"kubernetes.io/projected/fa436d67-154b-4936-88f1-651afd96c94c-kube-api-access-6cwsd\") pod \"test-curl-7655-7023d8\" (UID: \"fa436d67-154b-4936-88f1-651afd96c94c\") " pod="opendatahub/test-curl-7655-7023d8"
Sep 10 23:18:24.998450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:24.998360    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cwsd\" (UniqueName: \"kubernetes.io/projected/fa436d67-154b-4936-88f1-651afd96c94c-kube-api-access-6cwsd\") pod \"test-curl-7655-7023d8\" (UID: \"fa436d67-154b-4936-88f1-651afd96c94c\") " pod="opendatahub/test-curl-7655-7023d8"
Sep 10 23:18:25.006891 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:25.006856    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cwsd\" (UniqueName: \"kubernetes.io/projected/fa436d67-154b-4936-88f1-651afd96c94c-kube-api-access-6cwsd\") pod \"test-curl-7655-7023d8\" (UID: \"fa436d67-154b-4936-88f1-651afd96c94c\") " pod="opendatahub/test-curl-7655-7023d8"
Sep 10 23:18:25.110023 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:25.109984    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-7023d8"
Sep 10 23:18:25.386613 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:25.386583    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7655-7023d8"]
Sep 10 23:18:25.388221 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:18:25.388191    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfa436d67_154b_4936_88f1_651afd96c94c.slice/crio-d139b45b35a9769310f459fba326193ba950d32293b8b34aed13c3da4a0927ed WatchSource:0}: Error finding container d139b45b35a9769310f459fba326193ba950d32293b8b34aed13c3da4a0927ed: Status 404 returned error can't find the container with id d139b45b35a9769310f459fba326193ba950d32293b8b34aed13c3da4a0927ed
Sep 10 23:18:26.388977 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:26.388932    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7655-7023d8" event={"ID":"fa436d67-154b-4936-88f1-651afd96c94c","Type":"ContainerStarted","Data":"046f3808b39c983332d565a485458995a5ee0702bec818cf8603e4a189150ff3"}
Sep 10 23:18:26.388977 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:26.388985    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7655-7023d8" event={"ID":"fa436d67-154b-4936-88f1-651afd96c94c","Type":"ContainerStarted","Data":"d139b45b35a9769310f459fba326193ba950d32293b8b34aed13c3da4a0927ed"}
Sep 10 23:18:26.390547 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:26.390525    2585 generic.go:356] "Generic (PLEG): container finished" podID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerID="1a200f2cbc0d1dc3ff8bc10e4b8906259bc55c3d17e06d79ad64f6e04b55784e" exitCode=0
Sep 10 23:18:26.390676 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:26.390609    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" event={"ID":"e20fdc2c-bd2e-4cc1-905e-02b0817703d5","Type":"ContainerDied","Data":"1a200f2cbc0d1dc3ff8bc10e4b8906259bc55c3d17e06d79ad64f6e04b55784e"}
Sep 10 23:18:26.390983 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:26.390968    2585 scope.go:117] "RemoveContainer" containerID="1a200f2cbc0d1dc3ff8bc10e4b8906259bc55c3d17e06d79ad64f6e04b55784e"
Sep 10 23:18:26.391927 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:26.391900    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:26.392019 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:26.391964    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:26.392019 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:26.392005    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:26.406067 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:26.406027    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7655-7023d8" podStartSLOduration=2.406012547 podStartE2EDuration="2.406012547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:18:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:18:26.403428093 +0000 UTC m=+1218.582299056" watchObservedRunningTime="2026-09-10 23:18:26.406012547 +0000 UTC m=+1218.584883574"
Sep 10 23:18:27.059762 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:27.059726    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7655-7023d8"]
Sep 10 23:18:27.063734 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:27.063707    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7655-7023d8"]
Sep 10 23:18:27.400614 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:18:27.400552    2585 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7655-7023d8" container="test-curl-7655-7023d8"
Sep 10 23:18:27.401128 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:27.400826    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" event={"ID":"e20fdc2c-bd2e-4cc1-905e-02b0817703d5","Type":"ContainerStarted","Data":"0b97f75c8ae6ae927bc8cc8fc33dd76222b5e170772007214fd5a3cabe2d1210"}
Sep 10 23:18:27.524892 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:27.524854    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:27.525147 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:27.525123    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 10 23:18:27.525195 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:27.525172    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 10 23:18:28.410836 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:28.410781    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7655-7023d8" podUID="fa436d67-154b-4936-88f1-651afd96c94c" containerName="test-curl-7655-7023d8" containerID="cri-o://046f3808b39c983332d565a485458995a5ee0702bec818cf8603e4a189150ff3" gracePeriod=2
Sep 10 23:18:28.524854 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:28.524811    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 10 23:18:28.525046 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:28.524885    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 10 23:18:29.524757 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:29.524713    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 10 23:18:29.525143 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:29.524779    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 10 23:18:30.524852 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:30.524818    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 10 23:18:30.525241 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:30.524876    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 10 23:18:30.647782 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:30.647756    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-7023d8"
Sep 10 23:18:30.757297 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:30.757217    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cwsd\" (UniqueName: \"kubernetes.io/projected/fa436d67-154b-4936-88f1-651afd96c94c-kube-api-access-6cwsd\") pod \"fa436d67-154b-4936-88f1-651afd96c94c\" (UID: \"fa436d67-154b-4936-88f1-651afd96c94c\") "
Sep 10 23:18:30.759326 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:30.759295    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa436d67-154b-4936-88f1-651afd96c94c-kube-api-access-6cwsd" (OuterVolumeSpecName: "kube-api-access-6cwsd") pod "fa436d67-154b-4936-88f1-651afd96c94c" (UID: "fa436d67-154b-4936-88f1-651afd96c94c"). InnerVolumeSpecName "kube-api-access-6cwsd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:18:30.858996 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:30.858961    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cwsd\" (UniqueName: \"kubernetes.io/projected/fa436d67-154b-4936-88f1-651afd96c94c-kube-api-access-6cwsd\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:18:31.434000 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:31.433964    2585 generic.go:356] "Generic (PLEG): container finished" podID="fa436d67-154b-4936-88f1-651afd96c94c" containerID="046f3808b39c983332d565a485458995a5ee0702bec818cf8603e4a189150ff3" exitCode=137
Sep 10 23:18:31.434217 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:31.434010    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7655-7023d8"
Sep 10 23:18:31.434217 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:31.434053    2585 scope.go:117] "RemoveContainer" containerID="046f3808b39c983332d565a485458995a5ee0702bec818cf8603e4a189150ff3"
Sep 10 23:18:31.443507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:31.443488    2585 scope.go:117] "RemoveContainer" containerID="046f3808b39c983332d565a485458995a5ee0702bec818cf8603e4a189150ff3"
Sep 10 23:18:31.443842 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:18:31.443818    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"046f3808b39c983332d565a485458995a5ee0702bec818cf8603e4a189150ff3\": container with ID starting with 046f3808b39c983332d565a485458995a5ee0702bec818cf8603e4a189150ff3 not found: ID does not exist" containerID="046f3808b39c983332d565a485458995a5ee0702bec818cf8603e4a189150ff3"
Sep 10 23:18:31.443895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:31.443854    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"046f3808b39c983332d565a485458995a5ee0702bec818cf8603e4a189150ff3"} err="failed to get container status \"046f3808b39c983332d565a485458995a5ee0702bec818cf8603e4a189150ff3\": rpc error: code = NotFound desc = could not find container \"046f3808b39c983332d565a485458995a5ee0702bec818cf8603e4a189150ff3\": container with ID starting with 046f3808b39c983332d565a485458995a5ee0702bec818cf8603e4a189150ff3 not found: ID does not exist"
Sep 10 23:18:31.443895 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:18:31.443872    2585 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7655-7023d8\" is forbidden: User \"system:node:ip-10-0-138-139.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-139.ec2.internal' and this object" podUID="fa436d67-154b-4936-88f1-651afd96c94c" pod="opendatahub/test-curl-7655-7023d8"
Sep 10 23:18:31.525016 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:31.524980    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Sep 10 23:18:31.525390 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:31.525036    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Sep 10 23:18:32.343786 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:32.343752    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa436d67-154b-4936-88f1-651afd96c94c" path="/var/lib/kubelet/pods/fa436d67-154b-4936-88f1-651afd96c94c/volumes"
Sep 10 23:18:32.543954 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:32.543924    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:32.544504 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:32.544321    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:32.545231 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:32.545212    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:18:33.661775 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.661740    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"]
Sep 10 23:18:33.662395 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.662373    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa436d67-154b-4936-88f1-651afd96c94c" containerName="test-curl-7655-7023d8"
Sep 10 23:18:33.662486 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.662397    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa436d67-154b-4936-88f1-651afd96c94c" containerName="test-curl-7655-7023d8"
Sep 10 23:18:33.662545 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.662529    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa436d67-154b-4936-88f1-651afd96c94c" containerName="test-curl-7655-7023d8"
Sep 10 23:18:33.666875 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.666853    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.668970 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.668948    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-4b268f-openshift-default-dockercfg-kbbl7\""
Sep 10 23:18:33.678071 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.678048    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"]
Sep 10 23:18:33.786452 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.786418    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-data\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.786656 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.786467    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-credential-socket\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.786656 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.786486    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-token\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.786656 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.786598    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bxsf\" (UniqueName: \"kubernetes.io/projected/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-kube-api-access-6bxsf\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.786656 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.786650    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istiod-ca-cert\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.786826 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.786729    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-podinfo\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.786826 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.786757    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-workload-certs\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.786826 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.786783    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-envoy\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.786953 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.786835    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-workload-socket\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.888345 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.888305    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istiod-ca-cert\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.888605 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.888360    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-podinfo\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.888605 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.888378    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-workload-certs\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.888605 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.888478    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-envoy\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.888605 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.888524    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-workload-socket\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.888837 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.888637    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-data\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.888837 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.888692    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-credential-socket\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.888837 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.888716    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-token\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.888837 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.888761    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bxsf\" (UniqueName: \"kubernetes.io/projected/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-kube-api-access-6bxsf\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.888837 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.888807    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-workload-certs\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.889287 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.889258    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-workload-socket\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.889381 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.889261    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istiod-ca-cert\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.889381 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.889299    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-credential-socket\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.889381 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.889340    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-data\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.891311 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.891289    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-envoy\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.891552 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.891531    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-podinfo\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.897364 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.897337    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bxsf\" (UniqueName: \"kubernetes.io/projected/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-kube-api-access-6bxsf\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.897470 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.897376    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-token\") pod \"e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") " pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:33.977819 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:33.977736    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:34.257997 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:34.257967    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"]
Sep 10 23:18:34.259014 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:18:34.258989    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9727a30a_60bc_4e7b_8a6b_92dce685f5c3.slice/crio-1788d3de8764a67b8edc4559e5bdf639e95b6829af22ea4f233a3ff0dc201fc5 WatchSource:0}: Error finding container 1788d3de8764a67b8edc4559e5bdf639e95b6829af22ea4f233a3ff0dc201fc5: Status 404 returned error can't find the container with id 1788d3de8764a67b8edc4559e5bdf639e95b6829af22ea4f233a3ff0dc201fc5
Sep 10 23:18:34.261423 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:34.261378    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:34.261508 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:34.261488    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:34.261576 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:34.261542    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:34.463428 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:34.463387    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" event={"ID":"9727a30a-60bc-4e7b-8a6b-92dce685f5c3","Type":"ContainerStarted","Data":"fb7624aa02af4561ff81ba2afc9cd43cd87af09e9e2df5eaf8d680b6b802aa63"}
Sep 10 23:18:34.463623 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:34.463455    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" event={"ID":"9727a30a-60bc-4e7b-8a6b-92dce685f5c3","Type":"ContainerStarted","Data":"1788d3de8764a67b8edc4559e5bdf639e95b6829af22ea4f233a3ff0dc201fc5"}
Sep 10 23:18:34.486699 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:34.486635    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" podStartSLOduration=1.486611565 podStartE2EDuration="1.486611565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:18:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:18:34.482974325 +0000 UTC m=+1226.661845311" watchObservedRunningTime="2026-09-10 23:18:34.486611565 +0000 UTC m=+1226.665482530"
Sep 10 23:18:34.978582 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:34.978534    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:35.734987 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.734958    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"]
Sep 10 23:18:35.738799 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.738778    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.740998 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.740975    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6d5278a1-openshift-default-dockercfg-8xcgx\""
Sep 10 23:18:35.749103 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.749078    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"]
Sep 10 23:18:35.808723 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.808690    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc39d312-2210-420d-966e-5dd06716d490-istio-podinfo\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.808919 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.808740    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-credential-socket\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.808919 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.808772    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc39d312-2210-420d-966e-5dd06716d490-istio-token\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.808919 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.808825    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc39d312-2210-420d-966e-5dd06716d490-istiod-ca-cert\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.808919 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.808892    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-istio-data\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.809198 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.808934    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-workload-socket\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.809198 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.808956    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-workload-certs\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.809198 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.809060    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rzsv\" (UniqueName: \"kubernetes.io/projected/dc39d312-2210-420d-966e-5dd06716d490-kube-api-access-7rzsv\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.809198 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.809133    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-istio-envoy\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.910581 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.910533    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc39d312-2210-420d-966e-5dd06716d490-istiod-ca-cert\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.910581 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.910590    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-istio-data\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.910846 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.910619    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-workload-socket\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.910846 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.910636    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-workload-certs\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.910846 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.910681    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rzsv\" (UniqueName: \"kubernetes.io/projected/dc39d312-2210-420d-966e-5dd06716d490-kube-api-access-7rzsv\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.910846 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.910748    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-istio-envoy\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.910846 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.910824    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc39d312-2210-420d-966e-5dd06716d490-istio-podinfo\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.911117 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.910866    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-credential-socket\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.911117 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.910893    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc39d312-2210-420d-966e-5dd06716d490-istio-token\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.911117 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.911027    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-workload-certs\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.911117 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.911061    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-istio-data\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.911358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.911147    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-workload-socket\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.911358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.911297    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc39d312-2210-420d-966e-5dd06716d490-istiod-ca-cert\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.911508 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.911484    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-credential-socket\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.913201 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.913175    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-istio-envoy\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.913381 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.913359    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc39d312-2210-420d-966e-5dd06716d490-istio-podinfo\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.918914 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.918889    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc39d312-2210-420d-966e-5dd06716d490-istio-token\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.919498 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.919481    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rzsv\" (UniqueName: \"kubernetes.io/projected/dc39d312-2210-420d-966e-5dd06716d490-kube-api-access-7rzsv\") pod \"e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") " pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:35.984135 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:35.984103    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:36.051494 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:36.051461    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:36.339314 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:18:36.339286    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc39d312_2210_420d_966e_5dd06716d490.slice/crio-a1fcfbe23b596d3491d305111a40ece786714ce5767bdc6f2c94c50612b2debb WatchSource:0}: Error finding container a1fcfbe23b596d3491d305111a40ece786714ce5767bdc6f2c94c50612b2debb: Status 404 returned error can't find the container with id a1fcfbe23b596d3491d305111a40ece786714ce5767bdc6f2c94c50612b2debb
Sep 10 23:18:36.342426 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:36.342391    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:36.342527 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:36.342472    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:36.342527 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:36.342519    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:36.344057 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:36.344039    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"]
Sep 10 23:18:36.480533 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:36.480485    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" event={"ID":"dc39d312-2210-420d-966e-5dd06716d490","Type":"ContainerStarted","Data":"905475e2eb6c689f15d00ea0ce98ac42713ce8229c8b91a927fabb16f22287fb"}
Sep 10 23:18:36.480725 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:36.480589    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" event={"ID":"dc39d312-2210-420d-966e-5dd06716d490","Type":"ContainerStarted","Data":"a1fcfbe23b596d3491d305111a40ece786714ce5767bdc6f2c94c50612b2debb"}
Sep 10 23:18:36.480981 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:36.480959    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:36.481943 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:36.481913    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:36.500576 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:36.500496    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" podStartSLOduration=1.500475594 podStartE2EDuration="1.500475594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:18:36.498059741 +0000 UTC m=+1228.676930777" watchObservedRunningTime="2026-09-10 23:18:36.500475594 +0000 UTC m=+1228.679346559"
Sep 10 23:18:37.052401 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:37.052360    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:37.057120 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:37.057088    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:37.487528 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:37.487438    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:37.488311 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:37.488291    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:40.285664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:40.285621    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"]
Sep 10 23:18:40.290285 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:40.290138    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"]
Sep 10 23:18:40.290451 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:40.290311    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"
Sep 10 23:18:40.292714 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:40.292691    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6d5278a1\""
Sep 10 23:18:40.292847 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:40.292796    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6d5278a1-dockercfg-776kl\""
Sep 10 23:18:40.364584 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:40.362313    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea5a9b17-63f5-4893-a14d-0881d1ffcb6a-plugins-config-volume\") pod \"payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8\" (UID: \"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a\") " pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"
Sep 10 23:18:40.364584 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:40.362440    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v85jh\" (UniqueName: \"kubernetes.io/projected/ea5a9b17-63f5-4893-a14d-0881d1ffcb6a-kube-api-access-v85jh\") pod \"payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8\" (UID: \"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a\") " pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"
Sep 10 23:18:40.464092 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:40.464050    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea5a9b17-63f5-4893-a14d-0881d1ffcb6a-plugins-config-volume\") pod \"payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8\" (UID: \"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a\") " pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"
Sep 10 23:18:40.464312 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:40.464133    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v85jh\" (UniqueName: \"kubernetes.io/projected/ea5a9b17-63f5-4893-a14d-0881d1ffcb6a-kube-api-access-v85jh\") pod \"payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8\" (UID: \"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a\") " pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"
Sep 10 23:18:40.464898 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:40.464878    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea5a9b17-63f5-4893-a14d-0881d1ffcb6a-plugins-config-volume\") pod \"payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8\" (UID: \"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a\") " pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"
Sep 10 23:18:40.472071 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:40.472045    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v85jh\" (UniqueName: \"kubernetes.io/projected/ea5a9b17-63f5-4893-a14d-0881d1ffcb6a-kube-api-access-v85jh\") pod \"payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8\" (UID: \"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a\") " pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"
Sep 10 23:18:40.605374 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:40.605334    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"
Sep 10 23:18:40.876625 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:40.876594    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"]
Sep 10 23:18:40.878555 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:18:40.878523    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea5a9b17_63f5_4893_a14d_0881d1ffcb6a.slice/crio-41c63067b341e25cdd504b7c51dd60ba537e3416dafd81a196a769e1b23761ee WatchSource:0}: Error finding container 41c63067b341e25cdd504b7c51dd60ba537e3416dafd81a196a769e1b23761ee: Status 404 returned error can't find the container with id 41c63067b341e25cdd504b7c51dd60ba537e3416dafd81a196a769e1b23761ee
Sep 10 23:18:41.516446 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:41.516404    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8" event={"ID":"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a","Type":"ContainerStarted","Data":"99d7e1d26e400591c4ed86a46ea6fec4a19206dc4c9cdf212af779e11b648865"}
Sep 10 23:18:41.516851 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:41.516482    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8" event={"ID":"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a","Type":"ContainerStarted","Data":"41c63067b341e25cdd504b7c51dd60ba537e3416dafd81a196a769e1b23761ee"}
Sep 10 23:18:41.516851 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:41.516584    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"
Sep 10 23:18:41.534922 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:41.534869    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8" podStartSLOduration=1.5348536739999998 podStartE2EDuration="1.534853674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:18:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:18:41.532173458 +0000 UTC m=+1233.711044456" watchObservedRunningTime="2026-09-10 23:18:41.534853674 +0000 UTC m=+1233.713724636"
Sep 10 23:18:52.524159 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:52.524112    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"
Sep 10 23:18:56.618188 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:56.618153    2585 generic.go:356] "Generic (PLEG): container finished" podID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerID="fb7624aa02af4561ff81ba2afc9cd43cd87af09e9e2df5eaf8d680b6b802aa63" exitCode=0
Sep 10 23:18:56.618710 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:56.618223    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" event={"ID":"9727a30a-60bc-4e7b-8a6b-92dce685f5c3","Type":"ContainerDied","Data":"fb7624aa02af4561ff81ba2afc9cd43cd87af09e9e2df5eaf8d680b6b802aa63"}
Sep 10 23:18:56.618784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:56.618729    2585 scope.go:117] "RemoveContainer" containerID="fb7624aa02af4561ff81ba2afc9cd43cd87af09e9e2df5eaf8d680b6b802aa63"
Sep 10 23:18:56.620011 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:56.619969    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:56.620100 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:56.620051    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:56.620100 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:56.620066    2585 generic.go:356] "Generic (PLEG): container finished" podID="dc39d312-2210-420d-966e-5dd06716d490" containerID="905475e2eb6c689f15d00ea0ce98ac42713ce8229c8b91a927fabb16f22287fb" exitCode=0
Sep 10 23:18:56.620100 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:56.620086    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:56.620207 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:56.620141    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" event={"ID":"dc39d312-2210-420d-966e-5dd06716d490","Type":"ContainerDied","Data":"905475e2eb6c689f15d00ea0ce98ac42713ce8229c8b91a927fabb16f22287fb"}
Sep 10 23:18:56.620473 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:56.620461    2585 scope.go:117] "RemoveContainer" containerID="905475e2eb6c689f15d00ea0ce98ac42713ce8229c8b91a927fabb16f22287fb"
Sep 10 23:18:56.621494 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:56.621462    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:56.621627 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:56.621601    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:56.621776 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:56.621659    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:18:57.628270 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:57.628238    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" event={"ID":"dc39d312-2210-420d-966e-5dd06716d490","Type":"ContainerStarted","Data":"244a24246a9800a35284e0d5ee3515ad57b0b175191c8d0ca6493340e97c11a6"}
Sep 10 23:18:57.630590 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:57.630544    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" event={"ID":"9727a30a-60bc-4e7b-8a6b-92dce685f5c3","Type":"ContainerStarted","Data":"d92ef8b1f4881e349d124739d936145b42cfc28c207de3b55c9c7526ed2e2f24"}
Sep 10 23:18:57.978841 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:57.978753    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:18:57.979007 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:57.978965    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 10 23:18:57.979060 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:57.979031    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 10 23:18:58.052214 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:58.052177    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:18:58.052386 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:58.052214    2585 patch_prober.go:28] interesting pod/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 10 23:18:58.052386 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:58.052278    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 10 23:18:58.978912 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:58.978872    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 10 23:18:58.979300 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:58.978937    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 10 23:18:59.052499 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:59.052450    2585 patch_prober.go:28] interesting pod/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 10 23:18:59.052722 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:59.052516    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 10 23:18:59.978426 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:59.978389    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 10 23:18:59.978644 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:18:59.978448    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 10 23:19:00.052629 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:00.052588    2585 patch_prober.go:28] interesting pod/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 10 23:19:00.053011 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:00.052653    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 10 23:19:00.978492 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:00.978398    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 10 23:19:00.978492 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:00.978455    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 10 23:19:01.052457 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:01.052417    2585 patch_prober.go:28] interesting pod/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 10 23:19:01.052651 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:01.052472    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 10 23:19:01.978594 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:01.978541    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 10 23:19:01.978842 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:01.978819    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 10 23:19:02.052509 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:02.052464    2585 patch_prober.go:28] interesting pod/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 10 23:19:02.052707 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:02.052524    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 10 23:19:02.979111 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:02.979069    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 10 23:19:02.979297 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:02.979129    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 10 23:19:03.052665 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:03.052632    2585 patch_prober.go:28] interesting pod/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused" start-of-body=
Sep 10 23:19:03.052903 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:03.052879    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.81:15021/healthz/ready\": dial tcp 10.134.0.81:15021: connect: connection refused"
Sep 10 23:19:03.985874 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:03.985841    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:19:03.986359 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:03.986318    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:19:03.987108 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:03.987090    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:19:04.056071 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:04.056035    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:19:04.056507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:04.056468    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:19:04.057190 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:19:04.057162    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:20:18.630987 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:18.630944    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8"]
Sep 10 23:20:18.634538 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:18.634517    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8"
Sep 10 23:20:18.636645 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:18.636622    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:20:18.636816 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:18.636792    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:20:18.642036 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:18.642014    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8"]
Sep 10 23:20:18.696190 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:18.696151    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40521f68-b00b-49c2-97b1-d77337e45761-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8\" (UID: \"40521f68-b00b-49c2-97b1-d77337e45761\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8"
Sep 10 23:20:18.797513 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:18.797463    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40521f68-b00b-49c2-97b1-d77337e45761-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8\" (UID: \"40521f68-b00b-49c2-97b1-d77337e45761\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8"
Sep 10 23:20:18.798111 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:18.798090    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40521f68-b00b-49c2-97b1-d77337e45761-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8\" (UID: \"40521f68-b00b-49c2-97b1-d77337e45761\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8"
Sep 10 23:20:18.946418 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:18.946318    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8"
Sep 10 23:20:19.223180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:19.223150    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8"]
Sep 10 23:20:19.224198 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:20:19.224169    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40521f68_b00b_49c2_97b1_d77337e45761.slice/crio-4c967a39929d806436f50054be9efc10fe57478ca15469682dad681350bc1b56 WatchSource:0}: Error finding container 4c967a39929d806436f50054be9efc10fe57478ca15469682dad681350bc1b56: Status 404 returned error can't find the container with id 4c967a39929d806436f50054be9efc10fe57478ca15469682dad681350bc1b56
Sep 10 23:20:20.188945 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:20.188854    2585 generic.go:356] "Generic (PLEG): container finished" podID="40521f68-b00b-49c2-97b1-d77337e45761" containerID="28ee164a4d0882296cc27ceb7e7052405044936ef333d9333df4e67c341d1774" exitCode=0
Sep 10 23:20:20.189313 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:20.188937    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8" event={"ID":"40521f68-b00b-49c2-97b1-d77337e45761","Type":"ContainerDied","Data":"28ee164a4d0882296cc27ceb7e7052405044936ef333d9333df4e67c341d1774"}
Sep 10 23:20:20.189313 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:20.188987    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8" event={"ID":"40521f68-b00b-49c2-97b1-d77337e45761","Type":"ContainerStarted","Data":"4c967a39929d806436f50054be9efc10fe57478ca15469682dad681350bc1b56"}
Sep 10 23:20:21.335363 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:21.335340    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8"
Sep 10 23:20:21.422273 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:21.422239    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40521f68-b00b-49c2-97b1-d77337e45761-maas-api-service-ca\") pod \"40521f68-b00b-49c2-97b1-d77337e45761\" (UID: \"40521f68-b00b-49c2-97b1-d77337e45761\") "
Sep 10 23:20:21.422643 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:21.422620    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40521f68-b00b-49c2-97b1-d77337e45761-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "40521f68-b00b-49c2-97b1-d77337e45761" (UID: "40521f68-b00b-49c2-97b1-d77337e45761"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:20:21.524022 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:21.523928    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40521f68-b00b-49c2-97b1-d77337e45761-maas-api-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:20:22.206799 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:22.206768    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8"
Sep 10 23:20:22.206980 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:22.206808    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8" event={"ID":"40521f68-b00b-49c2-97b1-d77337e45761","Type":"ContainerDied","Data":"4c967a39929d806436f50054be9efc10fe57478ca15469682dad681350bc1b56"}
Sep 10 23:20:22.206980 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:22.206880    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c967a39929d806436f50054be9efc10fe57478ca15469682dad681350bc1b56"
Sep 10 23:20:34.231086 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:34.230992    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"]
Sep 10 23:20:34.231477 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:34.231310    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8" podUID="ea5a9b17-63f5-4893-a14d-0881d1ffcb6a" containerName="payload-processing" containerID="cri-o://99d7e1d26e400591c4ed86a46ea6fec4a19206dc4c9cdf212af779e11b648865" gracePeriod=30
Sep 10 23:20:34.405227 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:34.405193    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8"]
Sep 10 23:20:34.410828 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:34.410791    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-6d5278a1-gdtq8"]
Sep 10 23:20:34.541439 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:34.541417    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"
Sep 10 23:20:34.652293 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:34.652261    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v85jh\" (UniqueName: \"kubernetes.io/projected/ea5a9b17-63f5-4893-a14d-0881d1ffcb6a-kube-api-access-v85jh\") pod \"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a\" (UID: \"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a\") "
Sep 10 23:20:34.652472 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:34.652355    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea5a9b17-63f5-4893-a14d-0881d1ffcb6a-plugins-config-volume\") pod \"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a\" (UID: \"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a\") "
Sep 10 23:20:34.652710 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:34.652688    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea5a9b17-63f5-4893-a14d-0881d1ffcb6a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ea5a9b17-63f5-4893-a14d-0881d1ffcb6a" (UID: "ea5a9b17-63f5-4893-a14d-0881d1ffcb6a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:20:34.654383 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:34.654364    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea5a9b17-63f5-4893-a14d-0881d1ffcb6a-kube-api-access-v85jh" (OuterVolumeSpecName: "kube-api-access-v85jh") pod "ea5a9b17-63f5-4893-a14d-0881d1ffcb6a" (UID: "ea5a9b17-63f5-4893-a14d-0881d1ffcb6a"). InnerVolumeSpecName "kube-api-access-v85jh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:20:34.753518 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:34.753480    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea5a9b17-63f5-4893-a14d-0881d1ffcb6a-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:20:34.753518 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:34.753510    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v85jh\" (UniqueName: \"kubernetes.io/projected/ea5a9b17-63f5-4893-a14d-0881d1ffcb6a-kube-api-access-v85jh\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:20:35.293661 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:35.293620    2585 generic.go:356] "Generic (PLEG): container finished" podID="ea5a9b17-63f5-4893-a14d-0881d1ffcb6a" containerID="99d7e1d26e400591c4ed86a46ea6fec4a19206dc4c9cdf212af779e11b648865" exitCode=0
Sep 10 23:20:35.294146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:35.293665    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"
Sep 10 23:20:35.294146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:35.293707    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8" event={"ID":"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a","Type":"ContainerDied","Data":"99d7e1d26e400591c4ed86a46ea6fec4a19206dc4c9cdf212af779e11b648865"}
Sep 10 23:20:35.294146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:35.293765    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8" event={"ID":"ea5a9b17-63f5-4893-a14d-0881d1ffcb6a","Type":"ContainerDied","Data":"41c63067b341e25cdd504b7c51dd60ba537e3416dafd81a196a769e1b23761ee"}
Sep 10 23:20:35.294146 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:35.293790    2585 scope.go:117] "RemoveContainer" containerID="99d7e1d26e400591c4ed86a46ea6fec4a19206dc4c9cdf212af779e11b648865"
Sep 10 23:20:35.308776 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:35.308754    2585 scope.go:117] "RemoveContainer" containerID="99d7e1d26e400591c4ed86a46ea6fec4a19206dc4c9cdf212af779e11b648865"
Sep 10 23:20:35.309143 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:20:35.309118    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99d7e1d26e400591c4ed86a46ea6fec4a19206dc4c9cdf212af779e11b648865\": container with ID starting with 99d7e1d26e400591c4ed86a46ea6fec4a19206dc4c9cdf212af779e11b648865 not found: ID does not exist" containerID="99d7e1d26e400591c4ed86a46ea6fec4a19206dc4c9cdf212af779e11b648865"
Sep 10 23:20:35.309209 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:35.309153    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99d7e1d26e400591c4ed86a46ea6fec4a19206dc4c9cdf212af779e11b648865"} err="failed to get container status \"99d7e1d26e400591c4ed86a46ea6fec4a19206dc4c9cdf212af779e11b648865\": rpc error: code = NotFound desc = could not find container \"99d7e1d26e400591c4ed86a46ea6fec4a19206dc4c9cdf212af779e11b648865\": container with ID starting with 99d7e1d26e400591c4ed86a46ea6fec4a19206dc4c9cdf212af779e11b648865 not found: ID does not exist"
Sep 10 23:20:35.319953 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:35.319922    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"]
Sep 10 23:20:35.323797 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:35.323770    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6d5278a1-778fbd7f6f-l7cl8"]
Sep 10 23:20:36.342065 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:36.342029    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40521f68-b00b-49c2-97b1-d77337e45761" path="/var/lib/kubelet/pods/40521f68-b00b-49c2-97b1-d77337e45761/volumes"
Sep 10 23:20:36.342427 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:20:36.342417    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea5a9b17-63f5-4893-a14d-0881d1ffcb6a" path="/var/lib/kubelet/pods/ea5a9b17-63f5-4893-a14d-0881d1ffcb6a/volumes"
Sep 10 23:21:08.528505 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:08.528471    2585 scope.go:117] "RemoveContainer" containerID="f69d55e68e486e2ee0d402a68febf9febd4ab7cf0754bc0f897b5eb9fffa1cb7"
Sep 10 23:21:08.540091 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:08.540069    2585 scope.go:117] "RemoveContainer" containerID="49e38f3b9ce093e57b38210a4a34c6bed9a38d2367f4103b57ae6c2699eb5e60"
Sep 10 23:21:31.670055 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:31.670016    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"]
Sep 10 23:21:31.670553 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:31.670249    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy" containerID="cri-o://244a24246a9800a35284e0d5ee3515ad57b0b175191c8d0ca6493340e97c11a6" gracePeriod=30
Sep 10 23:21:34.059213 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:34.059173    2585 patch_prober.go:28] interesting pod/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 23:21:34.059606 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:34.059248    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 23:21:36.927925 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.927900    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:21:36.987546 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.987464    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rzsv\" (UniqueName: \"kubernetes.io/projected/dc39d312-2210-420d-966e-5dd06716d490-kube-api-access-7rzsv\") pod \"dc39d312-2210-420d-966e-5dd06716d490\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") "
Sep 10 23:21:36.987546 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.987513    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc39d312-2210-420d-966e-5dd06716d490-istio-token\") pod \"dc39d312-2210-420d-966e-5dd06716d490\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") "
Sep 10 23:21:36.987804 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.987550    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-istio-envoy\") pod \"dc39d312-2210-420d-966e-5dd06716d490\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") "
Sep 10 23:21:36.987804 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.987598    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc39d312-2210-420d-966e-5dd06716d490-istiod-ca-cert\") pod \"dc39d312-2210-420d-966e-5dd06716d490\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") "
Sep 10 23:21:36.987804 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.987613    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-istio-data\") pod \"dc39d312-2210-420d-966e-5dd06716d490\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") "
Sep 10 23:21:36.987804 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.987629    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-credential-socket\") pod \"dc39d312-2210-420d-966e-5dd06716d490\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") "
Sep 10 23:21:36.987804 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.987660    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-workload-certs\") pod \"dc39d312-2210-420d-966e-5dd06716d490\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") "
Sep 10 23:21:36.987804 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.987691    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-workload-socket\") pod \"dc39d312-2210-420d-966e-5dd06716d490\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") "
Sep 10 23:21:36.987804 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.987743    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc39d312-2210-420d-966e-5dd06716d490-istio-podinfo\") pod \"dc39d312-2210-420d-966e-5dd06716d490\" (UID: \"dc39d312-2210-420d-966e-5dd06716d490\") "
Sep 10 23:21:36.988192 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.988083    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-istio-data" (OuterVolumeSpecName: "istio-data") pod "dc39d312-2210-420d-966e-5dd06716d490" (UID: "dc39d312-2210-420d-966e-5dd06716d490"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:21:36.988192 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.988098    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dc39d312-2210-420d-966e-5dd06716d490" (UID: "dc39d312-2210-420d-966e-5dd06716d490"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:21:36.988192 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.988104    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc39d312-2210-420d-966e-5dd06716d490-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dc39d312-2210-420d-966e-5dd06716d490" (UID: "dc39d312-2210-420d-966e-5dd06716d490"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:21:36.988357 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.988281    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dc39d312-2210-420d-966e-5dd06716d490" (UID: "dc39d312-2210-420d-966e-5dd06716d490"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:21:36.988413 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.988356    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dc39d312-2210-420d-966e-5dd06716d490" (UID: "dc39d312-2210-420d-966e-5dd06716d490"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:21:36.989867 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.989842    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc39d312-2210-420d-966e-5dd06716d490-kube-api-access-7rzsv" (OuterVolumeSpecName: "kube-api-access-7rzsv") pod "dc39d312-2210-420d-966e-5dd06716d490" (UID: "dc39d312-2210-420d-966e-5dd06716d490"). InnerVolumeSpecName "kube-api-access-7rzsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:21:36.989997 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.989886    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc39d312-2210-420d-966e-5dd06716d490-istio-token" (OuterVolumeSpecName: "istio-token") pod "dc39d312-2210-420d-966e-5dd06716d490" (UID: "dc39d312-2210-420d-966e-5dd06716d490"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:21:36.989997 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.989907    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dc39d312-2210-420d-966e-5dd06716d490" (UID: "dc39d312-2210-420d-966e-5dd06716d490"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:21:36.989997 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:36.989988    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dc39d312-2210-420d-966e-5dd06716d490-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dc39d312-2210-420d-966e-5dd06716d490" (UID: "dc39d312-2210-420d-966e-5dd06716d490"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:21:37.088975 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.088943    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rzsv\" (UniqueName: \"kubernetes.io/projected/dc39d312-2210-420d-966e-5dd06716d490-kube-api-access-7rzsv\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:21:37.088975 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.088970    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dc39d312-2210-420d-966e-5dd06716d490-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:21:37.088975 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.088979    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:21:37.089203 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.088988    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dc39d312-2210-420d-966e-5dd06716d490-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:21:37.089203 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.088995    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:21:37.089203 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.089003    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:21:37.089203 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.089011    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:21:37.089203 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.089019    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dc39d312-2210-420d-966e-5dd06716d490-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:21:37.089203 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.089027    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dc39d312-2210-420d-966e-5dd06716d490-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:21:37.705710 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.705673    2585 generic.go:356] "Generic (PLEG): container finished" podID="dc39d312-2210-420d-966e-5dd06716d490" containerID="244a24246a9800a35284e0d5ee3515ad57b0b175191c8d0ca6493340e97c11a6" exitCode=0
Sep 10 23:21:37.705893 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.705732    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"
Sep 10 23:21:37.705893 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.705772    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" event={"ID":"dc39d312-2210-420d-966e-5dd06716d490","Type":"ContainerDied","Data":"244a24246a9800a35284e0d5ee3515ad57b0b175191c8d0ca6493340e97c11a6"}
Sep 10 23:21:37.705893 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.705841    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4" event={"ID":"dc39d312-2210-420d-966e-5dd06716d490","Type":"ContainerDied","Data":"a1fcfbe23b596d3491d305111a40ece786714ce5767bdc6f2c94c50612b2debb"}
Sep 10 23:21:37.705893 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.705866    2585 scope.go:117] "RemoveContainer" containerID="244a24246a9800a35284e0d5ee3515ad57b0b175191c8d0ca6493340e97c11a6"
Sep 10 23:21:37.717371 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.717355    2585 scope.go:117] "RemoveContainer" containerID="905475e2eb6c689f15d00ea0ce98ac42713ce8229c8b91a927fabb16f22287fb"
Sep 10 23:21:37.730539 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.730510    2585 scope.go:117] "RemoveContainer" containerID="244a24246a9800a35284e0d5ee3515ad57b0b175191c8d0ca6493340e97c11a6"
Sep 10 23:21:37.730895 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:21:37.730870    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"244a24246a9800a35284e0d5ee3515ad57b0b175191c8d0ca6493340e97c11a6\": container with ID starting with 244a24246a9800a35284e0d5ee3515ad57b0b175191c8d0ca6493340e97c11a6 not found: ID does not exist" containerID="244a24246a9800a35284e0d5ee3515ad57b0b175191c8d0ca6493340e97c11a6"
Sep 10 23:21:37.730971 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.730906    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"244a24246a9800a35284e0d5ee3515ad57b0b175191c8d0ca6493340e97c11a6"} err="failed to get container status \"244a24246a9800a35284e0d5ee3515ad57b0b175191c8d0ca6493340e97c11a6\": rpc error: code = NotFound desc = could not find container \"244a24246a9800a35284e0d5ee3515ad57b0b175191c8d0ca6493340e97c11a6\": container with ID starting with 244a24246a9800a35284e0d5ee3515ad57b0b175191c8d0ca6493340e97c11a6 not found: ID does not exist"
Sep 10 23:21:37.730971 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.730925    2585 scope.go:117] "RemoveContainer" containerID="905475e2eb6c689f15d00ea0ce98ac42713ce8229c8b91a927fabb16f22287fb"
Sep 10 23:21:37.731205 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:21:37.731182    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"905475e2eb6c689f15d00ea0ce98ac42713ce8229c8b91a927fabb16f22287fb\": container with ID starting with 905475e2eb6c689f15d00ea0ce98ac42713ce8229c8b91a927fabb16f22287fb not found: ID does not exist" containerID="905475e2eb6c689f15d00ea0ce98ac42713ce8229c8b91a927fabb16f22287fb"
Sep 10 23:21:37.731262 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.731208    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"905475e2eb6c689f15d00ea0ce98ac42713ce8229c8b91a927fabb16f22287fb"} err="failed to get container status \"905475e2eb6c689f15d00ea0ce98ac42713ce8229c8b91a927fabb16f22287fb\": rpc error: code = NotFound desc = could not find container \"905475e2eb6c689f15d00ea0ce98ac42713ce8229c8b91a927fabb16f22287fb\": container with ID starting with 905475e2eb6c689f15d00ea0ce98ac42713ce8229c8b91a927fabb16f22287fb not found: ID does not exist"
Sep 10 23:21:37.732194 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.732182    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"]
Sep 10 23:21:37.734652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:37.734634    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6d5278a1-openshift-default-845d57b9b4-9gbl4"]
Sep 10 23:21:38.348265 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:21:38.348232    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc39d312-2210-420d-966e-5dd06716d490" path="/var/lib/kubelet/pods/dc39d312-2210-420d-966e-5dd06716d490/volumes"
Sep 10 23:22:26.871521 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.871485    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"]
Sep 10 23:22:26.872044 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.871923    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea5a9b17-63f5-4893-a14d-0881d1ffcb6a" containerName="payload-processing"
Sep 10 23:22:26.872044 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.871936    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea5a9b17-63f5-4893-a14d-0881d1ffcb6a" containerName="payload-processing"
Sep 10 23:22:26.872044 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.871949    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40521f68-b00b-49c2-97b1-d77337e45761" containerName="revoke-keys"
Sep 10 23:22:26.872044 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.871955    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="40521f68-b00b-49c2-97b1-d77337e45761" containerName="revoke-keys"
Sep 10 23:22:26.872044 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.871972    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy"
Sep 10 23:22:26.872044 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.871979    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy"
Sep 10 23:22:26.872044 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.871987    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy"
Sep 10 23:22:26.872044 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.871992    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy"
Sep 10 23:22:26.872335 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.872061    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea5a9b17-63f5-4893-a14d-0881d1ffcb6a" containerName="payload-processing"
Sep 10 23:22:26.872335 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.872070    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy"
Sep 10 23:22:26.872335 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.872076    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc39d312-2210-420d-966e-5dd06716d490" containerName="istio-proxy"
Sep 10 23:22:26.872335 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.872083    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="40521f68-b00b-49c2-97b1-d77337e45761" containerName="revoke-keys"
Sep 10 23:22:26.875215 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.875196    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:26.877525 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.877505    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-5052bd-openshift-default-dockercfg-flzl5\""
Sep 10 23:22:26.886969 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.886945    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"]
Sep 10 23:22:26.986223 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.986165    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/473b956a-c818-4f12-b90f-d9d49c74049c-istio-token\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:26.986429 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.986300    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-istio-data\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:26.986429 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.986359    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79g7t\" (UniqueName: \"kubernetes.io/projected/473b956a-c818-4f12-b90f-d9d49c74049c-kube-api-access-79g7t\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:26.986429 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.986388    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/473b956a-c818-4f12-b90f-d9d49c74049c-istio-podinfo\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:26.986429 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.986424    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-istio-envoy\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:26.986686 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.986458    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-credential-socket\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:26.986686 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.986514    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/473b956a-c818-4f12-b90f-d9d49c74049c-istiod-ca-cert\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:26.986686 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.986552    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-workload-socket\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:26.986686 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:26.986620    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-workload-certs\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.087197 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.087156    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-istio-data\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.087401 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.087212    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79g7t\" (UniqueName: \"kubernetes.io/projected/473b956a-c818-4f12-b90f-d9d49c74049c-kube-api-access-79g7t\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.087401 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.087242    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/473b956a-c818-4f12-b90f-d9d49c74049c-istio-podinfo\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.087401 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.087277    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-istio-envoy\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.087617 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.087422    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-credential-socket\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.087617 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.087503    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/473b956a-c818-4f12-b90f-d9d49c74049c-istiod-ca-cert\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.087617 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.087537    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-workload-socket\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.087617 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.087588    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-workload-certs\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.087617 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.087595    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-istio-data\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.087895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.087651    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/473b956a-c818-4f12-b90f-d9d49c74049c-istio-token\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.087895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.087776    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-credential-socket\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.087895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.087853    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-workload-socket\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.087895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.087866    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-workload-certs\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.088386 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.088366    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/473b956a-c818-4f12-b90f-d9d49c74049c-istiod-ca-cert\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.089742 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.089709    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-istio-envoy\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.089878 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.089861    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/473b956a-c818-4f12-b90f-d9d49c74049c-istio-podinfo\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.095114 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.095082    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/473b956a-c818-4f12-b90f-d9d49c74049c-istio-token\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.095337 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.095320    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79g7t\" (UniqueName: \"kubernetes.io/projected/473b956a-c818-4f12-b90f-d9d49c74049c-kube-api-access-79g7t\") pod \"e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") " pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.188086 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.187993    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:27.485451 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.485416    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"]
Sep 10 23:22:27.488130 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:22:27.488094    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod473b956a_c818_4f12_b90f_d9d49c74049c.slice/crio-782b043b3da4c7266788978232647082b7eaa07ae005acccacb1ce59e38d6e1d WatchSource:0}: Error finding container 782b043b3da4c7266788978232647082b7eaa07ae005acccacb1ce59e38d6e1d: Status 404 returned error can't find the container with id 782b043b3da4c7266788978232647082b7eaa07ae005acccacb1ce59e38d6e1d
Sep 10 23:22:27.491200 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.491165    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:22:27.491312 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.491243    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:22:27.491312 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:27.491288    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:22:28.028061 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:28.028005    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" event={"ID":"473b956a-c818-4f12-b90f-d9d49c74049c","Type":"ContainerStarted","Data":"f7dcd40f3a7499a7bdf3f81f0513a0032464dd01280317804aeacbfe2b4ac3e9"}
Sep 10 23:22:28.028500 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:28.028125    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" event={"ID":"473b956a-c818-4f12-b90f-d9d49c74049c","Type":"ContainerStarted","Data":"782b043b3da4c7266788978232647082b7eaa07ae005acccacb1ce59e38d6e1d"}
Sep 10 23:22:28.047148 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:28.047089    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" podStartSLOduration=2.047074372 podStartE2EDuration="2.047074372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:22:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:22:28.0459799 +0000 UTC m=+1460.224850865" watchObservedRunningTime="2026-09-10 23:22:28.047074372 +0000 UTC m=+1460.225945336"
Sep 10 23:22:28.188387 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:28.188338    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:28.193958 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:28.193931    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:29.034734 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:29.034705    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:29.035782 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:29.035760    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:31.768882 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:31.768847    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"]
Sep 10 23:22:31.772594 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:31.772549    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"
Sep 10 23:22:31.774682 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:31.774661    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-5052bd\""
Sep 10 23:22:31.774776 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:31.774728    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-5052bd-dockercfg-x8hd7\""
Sep 10 23:22:31.781451 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:31.781424    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"]
Sep 10 23:22:31.937997 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:31.937958    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cjmw\" (UniqueName: \"kubernetes.io/projected/d6b94c9d-305a-4c43-8fd1-59a777761837-kube-api-access-7cjmw\") pod \"payload-processing-e2e-api-a-5052bd-57546cb7-7st6m\" (UID: \"d6b94c9d-305a-4c43-8fd1-59a777761837\") " pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"
Sep 10 23:22:31.938169 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:31.938035    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6b94c9d-305a-4c43-8fd1-59a777761837-plugins-config-volume\") pod \"payload-processing-e2e-api-a-5052bd-57546cb7-7st6m\" (UID: \"d6b94c9d-305a-4c43-8fd1-59a777761837\") " pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"
Sep 10 23:22:32.039247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:32.039170    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cjmw\" (UniqueName: \"kubernetes.io/projected/d6b94c9d-305a-4c43-8fd1-59a777761837-kube-api-access-7cjmw\") pod \"payload-processing-e2e-api-a-5052bd-57546cb7-7st6m\" (UID: \"d6b94c9d-305a-4c43-8fd1-59a777761837\") " pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"
Sep 10 23:22:32.039247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:32.039225    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6b94c9d-305a-4c43-8fd1-59a777761837-plugins-config-volume\") pod \"payload-processing-e2e-api-a-5052bd-57546cb7-7st6m\" (UID: \"d6b94c9d-305a-4c43-8fd1-59a777761837\") " pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"
Sep 10 23:22:32.039906 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:32.039888    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6b94c9d-305a-4c43-8fd1-59a777761837-plugins-config-volume\") pod \"payload-processing-e2e-api-a-5052bd-57546cb7-7st6m\" (UID: \"d6b94c9d-305a-4c43-8fd1-59a777761837\") " pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"
Sep 10 23:22:32.047001 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:32.046982    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cjmw\" (UniqueName: \"kubernetes.io/projected/d6b94c9d-305a-4c43-8fd1-59a777761837-kube-api-access-7cjmw\") pod \"payload-processing-e2e-api-a-5052bd-57546cb7-7st6m\" (UID: \"d6b94c9d-305a-4c43-8fd1-59a777761837\") " pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"
Sep 10 23:22:32.084029 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:32.084001    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"
Sep 10 23:22:32.360229 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:32.360205    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"]
Sep 10 23:22:32.362131 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:22:32.362102    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6b94c9d_305a_4c43_8fd1_59a777761837.slice/crio-ff489afa8265952a9ec6cae3adcac3d5cb513f5a3a49e655f0d6ee94dc7c33e9 WatchSource:0}: Error finding container ff489afa8265952a9ec6cae3adcac3d5cb513f5a3a49e655f0d6ee94dc7c33e9: Status 404 returned error can't find the container with id ff489afa8265952a9ec6cae3adcac3d5cb513f5a3a49e655f0d6ee94dc7c33e9
Sep 10 23:22:33.066580 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:33.066525    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m" event={"ID":"d6b94c9d-305a-4c43-8fd1-59a777761837","Type":"ContainerStarted","Data":"fc97f8304bdb1e7b1507ce00ac826690a8dc609ce5adcff283aaa749537cf7fe"}
Sep 10 23:22:33.066997 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:33.066638    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m" event={"ID":"d6b94c9d-305a-4c43-8fd1-59a777761837","Type":"ContainerStarted","Data":"ff489afa8265952a9ec6cae3adcac3d5cb513f5a3a49e655f0d6ee94dc7c33e9"}
Sep 10 23:22:33.066997 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:33.066678    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"
Sep 10 23:22:33.083097 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:33.083046    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m" podStartSLOduration=2.083030779 podStartE2EDuration="2.083030779s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:22:33.08200614 +0000 UTC m=+1465.260877103" watchObservedRunningTime="2026-09-10 23:22:33.083030779 +0000 UTC m=+1465.261901765"
Sep 10 23:22:44.075286 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:44.075254    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"
Sep 10 23:22:49.176063 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:49.176021    2585 generic.go:356] "Generic (PLEG): container finished" podID="473b956a-c818-4f12-b90f-d9d49c74049c" containerID="f7dcd40f3a7499a7bdf3f81f0513a0032464dd01280317804aeacbfe2b4ac3e9" exitCode=0
Sep 10 23:22:49.176454 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:49.176094    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" event={"ID":"473b956a-c818-4f12-b90f-d9d49c74049c","Type":"ContainerDied","Data":"f7dcd40f3a7499a7bdf3f81f0513a0032464dd01280317804aeacbfe2b4ac3e9"}
Sep 10 23:22:49.176547 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:49.176533    2585 scope.go:117] "RemoveContainer" containerID="f7dcd40f3a7499a7bdf3f81f0513a0032464dd01280317804aeacbfe2b4ac3e9"
Sep 10 23:22:49.177736 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:49.177706    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:22:49.177838 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:49.177775    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:22:49.177838 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:49.177815    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:22:50.184110 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:50.184074    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" event={"ID":"473b956a-c818-4f12-b90f-d9d49c74049c","Type":"ContainerStarted","Data":"8323494865e89cd8ce372f0978ddb42bdf8b9927be274f2833c225ac296c45c1"}
Sep 10 23:22:50.188125 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:50.188108    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:50.188377 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:50.188356    2585 patch_prober.go:28] interesting pod/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Sep 10 23:22:50.188439 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:50.188400    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Sep 10 23:22:51.188957 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:51.188919    2585 patch_prober.go:28] interesting pod/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Sep 10 23:22:51.189367 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:51.188982    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Sep 10 23:22:52.188932 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:52.188894    2585 patch_prober.go:28] interesting pod/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Sep 10 23:22:52.189123 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:52.188960    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Sep 10 23:22:53.188946 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:53.188892    2585 patch_prober.go:28] interesting pod/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Sep 10 23:22:53.189133 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:53.188962    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Sep 10 23:22:54.189244 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:54.189207    2585 patch_prober.go:28] interesting pod/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Sep 10 23:22:54.189654 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:54.189270    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Sep 10 23:22:55.189228 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:55.189188    2585 patch_prober.go:28] interesting pod/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused" start-of-body=
Sep 10 23:22:55.189409 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:55.189247    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.84:15021/healthz/ready\": dial tcp 10.134.0.84:15021: connect: connection refused"
Sep 10 23:22:56.193141 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:56.193111    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:56.193515 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:56.193369    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:22:56.194171 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:22:56.194156    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:23:03.528140 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:03.528107    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"]
Sep 10 23:23:03.533214 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:03.533192    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"
Sep 10 23:23:03.535476 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:03.535454    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-44c67e\""
Sep 10 23:23:03.535476 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:03.535470    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-44c67e-dockercfg-94j9b\""
Sep 10 23:23:03.545042 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:03.545013    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"]
Sep 10 23:23:03.665317 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:03.665274    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clpsg\" (UniqueName: \"kubernetes.io/projected/cbc6656f-7e1b-4b8c-9bed-6460a4dfa070-kube-api-access-clpsg\") pod \"payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z\" (UID: \"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070\") " pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"
Sep 10 23:23:03.665518 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:03.665436    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbc6656f-7e1b-4b8c-9bed-6460a4dfa070-plugins-config-volume\") pod \"payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z\" (UID: \"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070\") " pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"
Sep 10 23:23:03.766193 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:03.766162    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbc6656f-7e1b-4b8c-9bed-6460a4dfa070-plugins-config-volume\") pod \"payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z\" (UID: \"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070\") " pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"
Sep 10 23:23:03.766360 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:03.766278    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clpsg\" (UniqueName: \"kubernetes.io/projected/cbc6656f-7e1b-4b8c-9bed-6460a4dfa070-kube-api-access-clpsg\") pod \"payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z\" (UID: \"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070\") " pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"
Sep 10 23:23:03.766942 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:03.766922    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbc6656f-7e1b-4b8c-9bed-6460a4dfa070-plugins-config-volume\") pod \"payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z\" (UID: \"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070\") " pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"
Sep 10 23:23:03.774052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:03.774028    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clpsg\" (UniqueName: \"kubernetes.io/projected/cbc6656f-7e1b-4b8c-9bed-6460a4dfa070-kube-api-access-clpsg\") pod \"payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z\" (UID: \"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070\") " pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"
Sep 10 23:23:03.852133 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:03.852096    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"
Sep 10 23:23:04.138932 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:04.138905    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"]
Sep 10 23:23:04.140749 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:23:04.140715    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc6656f_7e1b_4b8c_9bed_6460a4dfa070.slice/crio-f6e355725c00b39a29d5530cbd33c801a7d5d77800c95b5f6d8e5f757b4c933b WatchSource:0}: Error finding container f6e355725c00b39a29d5530cbd33c801a7d5d77800c95b5f6d8e5f757b4c933b: Status 404 returned error can't find the container with id f6e355725c00b39a29d5530cbd33c801a7d5d77800c95b5f6d8e5f757b4c933b
Sep 10 23:23:04.303295 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:04.303249    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z" event={"ID":"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070","Type":"ContainerStarted","Data":"33e039623fcc442566089db2fc1d267f17a56620078ad6d166d48573c7e150a1"}
Sep 10 23:23:04.303493 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:04.303319    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z" event={"ID":"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070","Type":"ContainerStarted","Data":"f6e355725c00b39a29d5530cbd33c801a7d5d77800c95b5f6d8e5f757b4c933b"}
Sep 10 23:23:04.303593 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:04.303519    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"
Sep 10 23:23:04.319496 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:04.319449    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z" podStartSLOduration=1.319432513 podStartE2EDuration="1.319432513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:23:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:23:04.318997512 +0000 UTC m=+1496.497868472" watchObservedRunningTime="2026-09-10 23:23:04.319432513 +0000 UTC m=+1496.498303495"
Sep 10 23:23:08.432531 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:08.432501    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:23:08.440234 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:08.440210    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:23:08.440400 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:08.440383    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:23:08.447180 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:08.447165    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:23:08.584274 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:08.584246    2585 scope.go:117] "RemoveContainer" containerID="ce970bd99ce9dbd0d07c1896aac69f3ca7fd5378e4fc33d51c786602e5784582"
Sep 10 23:23:08.595369 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:08.595345    2585 scope.go:117] "RemoveContainer" containerID="18fde01ceeed61614f949126a9feabdc67ac8a232dea909b2b14b05b635ec51c"
Sep 10 23:23:15.311116 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:15.311082    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"
Sep 10 23:23:29.320836 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:29.320800    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks"]
Sep 10 23:23:29.324670 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:29.324644    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks"
Sep 10 23:23:29.328107 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:29.328071    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:23:29.328629 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:29.328590    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:23:29.332753 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:29.332723    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks"]
Sep 10 23:23:29.423998 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:29.423964    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/315a8499-f7ae-4102-976b-e67e1b20a528-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5052bd-6lhks\" (UID: \"315a8499-f7ae-4102-976b-e67e1b20a528\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks"
Sep 10 23:23:29.525041 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:29.525003    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/315a8499-f7ae-4102-976b-e67e1b20a528-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5052bd-6lhks\" (UID: \"315a8499-f7ae-4102-976b-e67e1b20a528\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks"
Sep 10 23:23:29.525643 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:29.525626    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/315a8499-f7ae-4102-976b-e67e1b20a528-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-5052bd-6lhks\" (UID: \"315a8499-f7ae-4102-976b-e67e1b20a528\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks"
Sep 10 23:23:29.639393 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:29.639306    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks"
Sep 10 23:23:29.916210 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:29.916182    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks"]
Sep 10 23:23:29.917206 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:23:29.917182    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315a8499_f7ae_4102_976b_e67e1b20a528.slice/crio-dc973d3e093d164d3a12791b376d04efdb5ecf014eeca44dad6c5ae305eb3630 WatchSource:0}: Error finding container dc973d3e093d164d3a12791b376d04efdb5ecf014eeca44dad6c5ae305eb3630: Status 404 returned error can't find the container with id dc973d3e093d164d3a12791b376d04efdb5ecf014eeca44dad6c5ae305eb3630
Sep 10 23:23:30.477378 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:30.477337    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks" event={"ID":"315a8499-f7ae-4102-976b-e67e1b20a528","Type":"ContainerStarted","Data":"888ad235ce1d9893323ef6ba748d249363f79ebd51fb96c753f63abb7780e270"}
Sep 10 23:23:30.477783 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:30.477415    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks" event={"ID":"315a8499-f7ae-4102-976b-e67e1b20a528","Type":"ContainerStarted","Data":"dc973d3e093d164d3a12791b376d04efdb5ecf014eeca44dad6c5ae305eb3630"}
Sep 10 23:23:30.494859 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:30.494802    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks" podStartSLOduration=1.494784023 podStartE2EDuration="1.494784023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:23:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:23:30.493190244 +0000 UTC m=+1522.672061208" watchObservedRunningTime="2026-09-10 23:23:30.494784023 +0000 UTC m=+1522.673654985"
Sep 10 23:23:31.486958 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:31.486923    2585 generic.go:356] "Generic (PLEG): container finished" podID="315a8499-f7ae-4102-976b-e67e1b20a528" containerID="888ad235ce1d9893323ef6ba748d249363f79ebd51fb96c753f63abb7780e270" exitCode=0
Sep 10 23:23:31.487468 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:31.486976    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks" event={"ID":"315a8499-f7ae-4102-976b-e67e1b20a528","Type":"ContainerDied","Data":"888ad235ce1d9893323ef6ba748d249363f79ebd51fb96c753f63abb7780e270"}
Sep 10 23:23:32.639347 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:32.639319    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks"
Sep 10 23:23:32.757629 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:32.757514    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/315a8499-f7ae-4102-976b-e67e1b20a528-maas-api-service-ca\") pod \"315a8499-f7ae-4102-976b-e67e1b20a528\" (UID: \"315a8499-f7ae-4102-976b-e67e1b20a528\") "
Sep 10 23:23:32.757851 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:32.757824    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/315a8499-f7ae-4102-976b-e67e1b20a528-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "315a8499-f7ae-4102-976b-e67e1b20a528" (UID: "315a8499-f7ae-4102-976b-e67e1b20a528"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:23:32.858578 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:32.858525    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/315a8499-f7ae-4102-976b-e67e1b20a528-maas-api-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:23:33.501835 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:33.501806    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks"
Sep 10 23:23:33.502627 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:33.501826    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks" event={"ID":"315a8499-f7ae-4102-976b-e67e1b20a528","Type":"ContainerDied","Data":"dc973d3e093d164d3a12791b376d04efdb5ecf014eeca44dad6c5ae305eb3630"}
Sep 10 23:23:33.502754 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:33.502717    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc973d3e093d164d3a12791b376d04efdb5ecf014eeca44dad6c5ae305eb3630"
Sep 10 23:23:36.648114 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.648066    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"]
Sep 10 23:23:36.648685 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.648589    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="315a8499-f7ae-4102-976b-e67e1b20a528" containerName="revoke-keys"
Sep 10 23:23:36.648685 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.648607    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="315a8499-f7ae-4102-976b-e67e1b20a528" containerName="revoke-keys"
Sep 10 23:23:36.648815 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.648689    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="315a8499-f7ae-4102-976b-e67e1b20a528" containerName="revoke-keys"
Sep 10 23:23:36.652483 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.652462    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.654698 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.654676    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-2da572\"/\"default-dockercfg-cc4n9\""
Sep 10 23:23:36.654816 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.654674    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-2da572\"/\"kube-root-ca.crt\""
Sep 10 23:23:36.655470 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.655445    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-2da572\"/\"openshift-service-ca.crt\""
Sep 10 23:23:36.655892 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.655874    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-2da572\"/\"rate-test-model-2da572-kserve-self-signed-certs\""
Sep 10 23:23:36.662624 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.662551    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"]
Sep 10 23:23:36.799270 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.799218    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw5pk\" (UniqueName: \"kubernetes.io/projected/4a73329b-3899-43de-8ef1-ae8107eed556-kube-api-access-tw5pk\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.799439 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.799280    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-home\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.799439 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.799410    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-model-cache\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.799515 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.799457    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a73329b-3899-43de-8ef1-ae8107eed556-tls-certs\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.799581 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.799531    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-dshm\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.799634 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.799617    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-tmp-dir\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.900450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.900360    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw5pk\" (UniqueName: \"kubernetes.io/projected/4a73329b-3899-43de-8ef1-ae8107eed556-kube-api-access-tw5pk\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.900450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.900401    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-home\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.900450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.900433    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-model-cache\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.900450 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.900452    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a73329b-3899-43de-8ef1-ae8107eed556-tls-certs\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.900851 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.900483    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-dshm\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.900851 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.900520    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-tmp-dir\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.901002 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.900886    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-model-cache\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.901002 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.900933    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-tmp-dir\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.901002 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.900966    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-home\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.902899 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.902875    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-dshm\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.903358 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.903336    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a73329b-3899-43de-8ef1-ae8107eed556-tls-certs\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.909645 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.909623    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw5pk\" (UniqueName: \"kubernetes.io/projected/4a73329b-3899-43de-8ef1-ae8107eed556-kube-api-access-tw5pk\") pod \"rate-test-model-2da572-kserve-cb8c9f6b7-qd27t\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") " pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:36.962967 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:36.962929    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:37.248540 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:37.248500    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"]
Sep 10 23:23:37.251778 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:23:37.251726    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a73329b_3899_43de_8ef1_ae8107eed556.slice/crio-bbdf9e66c6e4b339e6b32897a310bdc3bee79036832f5cc292223f5f49d050f9 WatchSource:0}: Error finding container bbdf9e66c6e4b339e6b32897a310bdc3bee79036832f5cc292223f5f49d050f9: Status 404 returned error can't find the container with id bbdf9e66c6e4b339e6b32897a310bdc3bee79036832f5cc292223f5f49d050f9
Sep 10 23:23:37.256689 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:37.256635    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:23:37.535929 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:37.535845    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t" event={"ID":"4a73329b-3899-43de-8ef1-ae8107eed556","Type":"ContainerStarted","Data":"bbdf9e66c6e4b339e6b32897a310bdc3bee79036832f5cc292223f5f49d050f9"}
Sep 10 23:23:38.543527 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:38.543492    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t" event={"ID":"4a73329b-3899-43de-8ef1-ae8107eed556","Type":"ContainerStarted","Data":"d2c613560e394aec65a8f4845fcff7712faad286b5553c4375759f084250d6d0"}
Sep 10 23:23:38.560505 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:38.560443    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t" podStartSLOduration=1.477526689 podStartE2EDuration="2.560420336s" totalImagesPullingTime="1.082893647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:23:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:23:38.559980509 +0000 UTC m=+1530.738851507" watchObservedRunningTime="2026-09-10 23:23:38.560420336 +0000 UTC m=+1530.739291320"
Sep 10 23:23:45.209774 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.209733    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"]
Sep 10 23:23:45.210278 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.209987    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m" podUID="d6b94c9d-305a-4c43-8fd1-59a777761837" containerName="payload-processing" containerID="cri-o://fc97f8304bdb1e7b1507ce00ac826690a8dc609ce5adcff283aaa749537cf7fe" gracePeriod=30
Sep 10 23:23:45.365670 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.365625    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks"]
Sep 10 23:23:45.368474 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.368441    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-5052bd-6lhks"]
Sep 10 23:23:45.503252 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.503217    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"
Sep 10 23:23:45.592718 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.592669    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cjmw\" (UniqueName: \"kubernetes.io/projected/d6b94c9d-305a-4c43-8fd1-59a777761837-kube-api-access-7cjmw\") pod \"d6b94c9d-305a-4c43-8fd1-59a777761837\" (UID: \"d6b94c9d-305a-4c43-8fd1-59a777761837\") "
Sep 10 23:23:45.592928 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.592795    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6b94c9d-305a-4c43-8fd1-59a777761837-plugins-config-volume\") pod \"d6b94c9d-305a-4c43-8fd1-59a777761837\" (UID: \"d6b94c9d-305a-4c43-8fd1-59a777761837\") "
Sep 10 23:23:45.593147 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.593125    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6b94c9d-305a-4c43-8fd1-59a777761837-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d6b94c9d-305a-4c43-8fd1-59a777761837" (UID: "d6b94c9d-305a-4c43-8fd1-59a777761837"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:23:45.594837 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.594805    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b94c9d-305a-4c43-8fd1-59a777761837-kube-api-access-7cjmw" (OuterVolumeSpecName: "kube-api-access-7cjmw") pod "d6b94c9d-305a-4c43-8fd1-59a777761837" (UID: "d6b94c9d-305a-4c43-8fd1-59a777761837"). InnerVolumeSpecName "kube-api-access-7cjmw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:23:45.595793 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.595766    2585 generic.go:356] "Generic (PLEG): container finished" podID="d6b94c9d-305a-4c43-8fd1-59a777761837" containerID="fc97f8304bdb1e7b1507ce00ac826690a8dc609ce5adcff283aaa749537cf7fe" exitCode=0
Sep 10 23:23:45.595902 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.595824    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"
Sep 10 23:23:45.595902 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.595842    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m" event={"ID":"d6b94c9d-305a-4c43-8fd1-59a777761837","Type":"ContainerDied","Data":"fc97f8304bdb1e7b1507ce00ac826690a8dc609ce5adcff283aaa749537cf7fe"}
Sep 10 23:23:45.595902 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.595885    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m" event={"ID":"d6b94c9d-305a-4c43-8fd1-59a777761837","Type":"ContainerDied","Data":"ff489afa8265952a9ec6cae3adcac3d5cb513f5a3a49e655f0d6ee94dc7c33e9"}
Sep 10 23:23:45.596078 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.595910    2585 scope.go:117] "RemoveContainer" containerID="fc97f8304bdb1e7b1507ce00ac826690a8dc609ce5adcff283aaa749537cf7fe"
Sep 10 23:23:45.618872 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.618848    2585 scope.go:117] "RemoveContainer" containerID="fc97f8304bdb1e7b1507ce00ac826690a8dc609ce5adcff283aaa749537cf7fe"
Sep 10 23:23:45.619250 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:23:45.619229    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc97f8304bdb1e7b1507ce00ac826690a8dc609ce5adcff283aaa749537cf7fe\": container with ID starting with fc97f8304bdb1e7b1507ce00ac826690a8dc609ce5adcff283aaa749537cf7fe not found: ID does not exist" containerID="fc97f8304bdb1e7b1507ce00ac826690a8dc609ce5adcff283aaa749537cf7fe"
Sep 10 23:23:45.619325 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.619262    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc97f8304bdb1e7b1507ce00ac826690a8dc609ce5adcff283aaa749537cf7fe"} err="failed to get container status \"fc97f8304bdb1e7b1507ce00ac826690a8dc609ce5adcff283aaa749537cf7fe\": rpc error: code = NotFound desc = could not find container \"fc97f8304bdb1e7b1507ce00ac826690a8dc609ce5adcff283aaa749537cf7fe\": container with ID starting with fc97f8304bdb1e7b1507ce00ac826690a8dc609ce5adcff283aaa749537cf7fe not found: ID does not exist"
Sep 10 23:23:45.629653 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.629615    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"]
Sep 10 23:23:45.632136 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.632117    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-5052bd-57546cb7-7st6m"]
Sep 10 23:23:45.694673 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.694642    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cjmw\" (UniqueName: \"kubernetes.io/projected/d6b94c9d-305a-4c43-8fd1-59a777761837-kube-api-access-7cjmw\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:23:45.694673 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:45.694668    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6b94c9d-305a-4c43-8fd1-59a777761837-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:23:46.343140 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:46.343104    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="315a8499-f7ae-4102-976b-e67e1b20a528" path="/var/lib/kubelet/pods/315a8499-f7ae-4102-976b-e67e1b20a528/volumes"
Sep 10 23:23:46.343634 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:46.343477    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6b94c9d-305a-4c43-8fd1-59a777761837" path="/var/lib/kubelet/pods/d6b94c9d-305a-4c43-8fd1-59a777761837/volumes"
Sep 10 23:23:46.963671 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:46.963630    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:46.963879 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:46.963694    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:46.976001 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:46.975972    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:47.622651 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:47.622622    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:23:51.876487 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:51.876449    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"]
Sep 10 23:23:51.876932 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:51.876782    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy" containerID="cri-o://8323494865e89cd8ce372f0978ddb42bdf8b9927be274f2833c225ac296c45c1" gracePeriod=30
Sep 10 23:23:52.208933 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:52.208839    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw"]
Sep 10 23:23:52.209367 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:52.209346    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b94c9d-305a-4c43-8fd1-59a777761837" containerName="payload-processing"
Sep 10 23:23:52.209469 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:52.209369    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b94c9d-305a-4c43-8fd1-59a777761837" containerName="payload-processing"
Sep 10 23:23:52.209525 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:52.209499    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b94c9d-305a-4c43-8fd1-59a777761837" containerName="payload-processing"
Sep 10 23:23:52.213910 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:52.213887    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw"
Sep 10 23:23:52.216326 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:52.216292    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:23:52.216463 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:52.216444    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:23:52.220511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:52.220479    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw"]
Sep 10 23:23:52.259983 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:52.259947    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55618caf-09a3-4da2-8a8c-b570e0db3bc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-44c67e-n76nw\" (UID: \"55618caf-09a3-4da2-8a8c-b570e0db3bc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw"
Sep 10 23:23:52.360972 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:52.360942    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55618caf-09a3-4da2-8a8c-b570e0db3bc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-44c67e-n76nw\" (UID: \"55618caf-09a3-4da2-8a8c-b570e0db3bc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw"
Sep 10 23:23:52.361625 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:52.361588    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55618caf-09a3-4da2-8a8c-b570e0db3bc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-44c67e-n76nw\" (UID: \"55618caf-09a3-4da2-8a8c-b570e0db3bc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw"
Sep 10 23:23:52.527333 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:52.527245    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw"
Sep 10 23:23:52.801309 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:52.801276    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw"]
Sep 10 23:23:52.806142 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:23:52.805724    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55618caf_09a3_4da2_8a8c_b570e0db3bc5.slice/crio-eedacb456e29b736b1209daf5c4cdc2aee093ad6167e68aeaefcf65e8251c35e WatchSource:0}: Error finding container eedacb456e29b736b1209daf5c4cdc2aee093ad6167e68aeaefcf65e8251c35e: Status 404 returned error can't find the container with id eedacb456e29b736b1209daf5c4cdc2aee093ad6167e68aeaefcf65e8251c35e
Sep 10 23:23:53.649232 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:53.649199    2585 generic.go:356] "Generic (PLEG): container finished" podID="55618caf-09a3-4da2-8a8c-b570e0db3bc5" containerID="c38b89d503103242158444836d724b96cf84b78063c2e8afed81874844eed6e9" exitCode=0
Sep 10 23:23:53.649625 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:53.649285    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw" event={"ID":"55618caf-09a3-4da2-8a8c-b570e0db3bc5","Type":"ContainerDied","Data":"c38b89d503103242158444836d724b96cf84b78063c2e8afed81874844eed6e9"}
Sep 10 23:23:53.649625 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:53.649332    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw" event={"ID":"55618caf-09a3-4da2-8a8c-b570e0db3bc5","Type":"ContainerStarted","Data":"eedacb456e29b736b1209daf5c4cdc2aee093ad6167e68aeaefcf65e8251c35e"}
Sep 10 23:23:54.797506 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:54.797475    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw"
Sep 10 23:23:54.885935 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:54.885898    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55618caf-09a3-4da2-8a8c-b570e0db3bc5-maas-api-service-ca\") pod \"55618caf-09a3-4da2-8a8c-b570e0db3bc5\" (UID: \"55618caf-09a3-4da2-8a8c-b570e0db3bc5\") "
Sep 10 23:23:54.886441 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:54.886412    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55618caf-09a3-4da2-8a8c-b570e0db3bc5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "55618caf-09a3-4da2-8a8c-b570e0db3bc5" (UID: "55618caf-09a3-4da2-8a8c-b570e0db3bc5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:23:54.886604 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:54.886484    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/55618caf-09a3-4da2-8a8c-b570e0db3bc5-maas-api-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:23:55.662295 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:55.662264    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw"
Sep 10 23:23:55.662480 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:55.662301    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw" event={"ID":"55618caf-09a3-4da2-8a8c-b570e0db3bc5","Type":"ContainerDied","Data":"eedacb456e29b736b1209daf5c4cdc2aee093ad6167e68aeaefcf65e8251c35e"}
Sep 10 23:23:55.662480 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:55.662352    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eedacb456e29b736b1209daf5c4cdc2aee093ad6167e68aeaefcf65e8251c35e"
Sep 10 23:23:56.196050 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:56.195997    2585 patch_prober.go:28] interesting pod/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 23:23:56.196422 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:56.196089    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 23:23:57.141069 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.141001    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:23:57.210846 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.210808    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-istio-envoy\") pod \"473b956a-c818-4f12-b90f-d9d49c74049c\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") "
Sep 10 23:23:57.211275 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.210874    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-credential-socket\") pod \"473b956a-c818-4f12-b90f-d9d49c74049c\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") "
Sep 10 23:23:57.211275 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.210896    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-workload-socket\") pod \"473b956a-c818-4f12-b90f-d9d49c74049c\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") "
Sep 10 23:23:57.211275 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.210925    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/473b956a-c818-4f12-b90f-d9d49c74049c-istio-podinfo\") pod \"473b956a-c818-4f12-b90f-d9d49c74049c\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") "
Sep 10 23:23:57.211275 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.210949    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-79g7t\" (UniqueName: \"kubernetes.io/projected/473b956a-c818-4f12-b90f-d9d49c74049c-kube-api-access-79g7t\") pod \"473b956a-c818-4f12-b90f-d9d49c74049c\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") "
Sep 10 23:23:57.211275 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.210993    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-istio-data\") pod \"473b956a-c818-4f12-b90f-d9d49c74049c\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") "
Sep 10 23:23:57.211275 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.211073    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/473b956a-c818-4f12-b90f-d9d49c74049c-istio-token\") pod \"473b956a-c818-4f12-b90f-d9d49c74049c\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") "
Sep 10 23:23:57.211275 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.211110    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-workload-certs\") pod \"473b956a-c818-4f12-b90f-d9d49c74049c\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") "
Sep 10 23:23:57.211275 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.211145    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "473b956a-c818-4f12-b90f-d9d49c74049c" (UID: "473b956a-c818-4f12-b90f-d9d49c74049c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:23:57.211275 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.211178    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/473b956a-c818-4f12-b90f-d9d49c74049c-istiod-ca-cert\") pod \"473b956a-c818-4f12-b90f-d9d49c74049c\" (UID: \"473b956a-c818-4f12-b90f-d9d49c74049c\") "
Sep 10 23:23:57.211275 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.211230    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "473b956a-c818-4f12-b90f-d9d49c74049c" (UID: "473b956a-c818-4f12-b90f-d9d49c74049c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:23:57.211784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.211429    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "473b956a-c818-4f12-b90f-d9d49c74049c" (UID: "473b956a-c818-4f12-b90f-d9d49c74049c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:23:57.211784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.211444    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/473b956a-c818-4f12-b90f-d9d49c74049c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "473b956a-c818-4f12-b90f-d9d49c74049c" (UID: "473b956a-c818-4f12-b90f-d9d49c74049c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:23:57.211784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.211505    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-istio-data" (OuterVolumeSpecName: "istio-data") pod "473b956a-c818-4f12-b90f-d9d49c74049c" (UID: "473b956a-c818-4f12-b90f-d9d49c74049c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:23:57.211784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.211605    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:23:57.211784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.211620    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:23:57.211784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.211634    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:23:57.211784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.211647    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/473b956a-c818-4f12-b90f-d9d49c74049c-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:23:57.213200 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.213168    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/473b956a-c818-4f12-b90f-d9d49c74049c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "473b956a-c818-4f12-b90f-d9d49c74049c" (UID: "473b956a-c818-4f12-b90f-d9d49c74049c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:23:57.213350 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.213232    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "473b956a-c818-4f12-b90f-d9d49c74049c" (UID: "473b956a-c818-4f12-b90f-d9d49c74049c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:23:57.213664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.213642    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/473b956a-c818-4f12-b90f-d9d49c74049c-istio-token" (OuterVolumeSpecName: "istio-token") pod "473b956a-c818-4f12-b90f-d9d49c74049c" (UID: "473b956a-c818-4f12-b90f-d9d49c74049c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:23:57.213746 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.213675    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/473b956a-c818-4f12-b90f-d9d49c74049c-kube-api-access-79g7t" (OuterVolumeSpecName: "kube-api-access-79g7t") pod "473b956a-c818-4f12-b90f-d9d49c74049c" (UID: "473b956a-c818-4f12-b90f-d9d49c74049c"). InnerVolumeSpecName "kube-api-access-79g7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:23:57.312254 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.312213    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/473b956a-c818-4f12-b90f-d9d49c74049c-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:23:57.312254 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.312250    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-79g7t\" (UniqueName: \"kubernetes.io/projected/473b956a-c818-4f12-b90f-d9d49c74049c-kube-api-access-79g7t\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:23:57.312254 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.312260    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:23:57.312494 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.312269    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/473b956a-c818-4f12-b90f-d9d49c74049c-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:23:57.312494 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.312277    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/473b956a-c818-4f12-b90f-d9d49c74049c-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:23:57.676103 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.676073    2585 generic.go:356] "Generic (PLEG): container finished" podID="473b956a-c818-4f12-b90f-d9d49c74049c" containerID="8323494865e89cd8ce372f0978ddb42bdf8b9927be274f2833c225ac296c45c1" exitCode=0
Sep 10 23:23:57.676281 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.676122    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"
Sep 10 23:23:57.676281 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.676160    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" event={"ID":"473b956a-c818-4f12-b90f-d9d49c74049c","Type":"ContainerDied","Data":"8323494865e89cd8ce372f0978ddb42bdf8b9927be274f2833c225ac296c45c1"}
Sep 10 23:23:57.676281 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.676221    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f" event={"ID":"473b956a-c818-4f12-b90f-d9d49c74049c","Type":"ContainerDied","Data":"782b043b3da4c7266788978232647082b7eaa07ae005acccacb1ce59e38d6e1d"}
Sep 10 23:23:57.676281 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.676251    2585 scope.go:117] "RemoveContainer" containerID="8323494865e89cd8ce372f0978ddb42bdf8b9927be274f2833c225ac296c45c1"
Sep 10 23:23:57.687046 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.687025    2585 scope.go:117] "RemoveContainer" containerID="f7dcd40f3a7499a7bdf3f81f0513a0032464dd01280317804aeacbfe2b4ac3e9"
Sep 10 23:23:57.695525 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.695507    2585 scope.go:117] "RemoveContainer" containerID="8323494865e89cd8ce372f0978ddb42bdf8b9927be274f2833c225ac296c45c1"
Sep 10 23:23:57.695887 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:23:57.695867    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8323494865e89cd8ce372f0978ddb42bdf8b9927be274f2833c225ac296c45c1\": container with ID starting with 8323494865e89cd8ce372f0978ddb42bdf8b9927be274f2833c225ac296c45c1 not found: ID does not exist" containerID="8323494865e89cd8ce372f0978ddb42bdf8b9927be274f2833c225ac296c45c1"
Sep 10 23:23:57.695984 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.695895    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8323494865e89cd8ce372f0978ddb42bdf8b9927be274f2833c225ac296c45c1"} err="failed to get container status \"8323494865e89cd8ce372f0978ddb42bdf8b9927be274f2833c225ac296c45c1\": rpc error: code = NotFound desc = could not find container \"8323494865e89cd8ce372f0978ddb42bdf8b9927be274f2833c225ac296c45c1\": container with ID starting with 8323494865e89cd8ce372f0978ddb42bdf8b9927be274f2833c225ac296c45c1 not found: ID does not exist"
Sep 10 23:23:57.695984 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.695913    2585 scope.go:117] "RemoveContainer" containerID="f7dcd40f3a7499a7bdf3f81f0513a0032464dd01280317804aeacbfe2b4ac3e9"
Sep 10 23:23:57.696218 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:23:57.696199    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7dcd40f3a7499a7bdf3f81f0513a0032464dd01280317804aeacbfe2b4ac3e9\": container with ID starting with f7dcd40f3a7499a7bdf3f81f0513a0032464dd01280317804aeacbfe2b4ac3e9 not found: ID does not exist" containerID="f7dcd40f3a7499a7bdf3f81f0513a0032464dd01280317804aeacbfe2b4ac3e9"
Sep 10 23:23:57.696283 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.696224    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7dcd40f3a7499a7bdf3f81f0513a0032464dd01280317804aeacbfe2b4ac3e9"} err="failed to get container status \"f7dcd40f3a7499a7bdf3f81f0513a0032464dd01280317804aeacbfe2b4ac3e9\": rpc error: code = NotFound desc = could not find container \"f7dcd40f3a7499a7bdf3f81f0513a0032464dd01280317804aeacbfe2b4ac3e9\": container with ID starting with f7dcd40f3a7499a7bdf3f81f0513a0032464dd01280317804aeacbfe2b4ac3e9 not found: ID does not exist"
Sep 10 23:23:57.701333 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.701307    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"]
Sep 10 23:23:57.705126 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:57.705090    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-5052bd-openshift-default-5f96c7cbd-nw57f"]
Sep 10 23:23:58.343332 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:23:58.343297    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" path="/var/lib/kubelet/pods/473b956a-c818-4f12-b90f-d9d49c74049c/volumes"
Sep 10 23:24:08.196771 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.196733    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"]
Sep 10 23:24:08.197800 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.197741    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z" podUID="cbc6656f-7e1b-4b8c-9bed-6460a4dfa070" containerName="payload-processing" containerID="cri-o://33e039623fcc442566089db2fc1d267f17a56620078ad6d166d48573c7e150a1" gracePeriod=30
Sep 10 23:24:08.355710 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.355675    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw"]
Sep 10 23:24:08.358274 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.358250    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-44c67e-n76nw"]
Sep 10 23:24:08.473997 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.473970    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"
Sep 10 23:24:08.523290 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.523254    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clpsg\" (UniqueName: \"kubernetes.io/projected/cbc6656f-7e1b-4b8c-9bed-6460a4dfa070-kube-api-access-clpsg\") pod \"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070\" (UID: \"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070\") "
Sep 10 23:24:08.524299 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.524277    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbc6656f-7e1b-4b8c-9bed-6460a4dfa070-plugins-config-volume\") pod \"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070\" (UID: \"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070\") "
Sep 10 23:24:08.525422 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.525389    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbc6656f-7e1b-4b8c-9bed-6460a4dfa070-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cbc6656f-7e1b-4b8c-9bed-6460a4dfa070" (UID: "cbc6656f-7e1b-4b8c-9bed-6460a4dfa070"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:24:08.531287 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.531236    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc6656f-7e1b-4b8c-9bed-6460a4dfa070-kube-api-access-clpsg" (OuterVolumeSpecName: "kube-api-access-clpsg") pod "cbc6656f-7e1b-4b8c-9bed-6460a4dfa070" (UID: "cbc6656f-7e1b-4b8c-9bed-6460a4dfa070"). InnerVolumeSpecName "kube-api-access-clpsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:24:08.622887 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.622856    2585 scope.go:117] "RemoveContainer" containerID="20182c53a066acd905c47143630db6a8567e2e94c5af29fb220c293b79844207"
Sep 10 23:24:08.625375 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.625341    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cbc6656f-7e1b-4b8c-9bed-6460a4dfa070-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:08.625375 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.625367    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clpsg\" (UniqueName: \"kubernetes.io/projected/cbc6656f-7e1b-4b8c-9bed-6460a4dfa070-kube-api-access-clpsg\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:08.631922 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.631899    2585 scope.go:117] "RemoveContainer" containerID="4c76c1368710fd8aa150854669159ea394f1d9ddf38adb3738f821e94d6ece9d"
Sep 10 23:24:08.755160 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.755073    2585 generic.go:356] "Generic (PLEG): container finished" podID="cbc6656f-7e1b-4b8c-9bed-6460a4dfa070" containerID="33e039623fcc442566089db2fc1d267f17a56620078ad6d166d48573c7e150a1" exitCode=0
Sep 10 23:24:08.755160 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.755123    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"
Sep 10 23:24:08.755347 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.755155    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z" event={"ID":"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070","Type":"ContainerDied","Data":"33e039623fcc442566089db2fc1d267f17a56620078ad6d166d48573c7e150a1"}
Sep 10 23:24:08.755347 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.755209    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z" event={"ID":"cbc6656f-7e1b-4b8c-9bed-6460a4dfa070","Type":"ContainerDied","Data":"f6e355725c00b39a29d5530cbd33c801a7d5d77800c95b5f6d8e5f757b4c933b"}
Sep 10 23:24:08.755347 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.755247    2585 scope.go:117] "RemoveContainer" containerID="33e039623fcc442566089db2fc1d267f17a56620078ad6d166d48573c7e150a1"
Sep 10 23:24:08.764873 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.764854    2585 scope.go:117] "RemoveContainer" containerID="33e039623fcc442566089db2fc1d267f17a56620078ad6d166d48573c7e150a1"
Sep 10 23:24:08.765145 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:24:08.765126    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33e039623fcc442566089db2fc1d267f17a56620078ad6d166d48573c7e150a1\": container with ID starting with 33e039623fcc442566089db2fc1d267f17a56620078ad6d166d48573c7e150a1 not found: ID does not exist" containerID="33e039623fcc442566089db2fc1d267f17a56620078ad6d166d48573c7e150a1"
Sep 10 23:24:08.765213 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.765157    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e039623fcc442566089db2fc1d267f17a56620078ad6d166d48573c7e150a1"} err="failed to get container status \"33e039623fcc442566089db2fc1d267f17a56620078ad6d166d48573c7e150a1\": rpc error: code = NotFound desc = could not find container \"33e039623fcc442566089db2fc1d267f17a56620078ad6d166d48573c7e150a1\": container with ID starting with 33e039623fcc442566089db2fc1d267f17a56620078ad6d166d48573c7e150a1 not found: ID does not exist"
Sep 10 23:24:08.778128 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.778101    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"]
Sep 10 23:24:08.781797 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:08.781768    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-44c67e-674fd556bc-z8d2z"]
Sep 10 23:24:10.343707 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:10.343675    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55618caf-09a3-4da2-8a8c-b570e0db3bc5" path="/var/lib/kubelet/pods/55618caf-09a3-4da2-8a8c-b570e0db3bc5/volumes"
Sep 10 23:24:10.344113 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:10.344042    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbc6656f-7e1b-4b8c-9bed-6460a4dfa070" path="/var/lib/kubelet/pods/cbc6656f-7e1b-4b8c-9bed-6460a4dfa070/volumes"
Sep 10 23:24:25.652651 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:25.652614    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"]
Sep 10 23:24:25.653394 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:25.653317    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g" podUID="53531aa0-28e3-4bd0-bab7-ebcaab2dd058" containerName="payload-processing" containerID="cri-o://10a97716a1ea0b71d850ecb1336dbf8481d583b5ed505e32ca984b87235e0f14" gracePeriod=30
Sep 10 23:24:25.656799 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:25.656769    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"]
Sep 10 23:24:25.657052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:25.657002    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs" podUID="80b22500-c489-45b4-ad71-0d84333208d5" containerName="payload-pre-processing" containerID="cri-o://b8949225e1a24103393e4082a3f89bf11b9b536076fadf373bd799987d37cdf4" gracePeriod=30
Sep 10 23:24:25.865006 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:25.864969    2585 generic.go:356] "Generic (PLEG): container finished" podID="80b22500-c489-45b4-ad71-0d84333208d5" containerID="b8949225e1a24103393e4082a3f89bf11b9b536076fadf373bd799987d37cdf4" exitCode=0
Sep 10 23:24:25.865274 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:25.865198    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs" event={"ID":"80b22500-c489-45b4-ad71-0d84333208d5","Type":"ContainerDied","Data":"b8949225e1a24103393e4082a3f89bf11b9b536076fadf373bd799987d37cdf4"}
Sep 10 23:24:25.867906 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:25.867875    2585 generic.go:356] "Generic (PLEG): container finished" podID="53531aa0-28e3-4bd0-bab7-ebcaab2dd058" containerID="10a97716a1ea0b71d850ecb1336dbf8481d583b5ed505e32ca984b87235e0f14" exitCode=0
Sep 10 23:24:25.868026 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:25.867947    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g" event={"ID":"53531aa0-28e3-4bd0-bab7-ebcaab2dd058","Type":"ContainerDied","Data":"10a97716a1ea0b71d850ecb1336dbf8481d583b5ed505e32ca984b87235e0f14"}
Sep 10 23:24:25.956657 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:25.956631    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"
Sep 10 23:24:25.958692 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:25.958675    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"
Sep 10 23:24:26.111471 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.111437    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vpct2\" (UniqueName: \"kubernetes.io/projected/80b22500-c489-45b4-ad71-0d84333208d5-kube-api-access-vpct2\") pod \"80b22500-c489-45b4-ad71-0d84333208d5\" (UID: \"80b22500-c489-45b4-ad71-0d84333208d5\") "
Sep 10 23:24:26.111715 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.111547    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53531aa0-28e3-4bd0-bab7-ebcaab2dd058-plugins-config-volume\") pod \"53531aa0-28e3-4bd0-bab7-ebcaab2dd058\" (UID: \"53531aa0-28e3-4bd0-bab7-ebcaab2dd058\") "
Sep 10 23:24:26.111715 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.111615    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt64s\" (UniqueName: \"kubernetes.io/projected/53531aa0-28e3-4bd0-bab7-ebcaab2dd058-kube-api-access-pt64s\") pod \"53531aa0-28e3-4bd0-bab7-ebcaab2dd058\" (UID: \"53531aa0-28e3-4bd0-bab7-ebcaab2dd058\") "
Sep 10 23:24:26.111715 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.111651    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80b22500-c489-45b4-ad71-0d84333208d5-plugins-config-volume\") pod \"80b22500-c489-45b4-ad71-0d84333208d5\" (UID: \"80b22500-c489-45b4-ad71-0d84333208d5\") "
Sep 10 23:24:26.111925 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.111899    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53531aa0-28e3-4bd0-bab7-ebcaab2dd058-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "53531aa0-28e3-4bd0-bab7-ebcaab2dd058" (UID: "53531aa0-28e3-4bd0-bab7-ebcaab2dd058"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:24:26.112018 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.112001    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53531aa0-28e3-4bd0-bab7-ebcaab2dd058-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:26.112136 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.112112    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80b22500-c489-45b4-ad71-0d84333208d5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "80b22500-c489-45b4-ad71-0d84333208d5" (UID: "80b22500-c489-45b4-ad71-0d84333208d5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:24:26.113814 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.113794    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80b22500-c489-45b4-ad71-0d84333208d5-kube-api-access-vpct2" (OuterVolumeSpecName: "kube-api-access-vpct2") pod "80b22500-c489-45b4-ad71-0d84333208d5" (UID: "80b22500-c489-45b4-ad71-0d84333208d5"). InnerVolumeSpecName "kube-api-access-vpct2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:24:26.113887 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.113856    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53531aa0-28e3-4bd0-bab7-ebcaab2dd058-kube-api-access-pt64s" (OuterVolumeSpecName: "kube-api-access-pt64s") pod "53531aa0-28e3-4bd0-bab7-ebcaab2dd058" (UID: "53531aa0-28e3-4bd0-bab7-ebcaab2dd058"). InnerVolumeSpecName "kube-api-access-pt64s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:24:26.212583 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.212471    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt64s\" (UniqueName: \"kubernetes.io/projected/53531aa0-28e3-4bd0-bab7-ebcaab2dd058-kube-api-access-pt64s\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:26.212583 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.212517    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80b22500-c489-45b4-ad71-0d84333208d5-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:26.212583 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.212527    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vpct2\" (UniqueName: \"kubernetes.io/projected/80b22500-c489-45b4-ad71-0d84333208d5-kube-api-access-vpct2\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:26.874964 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.874928    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"
Sep 10 23:24:26.875388 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.874971    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g" event={"ID":"53531aa0-28e3-4bd0-bab7-ebcaab2dd058","Type":"ContainerDied","Data":"d9460d356332870ecd17770dc16b64a9293f45756e0d0ecadb0beb7dfc028fec"}
Sep 10 23:24:26.875388 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.875037    2585 scope.go:117] "RemoveContainer" containerID="10a97716a1ea0b71d850ecb1336dbf8481d583b5ed505e32ca984b87235e0f14"
Sep 10 23:24:26.876513 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.876440    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs" event={"ID":"80b22500-c489-45b4-ad71-0d84333208d5","Type":"ContainerDied","Data":"3822b89a99ba5d76243a1fb74610a0c1fa80c8e4c44a0e0c64259a6cbcd5b21a"}
Sep 10 23:24:26.876513 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.876454    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"
Sep 10 23:24:26.885054 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.885037    2585 scope.go:117] "RemoveContainer" containerID="b8949225e1a24103393e4082a3f89bf11b9b536076fadf373bd799987d37cdf4"
Sep 10 23:24:26.893603 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.893555    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"]
Sep 10 23:24:26.900344 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.900321    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-94f305-7bcd88476b-stzjs"]
Sep 10 23:24:26.910629 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.910604    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"]
Sep 10 23:24:26.914881 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:26.914840    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-94f305-6ccc94866c-6vz7g"]
Sep 10 23:24:28.342403 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:28.342369    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53531aa0-28e3-4bd0-bab7-ebcaab2dd058" path="/var/lib/kubelet/pods/53531aa0-28e3-4bd0-bab7-ebcaab2dd058/volumes"
Sep 10 23:24:28.342821 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:28.342765    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80b22500-c489-45b4-ad71-0d84333208d5" path="/var/lib/kubelet/pods/80b22500-c489-45b4-ad71-0d84333208d5/volumes"
Sep 10 23:24:32.495738 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:32.495703    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"]
Sep 10 23:24:32.496228 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:32.496020    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerName="istio-proxy" containerID="cri-o://c8dbd3a56102e085bb11e5d2868ad1aeb25c970bacd34f2b80958c72d2f4a3ab" gracePeriod=30
Sep 10 23:24:37.753431 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.753401    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:24:37.822986 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.822954    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-credential-socket\") pod \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") "
Sep 10 23:24:37.823164 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823105    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-envoy\") pod \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") "
Sep 10 23:24:37.823164 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823145    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-podinfo\") pod \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") "
Sep 10 23:24:37.823291 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823168    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-workload-socket\") pod \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") "
Sep 10 23:24:37.823291 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823200    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istiod-ca-cert\") pod \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") "
Sep 10 23:24:37.823291 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823211    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" (UID: "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:24:37.823455 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823286    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-data\") pod \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") "
Sep 10 23:24:37.823455 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823328    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-workload-certs\") pod \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") "
Sep 10 23:24:37.823455 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823364    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-token\") pod \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") "
Sep 10 23:24:37.823455 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823423    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc8vr\" (UniqueName: \"kubernetes.io/projected/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-kube-api-access-vc8vr\") pod \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\" (UID: \"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3\") "
Sep 10 23:24:37.823703 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823479    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" (UID: "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:24:37.823703 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823582    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" (UID: "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:24:37.824235 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823820    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" (UID: "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:24:37.824235 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823852    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-data" (OuterVolumeSpecName: "istio-data") pod "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" (UID: "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:24:37.824235 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823952    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:37.824235 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823971    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:37.824235 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823986    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:37.824235 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.823998    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:37.824235 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.824012    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:37.825705 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.825675    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" (UID: "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:24:37.825823 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.825719    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" (UID: "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:24:37.826021 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.825991    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-kube-api-access-vc8vr" (OuterVolumeSpecName: "kube-api-access-vc8vr") pod "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" (UID: "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3"). InnerVolumeSpecName "kube-api-access-vc8vr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:24:37.826123 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.826026    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-token" (OuterVolumeSpecName: "istio-token") pod "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" (UID: "8858a7ed-e0f6-4e74-9fd2-3e117542dbf3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:24:37.924977 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.924947    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:37.924977 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.924976    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:37.925177 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.924986    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc8vr\" (UniqueName: \"kubernetes.io/projected/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-kube-api-access-vc8vr\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:37.925177 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.924995    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:37.947957 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.947932    2585 generic.go:356] "Generic (PLEG): container finished" podID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerID="c8dbd3a56102e085bb11e5d2868ad1aeb25c970bacd34f2b80958c72d2f4a3ab" exitCode=0
Sep 10 23:24:37.948106 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.947980    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"
Sep 10 23:24:37.948106 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.948015    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" event={"ID":"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3","Type":"ContainerDied","Data":"c8dbd3a56102e085bb11e5d2868ad1aeb25c970bacd34f2b80958c72d2f4a3ab"}
Sep 10 23:24:37.948106 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.948075    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b" event={"ID":"8858a7ed-e0f6-4e74-9fd2-3e117542dbf3","Type":"ContainerDied","Data":"f1714311ccb6ff8e20c126a615a218d01e2b348adbab8942ded1d782e6d905ca"}
Sep 10 23:24:37.948106 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.948099    2585 scope.go:117] "RemoveContainer" containerID="c8dbd3a56102e085bb11e5d2868ad1aeb25c970bacd34f2b80958c72d2f4a3ab"
Sep 10 23:24:37.958753 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.958738    2585 scope.go:117] "RemoveContainer" containerID="0b8edc7bac6ba6588d78308e225ae6830f39fae3981bd823f45fc6961bd49b34"
Sep 10 23:24:37.967250 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.967236    2585 scope.go:117] "RemoveContainer" containerID="c8dbd3a56102e085bb11e5d2868ad1aeb25c970bacd34f2b80958c72d2f4a3ab"
Sep 10 23:24:37.967496 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:24:37.967479    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8dbd3a56102e085bb11e5d2868ad1aeb25c970bacd34f2b80958c72d2f4a3ab\": container with ID starting with c8dbd3a56102e085bb11e5d2868ad1aeb25c970bacd34f2b80958c72d2f4a3ab not found: ID does not exist" containerID="c8dbd3a56102e085bb11e5d2868ad1aeb25c970bacd34f2b80958c72d2f4a3ab"
Sep 10 23:24:37.967545 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.967503    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8dbd3a56102e085bb11e5d2868ad1aeb25c970bacd34f2b80958c72d2f4a3ab"} err="failed to get container status \"c8dbd3a56102e085bb11e5d2868ad1aeb25c970bacd34f2b80958c72d2f4a3ab\": rpc error: code = NotFound desc = could not find container \"c8dbd3a56102e085bb11e5d2868ad1aeb25c970bacd34f2b80958c72d2f4a3ab\": container with ID starting with c8dbd3a56102e085bb11e5d2868ad1aeb25c970bacd34f2b80958c72d2f4a3ab not found: ID does not exist"
Sep 10 23:24:37.967545 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.967520    2585 scope.go:117] "RemoveContainer" containerID="0b8edc7bac6ba6588d78308e225ae6830f39fae3981bd823f45fc6961bd49b34"
Sep 10 23:24:37.967772 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:24:37.967756    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b8edc7bac6ba6588d78308e225ae6830f39fae3981bd823f45fc6961bd49b34\": container with ID starting with 0b8edc7bac6ba6588d78308e225ae6830f39fae3981bd823f45fc6961bd49b34 not found: ID does not exist" containerID="0b8edc7bac6ba6588d78308e225ae6830f39fae3981bd823f45fc6961bd49b34"
Sep 10 23:24:37.967823 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.967777    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8edc7bac6ba6588d78308e225ae6830f39fae3981bd823f45fc6961bd49b34"} err="failed to get container status \"0b8edc7bac6ba6588d78308e225ae6830f39fae3981bd823f45fc6961bd49b34\": rpc error: code = NotFound desc = could not find container \"0b8edc7bac6ba6588d78308e225ae6830f39fae3981bd823f45fc6961bd49b34\": container with ID starting with 0b8edc7bac6ba6588d78308e225ae6830f39fae3981bd823f45fc6961bd49b34 not found: ID does not exist"
Sep 10 23:24:37.971710 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.971688    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"]
Sep 10 23:24:37.975800 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:37.975779    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-94f305-openshift-default-8544587896-w2n6b"]
Sep 10 23:24:38.342415 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:38.342381    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" path="/var/lib/kubelet/pods/8858a7ed-e0f6-4e74-9fd2-3e117542dbf3/volumes"
Sep 10 23:24:43.454345 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.454307    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"]
Sep 10 23:24:43.454932 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.454597    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn" podUID="ffda0458-fa4b-485b-8d7d-ed8b5cb3f813" containerName="payload-processing" containerID="cri-o://f69bfc6463dcdd815bfe231aec8ae38eeb70c0c5a6a5945fcfcfcdd27109b2de" gracePeriod=30
Sep 10 23:24:43.727260 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.727233    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"
Sep 10 23:24:43.779361 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.779309    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6snsv\" (UniqueName: \"kubernetes.io/projected/ffda0458-fa4b-485b-8d7d-ed8b5cb3f813-kube-api-access-6snsv\") pod \"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813\" (UID: \"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813\") "
Sep 10 23:24:43.779541 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.779508    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffda0458-fa4b-485b-8d7d-ed8b5cb3f813-plugins-config-volume\") pod \"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813\" (UID: \"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813\") "
Sep 10 23:24:43.779923 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.779903    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffda0458-fa4b-485b-8d7d-ed8b5cb3f813-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ffda0458-fa4b-485b-8d7d-ed8b5cb3f813" (UID: "ffda0458-fa4b-485b-8d7d-ed8b5cb3f813"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:24:43.781402 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.781379    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffda0458-fa4b-485b-8d7d-ed8b5cb3f813-kube-api-access-6snsv" (OuterVolumeSpecName: "kube-api-access-6snsv") pod "ffda0458-fa4b-485b-8d7d-ed8b5cb3f813" (UID: "ffda0458-fa4b-485b-8d7d-ed8b5cb3f813"). InnerVolumeSpecName "kube-api-access-6snsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:24:43.880918 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.880872    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ffda0458-fa4b-485b-8d7d-ed8b5cb3f813-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:43.880918 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.880914    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6snsv\" (UniqueName: \"kubernetes.io/projected/ffda0458-fa4b-485b-8d7d-ed8b5cb3f813-kube-api-access-6snsv\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:43.986422 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.986327    2585 generic.go:356] "Generic (PLEG): container finished" podID="ffda0458-fa4b-485b-8d7d-ed8b5cb3f813" containerID="f69bfc6463dcdd815bfe231aec8ae38eeb70c0c5a6a5945fcfcfcdd27109b2de" exitCode=0
Sep 10 23:24:43.986422 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.986382    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"
Sep 10 23:24:43.986715 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.986417    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn" event={"ID":"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813","Type":"ContainerDied","Data":"f69bfc6463dcdd815bfe231aec8ae38eeb70c0c5a6a5945fcfcfcdd27109b2de"}
Sep 10 23:24:43.986715 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.986487    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn" event={"ID":"ffda0458-fa4b-485b-8d7d-ed8b5cb3f813","Type":"ContainerDied","Data":"b1853e1ae54e3d9064e0c1ee265e7140d24678cdca50a19a1a03865c34223300"}
Sep 10 23:24:43.986715 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.986516    2585 scope.go:117] "RemoveContainer" containerID="f69bfc6463dcdd815bfe231aec8ae38eeb70c0c5a6a5945fcfcfcdd27109b2de"
Sep 10 23:24:43.997020 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.996990    2585 scope.go:117] "RemoveContainer" containerID="f69bfc6463dcdd815bfe231aec8ae38eeb70c0c5a6a5945fcfcfcdd27109b2de"
Sep 10 23:24:43.997316 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:24:43.997295    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f69bfc6463dcdd815bfe231aec8ae38eeb70c0c5a6a5945fcfcfcdd27109b2de\": container with ID starting with f69bfc6463dcdd815bfe231aec8ae38eeb70c0c5a6a5945fcfcfcdd27109b2de not found: ID does not exist" containerID="f69bfc6463dcdd815bfe231aec8ae38eeb70c0c5a6a5945fcfcfcdd27109b2de"
Sep 10 23:24:43.997415 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:43.997323    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f69bfc6463dcdd815bfe231aec8ae38eeb70c0c5a6a5945fcfcfcdd27109b2de"} err="failed to get container status \"f69bfc6463dcdd815bfe231aec8ae38eeb70c0c5a6a5945fcfcfcdd27109b2de\": rpc error: code = NotFound desc = could not find container \"f69bfc6463dcdd815bfe231aec8ae38eeb70c0c5a6a5945fcfcfcdd27109b2de\": container with ID starting with f69bfc6463dcdd815bfe231aec8ae38eeb70c0c5a6a5945fcfcfcdd27109b2de not found: ID does not exist"
Sep 10 23:24:44.012391 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:44.012358    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"]
Sep 10 23:24:44.016148 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:44.016125    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-063e1d-59b64f94c7-rfkjn"]
Sep 10 23:24:44.341711 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:44.341683    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffda0458-fa4b-485b-8d7d-ed8b5cb3f813" path="/var/lib/kubelet/pods/ffda0458-fa4b-485b-8d7d-ed8b5cb3f813/volumes"
Sep 10 23:24:50.556806 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:50.556770    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"]
Sep 10 23:24:51.033678 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:51.033577    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy" containerID="cri-o://8d1a6b6d6f2b8c4bbaeb165692fa9cd84957d31055107cf5b99ba50297102f77" gracePeriod=30
Sep 10 23:24:54.716810 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:54.716773    2585 patch_prober.go:28] interesting pod/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 23:24:54.717215 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:54.716831    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 23:24:56.279079 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.279052    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:24:56.415697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.415598    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-workload-certs\") pod \"d9fbe8c1-99be-4797-92a8-d889c80930b5\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") "
Sep 10 23:24:56.415697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.415643    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-envoy\") pod \"d9fbe8c1-99be-4797-92a8-d889c80930b5\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") "
Sep 10 23:24:56.415697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.415691    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-token\") pod \"d9fbe8c1-99be-4797-92a8-d889c80930b5\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") "
Sep 10 23:24:56.415986 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.415721    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-data\") pod \"d9fbe8c1-99be-4797-92a8-d889c80930b5\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") "
Sep 10 23:24:56.415986 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.415771    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-credential-socket\") pod \"d9fbe8c1-99be-4797-92a8-d889c80930b5\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") "
Sep 10 23:24:56.415986 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.415806    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-workload-socket\") pod \"d9fbe8c1-99be-4797-92a8-d889c80930b5\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") "
Sep 10 23:24:56.415986 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.415867    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxsbk\" (UniqueName: \"kubernetes.io/projected/d9fbe8c1-99be-4797-92a8-d889c80930b5-kube-api-access-pxsbk\") pod \"d9fbe8c1-99be-4797-92a8-d889c80930b5\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") "
Sep 10 23:24:56.415986 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.415888    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d9fbe8c1-99be-4797-92a8-d889c80930b5" (UID: "d9fbe8c1-99be-4797-92a8-d889c80930b5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:24:56.415986 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.415899    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-podinfo\") pod \"d9fbe8c1-99be-4797-92a8-d889c80930b5\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") "
Sep 10 23:24:56.415986 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.415963    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9fbe8c1-99be-4797-92a8-d889c80930b5-istiod-ca-cert\") pod \"d9fbe8c1-99be-4797-92a8-d889c80930b5\" (UID: \"d9fbe8c1-99be-4797-92a8-d889c80930b5\") "
Sep 10 23:24:56.416375 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.416219    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d9fbe8c1-99be-4797-92a8-d889c80930b5" (UID: "d9fbe8c1-99be-4797-92a8-d889c80930b5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:24:56.416465 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.416441    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:56.416692 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.416668    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:56.416692 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.416493    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d9fbe8c1-99be-4797-92a8-d889c80930b5" (UID: "d9fbe8c1-99be-4797-92a8-d889c80930b5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:24:56.416885 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.416603    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9fbe8c1-99be-4797-92a8-d889c80930b5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d9fbe8c1-99be-4797-92a8-d889c80930b5" (UID: "d9fbe8c1-99be-4797-92a8-d889c80930b5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:24:56.416885 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.416623    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-data" (OuterVolumeSpecName: "istio-data") pod "d9fbe8c1-99be-4797-92a8-d889c80930b5" (UID: "d9fbe8c1-99be-4797-92a8-d889c80930b5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:24:56.418100 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.418074    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d9fbe8c1-99be-4797-92a8-d889c80930b5" (UID: "d9fbe8c1-99be-4797-92a8-d889c80930b5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:24:56.418194 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.418101    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-token" (OuterVolumeSpecName: "istio-token") pod "d9fbe8c1-99be-4797-92a8-d889c80930b5" (UID: "d9fbe8c1-99be-4797-92a8-d889c80930b5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:24:56.418194 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.418154    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d9fbe8c1-99be-4797-92a8-d889c80930b5" (UID: "d9fbe8c1-99be-4797-92a8-d889c80930b5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:24:56.418299 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.418284    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9fbe8c1-99be-4797-92a8-d889c80930b5-kube-api-access-pxsbk" (OuterVolumeSpecName: "kube-api-access-pxsbk") pod "d9fbe8c1-99be-4797-92a8-d889c80930b5" (UID: "d9fbe8c1-99be-4797-92a8-d889c80930b5"). InnerVolumeSpecName "kube-api-access-pxsbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:24:56.517829 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.517788    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:56.517829 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.517824    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:56.517829 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.517836    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:56.518086 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.517848    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9fbe8c1-99be-4797-92a8-d889c80930b5-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:56.518086 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.517865    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxsbk\" (UniqueName: \"kubernetes.io/projected/d9fbe8c1-99be-4797-92a8-d889c80930b5-kube-api-access-pxsbk\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:56.518086 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.517877    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9fbe8c1-99be-4797-92a8-d889c80930b5-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:56.518086 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:56.517890    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9fbe8c1-99be-4797-92a8-d889c80930b5-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:24:57.071465 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:57.071430    2585 generic.go:356] "Generic (PLEG): container finished" podID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerID="8d1a6b6d6f2b8c4bbaeb165692fa9cd84957d31055107cf5b99ba50297102f77" exitCode=0
Sep 10 23:24:57.071637 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:57.071478    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"
Sep 10 23:24:57.071637 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:57.071510    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" event={"ID":"d9fbe8c1-99be-4797-92a8-d889c80930b5","Type":"ContainerDied","Data":"8d1a6b6d6f2b8c4bbaeb165692fa9cd84957d31055107cf5b99ba50297102f77"}
Sep 10 23:24:57.071637 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:57.071584    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf" event={"ID":"d9fbe8c1-99be-4797-92a8-d889c80930b5","Type":"ContainerDied","Data":"0e8886b888efd516bb379513ba9bc2c94a17f8120564c910fce3e93c52a3cb5a"}
Sep 10 23:24:57.071637 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:57.071616    2585 scope.go:117] "RemoveContainer" containerID="8d1a6b6d6f2b8c4bbaeb165692fa9cd84957d31055107cf5b99ba50297102f77"
Sep 10 23:24:57.081882 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:57.081864    2585 scope.go:117] "RemoveContainer" containerID="be05418e0bb0866279c94143d708ecbcd6a42c24eb4e6d425b9079fb58847ba1"
Sep 10 23:24:57.090341 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:57.090323    2585 scope.go:117] "RemoveContainer" containerID="8d1a6b6d6f2b8c4bbaeb165692fa9cd84957d31055107cf5b99ba50297102f77"
Sep 10 23:24:57.090639 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:24:57.090620    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d1a6b6d6f2b8c4bbaeb165692fa9cd84957d31055107cf5b99ba50297102f77\": container with ID starting with 8d1a6b6d6f2b8c4bbaeb165692fa9cd84957d31055107cf5b99ba50297102f77 not found: ID does not exist" containerID="8d1a6b6d6f2b8c4bbaeb165692fa9cd84957d31055107cf5b99ba50297102f77"
Sep 10 23:24:57.090704 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:57.090649    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1a6b6d6f2b8c4bbaeb165692fa9cd84957d31055107cf5b99ba50297102f77"} err="failed to get container status \"8d1a6b6d6f2b8c4bbaeb165692fa9cd84957d31055107cf5b99ba50297102f77\": rpc error: code = NotFound desc = could not find container \"8d1a6b6d6f2b8c4bbaeb165692fa9cd84957d31055107cf5b99ba50297102f77\": container with ID starting with 8d1a6b6d6f2b8c4bbaeb165692fa9cd84957d31055107cf5b99ba50297102f77 not found: ID does not exist"
Sep 10 23:24:57.090704 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:57.090668    2585 scope.go:117] "RemoveContainer" containerID="be05418e0bb0866279c94143d708ecbcd6a42c24eb4e6d425b9079fb58847ba1"
Sep 10 23:24:57.090916 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:24:57.090897    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be05418e0bb0866279c94143d708ecbcd6a42c24eb4e6d425b9079fb58847ba1\": container with ID starting with be05418e0bb0866279c94143d708ecbcd6a42c24eb4e6d425b9079fb58847ba1 not found: ID does not exist" containerID="be05418e0bb0866279c94143d708ecbcd6a42c24eb4e6d425b9079fb58847ba1"
Sep 10 23:24:57.090961 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:57.090922    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be05418e0bb0866279c94143d708ecbcd6a42c24eb4e6d425b9079fb58847ba1"} err="failed to get container status \"be05418e0bb0866279c94143d708ecbcd6a42c24eb4e6d425b9079fb58847ba1\": rpc error: code = NotFound desc = could not find container \"be05418e0bb0866279c94143d708ecbcd6a42c24eb4e6d425b9079fb58847ba1\": container with ID starting with be05418e0bb0866279c94143d708ecbcd6a42c24eb4e6d425b9079fb58847ba1 not found: ID does not exist"
Sep 10 23:24:57.095072 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:57.095050    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"]
Sep 10 23:24:57.101231 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:57.101210    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-063e1d-openshift-default-54568dfdbb-5gbqf"]
Sep 10 23:24:58.342430 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:24:58.342389    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" path="/var/lib/kubelet/pods/d9fbe8c1-99be-4797-92a8-d889c80930b5/volumes"
Sep 10 23:25:00.145829 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:00.145794    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"]
Sep 10 23:25:01.869302 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869211    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"]
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869614    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869628    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869636    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55618caf-09a3-4da2-8a8c-b570e0db3bc5" containerName="revoke-keys"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869642    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="55618caf-09a3-4da2-8a8c-b570e0db3bc5" containerName="revoke-keys"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869649    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerName="istio-proxy"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869655    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerName="istio-proxy"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869665    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869673    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869682    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc6656f-7e1b-4b8c-9bed-6460a4dfa070" containerName="payload-processing"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869688    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc6656f-7e1b-4b8c-9bed-6460a4dfa070" containerName="payload-processing"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869698    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80b22500-c489-45b4-ad71-0d84333208d5" containerName="payload-pre-processing"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869707    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="80b22500-c489-45b4-ad71-0d84333208d5" containerName="payload-pre-processing"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869722    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869727    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869736    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy"
Sep 10 23:25:01.869745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869742    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869757    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerName="istio-proxy"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869764    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerName="istio-proxy"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869773    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffda0458-fa4b-485b-8d7d-ed8b5cb3f813" containerName="payload-processing"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869778    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffda0458-fa4b-485b-8d7d-ed8b5cb3f813" containerName="payload-processing"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869785    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53531aa0-28e3-4bd0-bab7-ebcaab2dd058" containerName="payload-processing"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869790    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="53531aa0-28e3-4bd0-bab7-ebcaab2dd058" containerName="payload-processing"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869856    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffda0458-fa4b-485b-8d7d-ed8b5cb3f813" containerName="payload-processing"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869866    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerName="istio-proxy"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869871    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869879    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="80b22500-c489-45b4-ad71-0d84333208d5" containerName="payload-pre-processing"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869885    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869893    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbc6656f-7e1b-4b8c-9bed-6460a4dfa070" containerName="payload-processing"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869899    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="55618caf-09a3-4da2-8a8c-b570e0db3bc5" containerName="revoke-keys"
Sep 10 23:25:01.870522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.869904    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="53531aa0-28e3-4bd0-bab7-ebcaab2dd058" containerName="payload-processing"
Sep 10 23:25:01.874377 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.874353    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:01.876629 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.876573    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-595479-openshift-default-dockercfg-hvc92\""
Sep 10 23:25:01.883510 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:01.883486    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"]
Sep 10 23:25:02.072671 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.072635    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-workload-certs\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.072671 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.072674    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-credential-socket\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.072880 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.072775    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcvpk\" (UniqueName: \"kubernetes.io/projected/def58862-7d87-4492-a88d-8b4fb8981439-kube-api-access-mcvpk\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.072880 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.072835    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def58862-7d87-4492-a88d-8b4fb8981439-istiod-ca-cert\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.072957 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.072893    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def58862-7d87-4492-a88d-8b4fb8981439-istio-token\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.072957 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.072914    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-istio-envoy\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.072957 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.072950    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-workload-socket\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.073059 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.073031    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-istio-data\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.073094 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.073086    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def58862-7d87-4492-a88d-8b4fb8981439-istio-podinfo\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.174411 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.174318    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-workload-certs\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.174411 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.174357    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-credential-socket\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.174411 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.174402    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcvpk\" (UniqueName: \"kubernetes.io/projected/def58862-7d87-4492-a88d-8b4fb8981439-kube-api-access-mcvpk\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.174767 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.174429    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def58862-7d87-4492-a88d-8b4fb8981439-istiod-ca-cert\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.174767 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.174447    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def58862-7d87-4492-a88d-8b4fb8981439-istio-token\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.174767 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.174472    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-istio-envoy\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.174767 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.174510    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-workload-socket\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.174767 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.174592    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-istio-data\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.174767 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.174649    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def58862-7d87-4492-a88d-8b4fb8981439-istio-podinfo\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.175086 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.174858    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-credential-socket\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.175086 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.174993    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-istio-data\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.175086 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.175003    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-workload-socket\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.175086 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.175061    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-workload-certs\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.175260 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.175239    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def58862-7d87-4492-a88d-8b4fb8981439-istiod-ca-cert\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.176967 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.176935    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-istio-envoy\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.177121 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.177103    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def58862-7d87-4492-a88d-8b4fb8981439-istio-podinfo\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.183108 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.183089    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def58862-7d87-4492-a88d-8b4fb8981439-istio-token\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.183202 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.183154    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcvpk\" (UniqueName: \"kubernetes.io/projected/def58862-7d87-4492-a88d-8b4fb8981439-kube-api-access-mcvpk\") pod \"e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") " pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.185122 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.185101    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:02.467045 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.467011    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"]
Sep 10 23:25:02.472803 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:25:02.472775    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef58862_7d87_4492_a88d_8b4fb8981439.slice/crio-1db4c94c2b043162187d9deedd5c8213e8678b13cb530ec161e7a6bc8e3a9d8d WatchSource:0}: Error finding container 1db4c94c2b043162187d9deedd5c8213e8678b13cb530ec161e7a6bc8e3a9d8d: Status 404 returned error can't find the container with id 1db4c94c2b043162187d9deedd5c8213e8678b13cb530ec161e7a6bc8e3a9d8d
Sep 10 23:25:02.474799 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.474757    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:25:02.474902 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.474836    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:25:02.474902 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:02.474879    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:25:03.109815 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:03.109775    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" event={"ID":"def58862-7d87-4492-a88d-8b4fb8981439","Type":"ContainerStarted","Data":"75f36dbc22399387a1ea32670b913c97bffaab5b26a3189ddcf8dba44b3474e8"}
Sep 10 23:25:03.110287 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:03.109838    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" event={"ID":"def58862-7d87-4492-a88d-8b4fb8981439","Type":"ContainerStarted","Data":"1db4c94c2b043162187d9deedd5c8213e8678b13cb530ec161e7a6bc8e3a9d8d"}
Sep 10 23:25:03.132534 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:03.132483    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" podStartSLOduration=2.132469267 podStartE2EDuration="2.132469267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:25:03.130329851 +0000 UTC m=+1615.309200881" watchObservedRunningTime="2026-09-10 23:25:03.132469267 +0000 UTC m=+1615.311340230"
Sep 10 23:25:03.185275 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:03.185250    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:03.190238 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:03.190215    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:04.115940 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:04.115910    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:04.117067 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:04.117050    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:06.889648 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:06.889612    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"]
Sep 10 23:25:06.890061 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:06.890048    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="8858a7ed-e0f6-4e74-9fd2-3e117542dbf3" containerName="istio-proxy"
Sep 10 23:25:06.890061 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:06.890061    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="473b956a-c818-4f12-b90f-d9d49c74049c" containerName="istio-proxy"
Sep 10 23:25:06.890141 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:06.890067    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9fbe8c1-99be-4797-92a8-d889c80930b5" containerName="istio-proxy"
Sep 10 23:25:06.893280 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:06.893261    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"
Sep 10 23:25:06.895634 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:06.895607    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-595479\""
Sep 10 23:25:06.895813 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:06.895786    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-595479-dockercfg-n7zdw\""
Sep 10 23:25:06.905839 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:06.905813    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"]
Sep 10 23:25:06.923542 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:06.923501    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26098b74-026f-4068-92c2-c56d774fc09c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv\" (UID: \"26098b74-026f-4068-92c2-c56d774fc09c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"
Sep 10 23:25:06.923703 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:06.923592    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88mm9\" (UniqueName: \"kubernetes.io/projected/26098b74-026f-4068-92c2-c56d774fc09c-kube-api-access-88mm9\") pod \"payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv\" (UID: \"26098b74-026f-4068-92c2-c56d774fc09c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"
Sep 10 23:25:06.923798 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:06.923774    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"]
Sep 10 23:25:06.929054 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:06.929031    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"
Sep 10 23:25:06.936345 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:06.936319    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"]
Sep 10 23:25:07.025168 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.025131    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26098b74-026f-4068-92c2-c56d774fc09c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv\" (UID: \"26098b74-026f-4068-92c2-c56d774fc09c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"
Sep 10 23:25:07.025364 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.025178    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88mm9\" (UniqueName: \"kubernetes.io/projected/26098b74-026f-4068-92c2-c56d774fc09c-kube-api-access-88mm9\") pod \"payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv\" (UID: \"26098b74-026f-4068-92c2-c56d774fc09c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"
Sep 10 23:25:07.025364 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.025302    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6kdx\" (UniqueName: \"kubernetes.io/projected/aed426ef-e12f-4150-b252-fccf24d57364-kube-api-access-k6kdx\") pod \"payload-processing-e2e-ipp-a-595479-f6545889f-4hndw\" (UID: \"aed426ef-e12f-4150-b252-fccf24d57364\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"
Sep 10 23:25:07.025538 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.025511    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aed426ef-e12f-4150-b252-fccf24d57364-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-595479-f6545889f-4hndw\" (UID: \"aed426ef-e12f-4150-b252-fccf24d57364\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"
Sep 10 23:25:07.025981 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.025958    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26098b74-026f-4068-92c2-c56d774fc09c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv\" (UID: \"26098b74-026f-4068-92c2-c56d774fc09c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"
Sep 10 23:25:07.033309 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.033288    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88mm9\" (UniqueName: \"kubernetes.io/projected/26098b74-026f-4068-92c2-c56d774fc09c-kube-api-access-88mm9\") pod \"payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv\" (UID: \"26098b74-026f-4068-92c2-c56d774fc09c\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"
Sep 10 23:25:07.126448 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.126406    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aed426ef-e12f-4150-b252-fccf24d57364-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-595479-f6545889f-4hndw\" (UID: \"aed426ef-e12f-4150-b252-fccf24d57364\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"
Sep 10 23:25:07.126643 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.126499    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6kdx\" (UniqueName: \"kubernetes.io/projected/aed426ef-e12f-4150-b252-fccf24d57364-kube-api-access-k6kdx\") pod \"payload-processing-e2e-ipp-a-595479-f6545889f-4hndw\" (UID: \"aed426ef-e12f-4150-b252-fccf24d57364\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"
Sep 10 23:25:07.127105 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.127085    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aed426ef-e12f-4150-b252-fccf24d57364-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-595479-f6545889f-4hndw\" (UID: \"aed426ef-e12f-4150-b252-fccf24d57364\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"
Sep 10 23:25:07.134955 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.134930    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6kdx\" (UniqueName: \"kubernetes.io/projected/aed426ef-e12f-4150-b252-fccf24d57364-kube-api-access-k6kdx\") pod \"payload-processing-e2e-ipp-a-595479-f6545889f-4hndw\" (UID: \"aed426ef-e12f-4150-b252-fccf24d57364\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"
Sep 10 23:25:07.207133 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.207038    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"
Sep 10 23:25:07.242553 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.242521    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"
Sep 10 23:25:07.481984 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.481900    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"]
Sep 10 23:25:07.484283 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:25:07.484248    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26098b74_026f_4068_92c2_c56d774fc09c.slice/crio-6da9b8bdfaae74c77544997ce564f6eb26bf244c217947f4cdb310aa7f66c09d WatchSource:0}: Error finding container 6da9b8bdfaae74c77544997ce564f6eb26bf244c217947f4cdb310aa7f66c09d: Status 404 returned error can't find the container with id 6da9b8bdfaae74c77544997ce564f6eb26bf244c217947f4cdb310aa7f66c09d
Sep 10 23:25:07.537313 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:07.537288    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"]
Sep 10 23:25:07.538941 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:25:07.538917    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaed426ef_e12f_4150_b252_fccf24d57364.slice/crio-3d8207ca0d52bc8503ebd4d479115bfc7a41f1e44561f03b3d2c7ea9aab69d2a WatchSource:0}: Error finding container 3d8207ca0d52bc8503ebd4d479115bfc7a41f1e44561f03b3d2c7ea9aab69d2a: Status 404 returned error can't find the container with id 3d8207ca0d52bc8503ebd4d479115bfc7a41f1e44561f03b3d2c7ea9aab69d2a
Sep 10 23:25:08.146657 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:08.146617    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw" event={"ID":"aed426ef-e12f-4150-b252-fccf24d57364","Type":"ContainerStarted","Data":"93b26bf6a5664680bd47aca12d326d94ea58ffe3141852fcb74741bee09f520d"}
Sep 10 23:25:08.147105 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:08.146672    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw" event={"ID":"aed426ef-e12f-4150-b252-fccf24d57364","Type":"ContainerStarted","Data":"3d8207ca0d52bc8503ebd4d479115bfc7a41f1e44561f03b3d2c7ea9aab69d2a"}
Sep 10 23:25:08.147105 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:08.146738    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"
Sep 10 23:25:08.148247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:08.148221    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv" event={"ID":"26098b74-026f-4068-92c2-c56d774fc09c","Type":"ContainerStarted","Data":"c3916abf1bccbf1e52b579dfc0e6f658dffd160fc46e4fc0ab39932c6a1120d9"}
Sep 10 23:25:08.148379 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:08.148275    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"
Sep 10 23:25:08.148379 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:08.148299    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv" event={"ID":"26098b74-026f-4068-92c2-c56d774fc09c","Type":"ContainerStarted","Data":"6da9b8bdfaae74c77544997ce564f6eb26bf244c217947f4cdb310aa7f66c09d"}
Sep 10 23:25:08.163644 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:08.163603    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw" podStartSLOduration=2.1635898669999998 podStartE2EDuration="2.163589867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:25:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:25:08.162349544 +0000 UTC m=+1620.341220507" watchObservedRunningTime="2026-09-10 23:25:08.163589867 +0000 UTC m=+1620.342460836"
Sep 10 23:25:08.177973 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:08.177932    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv" podStartSLOduration=2.177918331 podStartE2EDuration="2.177918331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:25:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:25:08.176622964 +0000 UTC m=+1620.355493938" watchObservedRunningTime="2026-09-10 23:25:08.177918331 +0000 UTC m=+1620.356789294"
Sep 10 23:25:15.164988 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.164945    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t" podUID="4a73329b-3899-43de-8ef1-ae8107eed556" containerName="main" containerID="cri-o://d2c613560e394aec65a8f4845fcff7712faad286b5553c4375759f084250d6d0" gracePeriod=45
Sep 10 23:25:15.475968 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.475943    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:25:15.513312 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.513278    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-tmp-dir\") pod \"4a73329b-3899-43de-8ef1-ae8107eed556\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") "
Sep 10 23:25:15.513489 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.513327    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-home\") pod \"4a73329b-3899-43de-8ef1-ae8107eed556\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") "
Sep 10 23:25:15.513489 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.513400    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tw5pk\" (UniqueName: \"kubernetes.io/projected/4a73329b-3899-43de-8ef1-ae8107eed556-kube-api-access-tw5pk\") pod \"4a73329b-3899-43de-8ef1-ae8107eed556\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") "
Sep 10 23:25:15.513489 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.513436    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-model-cache\") pod \"4a73329b-3899-43de-8ef1-ae8107eed556\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") "
Sep 10 23:25:15.513703 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.513523    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-dshm\") pod \"4a73329b-3899-43de-8ef1-ae8107eed556\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") "
Sep 10 23:25:15.513703 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.513581    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a73329b-3899-43de-8ef1-ae8107eed556-tls-certs\") pod \"4a73329b-3899-43de-8ef1-ae8107eed556\" (UID: \"4a73329b-3899-43de-8ef1-ae8107eed556\") "
Sep 10 23:25:15.516373 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.516318    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-home" (OuterVolumeSpecName: "home") pod "4a73329b-3899-43de-8ef1-ae8107eed556" (UID: "4a73329b-3899-43de-8ef1-ae8107eed556"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:25:15.516594 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.516546    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4a73329b-3899-43de-8ef1-ae8107eed556" (UID: "4a73329b-3899-43de-8ef1-ae8107eed556"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:25:15.516983 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.516961    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-model-cache" (OuterVolumeSpecName: "model-cache") pod "4a73329b-3899-43de-8ef1-ae8107eed556" (UID: "4a73329b-3899-43de-8ef1-ae8107eed556"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:25:15.526504 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.526295    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a73329b-3899-43de-8ef1-ae8107eed556-kube-api-access-tw5pk" (OuterVolumeSpecName: "kube-api-access-tw5pk") pod "4a73329b-3899-43de-8ef1-ae8107eed556" (UID: "4a73329b-3899-43de-8ef1-ae8107eed556"). InnerVolumeSpecName "kube-api-access-tw5pk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:25:15.530054 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.530017    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-dshm" (OuterVolumeSpecName: "dshm") pod "4a73329b-3899-43de-8ef1-ae8107eed556" (UID: "4a73329b-3899-43de-8ef1-ae8107eed556"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:25:15.531693 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.531656    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a73329b-3899-43de-8ef1-ae8107eed556-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4a73329b-3899-43de-8ef1-ae8107eed556" (UID: "4a73329b-3899-43de-8ef1-ae8107eed556"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:25:15.620323 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.620196    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4a73329b-3899-43de-8ef1-ae8107eed556-tls-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:25:15.620323 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.620233    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-tmp-dir\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:25:15.620323 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.620245    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-home\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:25:15.620323 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.620258    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tw5pk\" (UniqueName: \"kubernetes.io/projected/4a73329b-3899-43de-8ef1-ae8107eed556-kube-api-access-tw5pk\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:25:15.620323 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.620272    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-model-cache\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:25:15.620323 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:15.620285    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4a73329b-3899-43de-8ef1-ae8107eed556-dshm\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:25:16.197575 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:16.197520    2585 generic.go:356] "Generic (PLEG): container finished" podID="4a73329b-3899-43de-8ef1-ae8107eed556" containerID="d2c613560e394aec65a8f4845fcff7712faad286b5553c4375759f084250d6d0" exitCode=0
Sep 10 23:25:16.198074 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:16.197627    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t" event={"ID":"4a73329b-3899-43de-8ef1-ae8107eed556","Type":"ContainerDied","Data":"d2c613560e394aec65a8f4845fcff7712faad286b5553c4375759f084250d6d0"}
Sep 10 23:25:16.198074 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:16.197838    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t" event={"ID":"4a73329b-3899-43de-8ef1-ae8107eed556","Type":"ContainerDied","Data":"bbdf9e66c6e4b339e6b32897a310bdc3bee79036832f5cc292223f5f49d050f9"}
Sep 10 23:25:16.198074 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:16.197668    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"
Sep 10 23:25:16.201326 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:16.201274    2585 scope.go:117] "RemoveContainer" containerID="d2c613560e394aec65a8f4845fcff7712faad286b5553c4375759f084250d6d0"
Sep 10 23:25:16.217193 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:16.217162    2585 scope.go:117] "RemoveContainer" containerID="d2c613560e394aec65a8f4845fcff7712faad286b5553c4375759f084250d6d0"
Sep 10 23:25:16.217610 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:25:16.217581    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2c613560e394aec65a8f4845fcff7712faad286b5553c4375759f084250d6d0\": container with ID starting with d2c613560e394aec65a8f4845fcff7712faad286b5553c4375759f084250d6d0 not found: ID does not exist" containerID="d2c613560e394aec65a8f4845fcff7712faad286b5553c4375759f084250d6d0"
Sep 10 23:25:16.217718 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:16.217622    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2c613560e394aec65a8f4845fcff7712faad286b5553c4375759f084250d6d0"} err="failed to get container status \"d2c613560e394aec65a8f4845fcff7712faad286b5553c4375759f084250d6d0\": rpc error: code = NotFound desc = could not find container \"d2c613560e394aec65a8f4845fcff7712faad286b5553c4375759f084250d6d0\": container with ID starting with d2c613560e394aec65a8f4845fcff7712faad286b5553c4375759f084250d6d0 not found: ID does not exist"
Sep 10 23:25:16.230822 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:16.230797    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"]
Sep 10 23:25:16.235775 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:16.235750    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-2da572/rate-test-model-2da572-kserve-cb8c9f6b7-qd27t"]
Sep 10 23:25:16.341505 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:16.341470    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a73329b-3899-43de-8ef1-ae8107eed556" path="/var/lib/kubelet/pods/4a73329b-3899-43de-8ef1-ae8107eed556/volumes"
Sep 10 23:25:19.156364 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:19.156325    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"
Sep 10 23:25:19.156871 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:19.156393    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"
Sep 10 23:25:20.111946 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:20.110872    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": read tcp 10.134.0.2:56030->10.134.0.90:15021: read: connection reset by peer" start-of-body=
Sep 10 23:25:20.111946 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:20.110944    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": read tcp 10.134.0.2:56030->10.134.0.90:15021: read: connection reset by peer"
Sep 10 23:25:20.227248 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:20.227215    2585 generic.go:356] "Generic (PLEG): container finished" podID="def58862-7d87-4492-a88d-8b4fb8981439" containerID="75f36dbc22399387a1ea32670b913c97bffaab5b26a3189ddcf8dba44b3474e8" exitCode=0
Sep 10 23:25:20.227651 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:20.227286    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" event={"ID":"def58862-7d87-4492-a88d-8b4fb8981439","Type":"ContainerDied","Data":"75f36dbc22399387a1ea32670b913c97bffaab5b26a3189ddcf8dba44b3474e8"}
Sep 10 23:25:20.227733 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:20.227718    2585 scope.go:117] "RemoveContainer" containerID="75f36dbc22399387a1ea32670b913c97bffaab5b26a3189ddcf8dba44b3474e8"
Sep 10 23:25:20.228810 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:20.228769    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:25:20.228919 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:20.228864    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:25:20.228984 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:20.228915    2585 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 10 23:25:21.235758 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:21.235719    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" event={"ID":"def58862-7d87-4492-a88d-8b4fb8981439","Type":"ContainerStarted","Data":"a59a469fccafdf462cac445aeaa52140daf4705a1e6e28fcb6879a0ada56d351"}
Sep 10 23:25:22.185698 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:22.185662    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:22.185944 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:22.185920    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 10 23:25:22.186038 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:22.185991    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 10 23:25:23.186082 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:23.186043    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 10 23:25:23.186497 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:23.186103    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 10 23:25:24.185948 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:24.185910    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 10 23:25:24.186160 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:24.185991    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 10 23:25:25.186395 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:25.186357    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 10 23:25:25.186824 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:25.186418    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 10 23:25:26.186418 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:26.186377    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 10 23:25:26.186948 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:26.186458    2585 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 10 23:25:27.189619 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:27.189585    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:27.190068 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:27.189899    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:27.190475 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:27.190457    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:25:36.214755 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.214721    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"]
Sep 10 23:25:36.215329 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.215308    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a73329b-3899-43de-8ef1-ae8107eed556" containerName="main"
Sep 10 23:25:36.215418 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.215331    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a73329b-3899-43de-8ef1-ae8107eed556" containerName="main"
Sep 10 23:25:36.215477 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.215426    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a73329b-3899-43de-8ef1-ae8107eed556" containerName="main"
Sep 10 23:25:36.218912 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.218890    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"
Sep 10 23:25:36.221595 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.221576    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-c6c079-dockercfg-xsmq9\""
Sep 10 23:25:36.221698 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.221585    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-c6c079\""
Sep 10 23:25:36.227233 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.226821    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"]
Sep 10 23:25:36.239520 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.239492    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"]
Sep 10 23:25:36.242939 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.242922    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"
Sep 10 23:25:36.255979 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.255955    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"]
Sep 10 23:25:36.324741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.324648    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2954a32-5ef5-4289-aa14-75417f0ab282-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9\" (UID: \"b2954a32-5ef5-4289-aa14-75417f0ab282\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"
Sep 10 23:25:36.324946 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.324805    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n57ln\" (UniqueName: \"kubernetes.io/projected/b2954a32-5ef5-4289-aa14-75417f0ab282-kube-api-access-n57ln\") pod \"payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9\" (UID: \"b2954a32-5ef5-4289-aa14-75417f0ab282\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"
Sep 10 23:25:36.425750 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.425715    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk6m4\" (UniqueName: \"kubernetes.io/projected/fb04e713-7075-4901-a4ab-85f8bc356f21-kube-api-access-jk6m4\") pod \"payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj\" (UID: \"fb04e713-7075-4901-a4ab-85f8bc356f21\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"
Sep 10 23:25:36.425964 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.425768    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n57ln\" (UniqueName: \"kubernetes.io/projected/b2954a32-5ef5-4289-aa14-75417f0ab282-kube-api-access-n57ln\") pod \"payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9\" (UID: \"b2954a32-5ef5-4289-aa14-75417f0ab282\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"
Sep 10 23:25:36.425964 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.425868    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb04e713-7075-4901-a4ab-85f8bc356f21-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj\" (UID: \"fb04e713-7075-4901-a4ab-85f8bc356f21\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"
Sep 10 23:25:36.425964 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.425925    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2954a32-5ef5-4289-aa14-75417f0ab282-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9\" (UID: \"b2954a32-5ef5-4289-aa14-75417f0ab282\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"
Sep 10 23:25:36.426678 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.426657    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2954a32-5ef5-4289-aa14-75417f0ab282-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9\" (UID: \"b2954a32-5ef5-4289-aa14-75417f0ab282\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"
Sep 10 23:25:36.433696 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.433671    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n57ln\" (UniqueName: \"kubernetes.io/projected/b2954a32-5ef5-4289-aa14-75417f0ab282-kube-api-access-n57ln\") pod \"payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9\" (UID: \"b2954a32-5ef5-4289-aa14-75417f0ab282\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"
Sep 10 23:25:36.526846 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.526747    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb04e713-7075-4901-a4ab-85f8bc356f21-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj\" (UID: \"fb04e713-7075-4901-a4ab-85f8bc356f21\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"
Sep 10 23:25:36.526999 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.526877    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk6m4\" (UniqueName: \"kubernetes.io/projected/fb04e713-7075-4901-a4ab-85f8bc356f21-kube-api-access-jk6m4\") pod \"payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj\" (UID: \"fb04e713-7075-4901-a4ab-85f8bc356f21\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"
Sep 10 23:25:36.527428 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.527408    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb04e713-7075-4901-a4ab-85f8bc356f21-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj\" (UID: \"fb04e713-7075-4901-a4ab-85f8bc356f21\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"
Sep 10 23:25:36.531655 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.531630    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"
Sep 10 23:25:36.535232 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.535214    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk6m4\" (UniqueName: \"kubernetes.io/projected/fb04e713-7075-4901-a4ab-85f8bc356f21-kube-api-access-jk6m4\") pod \"payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj\" (UID: \"fb04e713-7075-4901-a4ab-85f8bc356f21\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"
Sep 10 23:25:36.556741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.556713    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"
Sep 10 23:25:36.811690 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.811661    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"]
Sep 10 23:25:36.812923 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:25:36.812890    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2954a32_5ef5_4289_aa14_75417f0ab282.slice/crio-ade52d8a470295e45ca733870df563af5f808cbf873f7c344bd6fa09106f8edc WatchSource:0}: Error finding container ade52d8a470295e45ca733870df563af5f808cbf873f7c344bd6fa09106f8edc: Status 404 returned error can't find the container with id ade52d8a470295e45ca733870df563af5f808cbf873f7c344bd6fa09106f8edc
Sep 10 23:25:36.846757 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:36.846733    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"]
Sep 10 23:25:36.852761 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:25:36.852735    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb04e713_7075_4901_a4ab_85f8bc356f21.slice/crio-097399dc0a0b775e7e8992f73a743bfc0fd392a3046898a1b6bcf01192b8bd97 WatchSource:0}: Error finding container 097399dc0a0b775e7e8992f73a743bfc0fd392a3046898a1b6bcf01192b8bd97: Status 404 returned error can't find the container with id 097399dc0a0b775e7e8992f73a743bfc0fd392a3046898a1b6bcf01192b8bd97
Sep 10 23:25:37.344993 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:37.344944    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj" event={"ID":"fb04e713-7075-4901-a4ab-85f8bc356f21","Type":"ContainerStarted","Data":"40751eaad45754cafc2e72e02833422bdb723f9244a6067c6a0680f0ca4d5193"}
Sep 10 23:25:37.345449 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:37.345021    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"
Sep 10 23:25:37.345449 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:37.345044    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj" event={"ID":"fb04e713-7075-4901-a4ab-85f8bc356f21","Type":"ContainerStarted","Data":"097399dc0a0b775e7e8992f73a743bfc0fd392a3046898a1b6bcf01192b8bd97"}
Sep 10 23:25:37.346515 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:37.346486    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9" event={"ID":"b2954a32-5ef5-4289-aa14-75417f0ab282","Type":"ContainerStarted","Data":"eb1970fdb26c551a02838a66002abdca8bf1a20ef9c34ef6790893c05e33c115"}
Sep 10 23:25:37.346651 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:37.346538    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9" event={"ID":"b2954a32-5ef5-4289-aa14-75417f0ab282","Type":"ContainerStarted","Data":"ade52d8a470295e45ca733870df563af5f808cbf873f7c344bd6fa09106f8edc"}
Sep 10 23:25:37.346651 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:37.346593    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"
Sep 10 23:25:37.362366 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:37.362315    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj" podStartSLOduration=1.362299412 podStartE2EDuration="1.362299412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:25:37.359930194 +0000 UTC m=+1649.538801169" watchObservedRunningTime="2026-09-10 23:25:37.362299412 +0000 UTC m=+1649.541170375"
Sep 10 23:25:37.377433 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:37.377375    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9" podStartSLOduration=1.377359066 podStartE2EDuration="1.377359066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:25:37.374535251 +0000 UTC m=+1649.553406237" watchObservedRunningTime="2026-09-10 23:25:37.377359066 +0000 UTC m=+1649.556230064"
Sep 10 23:25:48.354854 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:48.354823    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"
Sep 10 23:25:48.355359 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:25:48.354891    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"
Sep 10 23:26:04.485730 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:04.485697    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pdlcg_3faa5574-b510-4949-b387-cc6607c9b0ac/payload-processing/0.log"
Sep 10 23:26:04.601774 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:04.601744    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj_fb04e713-7075-4901-a4ab-85f8bc356f21/payload-processing/0.log"
Sep 10 23:26:16.047841 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.047801    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"]
Sep 10 23:26:16.051406 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.051386    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.054496 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.054471    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-595479\"/\"openshift-service-ca.crt\""
Sep 10 23:26:16.054496 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.054485    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-595479\"/\"default-dockercfg-wn7sw\""
Sep 10 23:26:16.054732 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.054531    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-595479\"/\"kube-root-ca.crt\""
Sep 10 23:26:16.054732 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.054490    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-595479\"/\"ipp-route-595479-kserve-self-signed-certs\""
Sep 10 23:26:16.059679 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.059656    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"]
Sep 10 23:26:16.198400 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.198364    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-home\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.198400 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.198405    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28f8e046-e2e8-4da4-b6b7-60b568a2497d-tls-certs\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.198689 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.198436    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tfgb\" (UniqueName: \"kubernetes.io/projected/28f8e046-e2e8-4da4-b6b7-60b568a2497d-kube-api-access-9tfgb\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.198689 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.198593    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-tmp-dir\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.198689 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.198623    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-model-cache\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.198689 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.198670    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-dshm\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.299429 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.299345    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-tmp-dir\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.299429 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.299384    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-model-cache\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.299684 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.299441    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-dshm\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.299684 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.299485    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-home\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.299684 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.299511    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28f8e046-e2e8-4da4-b6b7-60b568a2497d-tls-certs\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.299684 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.299539    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tfgb\" (UniqueName: \"kubernetes.io/projected/28f8e046-e2e8-4da4-b6b7-60b568a2497d-kube-api-access-9tfgb\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.299915 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.299801    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-tmp-dir\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.299915 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.299855    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-model-cache\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.300191 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.300166    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-home\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.302145 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.302116    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-dshm\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.302724 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.302704    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28f8e046-e2e8-4da4-b6b7-60b568a2497d-tls-certs\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.307860 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.307838    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tfgb\" (UniqueName: \"kubernetes.io/projected/28f8e046-e2e8-4da4-b6b7-60b568a2497d-kube-api-access-9tfgb\") pod \"ipp-route-595479-kserve-76f45bc55f-d84dk\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") " pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.361662 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.361624    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:16.634885 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:16.634858    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"]
Sep 10 23:26:16.636262 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:26:16.636229    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28f8e046_e2e8_4da4_b6b7_60b568a2497d.slice/crio-0b6dc3b4f4c68041ba349c8745a18fcebd1db77f4c19e4d05ba3338bf8161764 WatchSource:0}: Error finding container 0b6dc3b4f4c68041ba349c8745a18fcebd1db77f4c19e4d05ba3338bf8161764: Status 404 returned error can't find the container with id 0b6dc3b4f4c68041ba349c8745a18fcebd1db77f4c19e4d05ba3338bf8161764
Sep 10 23:26:17.603975 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:17.603935    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk" event={"ID":"28f8e046-e2e8-4da4-b6b7-60b568a2497d","Type":"ContainerStarted","Data":"ab40d7e4a224fb0fd148d3acd1b5ec6b39160a37c8b5d5c727f6d3ca230b7afe"}
Sep 10 23:26:17.603975 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:17.603983    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk" event={"ID":"28f8e046-e2e8-4da4-b6b7-60b568a2497d","Type":"ContainerStarted","Data":"0b6dc3b4f4c68041ba349c8745a18fcebd1db77f4c19e4d05ba3338bf8161764"}
Sep 10 23:26:17.622329 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:17.622273    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk" podStartSLOduration=1.622255972 podStartE2EDuration="1.622255972s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:26:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:26:17.620056777 +0000 UTC m=+1689.798927734" watchObservedRunningTime="2026-09-10 23:26:17.622255972 +0000 UTC m=+1689.801126935"
Sep 10 23:26:26.362080 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:26.362046    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:26.362555 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:26.362094    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:26.374834 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:26.374812    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:26:26.666226 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:26:26.666141    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:27:00.650073 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:00.650034    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-595479-f6545889f-4hndw_aed426ef-e12f-4150-b252-fccf24d57364/payload-processing/0.log"
Sep 10 23:27:00.781475 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:00.781443    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pdlcg_3faa5574-b510-4949-b387-cc6607c9b0ac/payload-processing/0.log"
Sep 10 23:27:00.902806 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:00.902723    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj_fb04e713-7075-4901-a4ab-85f8bc356f21/payload-processing/0.log"
Sep 10 23:27:06.739966 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:06.739933    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"]
Sep 10 23:27:06.743824 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:06.743807    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"
Sep 10 23:27:06.745780 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:06.745757    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-2cdd19-dockercfg-sxzfb\""
Sep 10 23:27:06.745898 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:06.745837    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-2cdd19\""
Sep 10 23:27:06.754804 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:06.754781    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"]
Sep 10 23:27:06.790490 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:06.790459    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mqwf\" (UniqueName: \"kubernetes.io/projected/2ff13daf-5973-4a1f-a1ef-d818233e7e71-kube-api-access-9mqwf\") pod \"payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6\" (UID: \"2ff13daf-5973-4a1f-a1ef-d818233e7e71\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"
Sep 10 23:27:06.790670 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:06.790504    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ff13daf-5973-4a1f-a1ef-d818233e7e71-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6\" (UID: \"2ff13daf-5973-4a1f-a1ef-d818233e7e71\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"
Sep 10 23:27:06.891052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:06.891018    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ff13daf-5973-4a1f-a1ef-d818233e7e71-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6\" (UID: \"2ff13daf-5973-4a1f-a1ef-d818233e7e71\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"
Sep 10 23:27:06.891229 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:06.891150    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mqwf\" (UniqueName: \"kubernetes.io/projected/2ff13daf-5973-4a1f-a1ef-d818233e7e71-kube-api-access-9mqwf\") pod \"payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6\" (UID: \"2ff13daf-5973-4a1f-a1ef-d818233e7e71\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"
Sep 10 23:27:06.891727 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:06.891710    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ff13daf-5973-4a1f-a1ef-d818233e7e71-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6\" (UID: \"2ff13daf-5973-4a1f-a1ef-d818233e7e71\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"
Sep 10 23:27:06.899684 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:06.899657    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mqwf\" (UniqueName: \"kubernetes.io/projected/2ff13daf-5973-4a1f-a1ef-d818233e7e71-kube-api-access-9mqwf\") pod \"payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6\" (UID: \"2ff13daf-5973-4a1f-a1ef-d818233e7e71\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"
Sep 10 23:27:07.056426 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:07.056392    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"
Sep 10 23:27:07.343209 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:07.343184    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"]
Sep 10 23:27:07.344983 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:27:07.344956    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff13daf_5973_4a1f_a1ef_d818233e7e71.slice/crio-1fa999da42f5ccca1acd70fc9b65ece556d5506296a753c78d69036f4e4c02c1 WatchSource:0}: Error finding container 1fa999da42f5ccca1acd70fc9b65ece556d5506296a753c78d69036f4e4c02c1: Status 404 returned error can't find the container with id 1fa999da42f5ccca1acd70fc9b65ece556d5506296a753c78d69036f4e4c02c1
Sep 10 23:27:07.905590 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:07.905543    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6" event={"ID":"2ff13daf-5973-4a1f-a1ef-d818233e7e71","Type":"ContainerStarted","Data":"cb97ed5ce11760dd90896a0e016d6c25fb7b29f25f01bd4e114af992b3a6d6a5"}
Sep 10 23:27:07.906066 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:07.905617    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6" event={"ID":"2ff13daf-5973-4a1f-a1ef-d818233e7e71","Type":"ContainerStarted","Data":"1fa999da42f5ccca1acd70fc9b65ece556d5506296a753c78d69036f4e4c02c1"}
Sep 10 23:27:07.906066 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:07.905774    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"
Sep 10 23:27:07.924343 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:07.924296    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6" podStartSLOduration=1.9242827660000001 podStartE2EDuration="1.924282766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:27:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:27:07.922107797 +0000 UTC m=+1740.100978771" watchObservedRunningTime="2026-09-10 23:27:07.924282766 +0000 UTC m=+1740.103153728"
Sep 10 23:27:08.720375 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:08.720341    2585 scope.go:117] "RemoveContainer" containerID="28ee164a4d0882296cc27ceb7e7052405044936ef333d9333df4e67c341d1774"
Sep 10 23:27:18.914112 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:18.914081    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"
Sep 10 23:27:30.573852 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:30.573817    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z"]
Sep 10 23:27:30.577594 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:30.577550    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z"
Sep 10 23:27:30.579899 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:30.579877    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:27:30.580015 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:30.579918    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:27:30.586292 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:30.586269    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z"]
Sep 10 23:27:30.731483 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:30.731449    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7d61609-5aa2-41f9-a8f7-78344bda3a14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z\" (UID: \"c7d61609-5aa2-41f9-a8f7-78344bda3a14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z"
Sep 10 23:27:30.832581 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:30.832431    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7d61609-5aa2-41f9-a8f7-78344bda3a14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z\" (UID: \"c7d61609-5aa2-41f9-a8f7-78344bda3a14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z"
Sep 10 23:27:30.833077 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:30.833055    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7d61609-5aa2-41f9-a8f7-78344bda3a14-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z\" (UID: \"c7d61609-5aa2-41f9-a8f7-78344bda3a14\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z"
Sep 10 23:27:30.889993 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:30.889965    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z"
Sep 10 23:27:31.161386 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:31.161352    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z"]
Sep 10 23:27:31.162509 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:27:31.162482    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d61609_5aa2_41f9_a8f7_78344bda3a14.slice/crio-fa0fcb64498b31e53a6ecf7706de3fe02f3c42e48b4e4f9410b8b3b34e584fa9 WatchSource:0}: Error finding container fa0fcb64498b31e53a6ecf7706de3fe02f3c42e48b4e4f9410b8b3b34e584fa9: Status 404 returned error can't find the container with id fa0fcb64498b31e53a6ecf7706de3fe02f3c42e48b4e4f9410b8b3b34e584fa9
Sep 10 23:27:32.049222 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:32.049188    2585 generic.go:356] "Generic (PLEG): container finished" podID="c7d61609-5aa2-41f9-a8f7-78344bda3a14" containerID="e840c54e5e53f2334442807dfea0fe568ea940beafc21ef06fa6f3f51d40a2e0" exitCode=0
Sep 10 23:27:32.049679 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:32.049270    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z" event={"ID":"c7d61609-5aa2-41f9-a8f7-78344bda3a14","Type":"ContainerDied","Data":"e840c54e5e53f2334442807dfea0fe568ea940beafc21ef06fa6f3f51d40a2e0"}
Sep 10 23:27:32.049679 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:32.049318    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z" event={"ID":"c7d61609-5aa2-41f9-a8f7-78344bda3a14","Type":"ContainerStarted","Data":"fa0fcb64498b31e53a6ecf7706de3fe02f3c42e48b4e4f9410b8b3b34e584fa9"}
Sep 10 23:27:33.193985 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:33.193956    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z"
Sep 10 23:27:33.356037 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:33.355940    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7d61609-5aa2-41f9-a8f7-78344bda3a14-maas-api-service-ca\") pod \"c7d61609-5aa2-41f9-a8f7-78344bda3a14\" (UID: \"c7d61609-5aa2-41f9-a8f7-78344bda3a14\") "
Sep 10 23:27:33.356338 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:33.356312    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7d61609-5aa2-41f9-a8f7-78344bda3a14-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c7d61609-5aa2-41f9-a8f7-78344bda3a14" (UID: "c7d61609-5aa2-41f9-a8f7-78344bda3a14"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:27:33.457656 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:33.457620    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7d61609-5aa2-41f9-a8f7-78344bda3a14-maas-api-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:27:34.061547 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:34.061517    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z"
Sep 10 23:27:34.061547 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:34.061537    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z" event={"ID":"c7d61609-5aa2-41f9-a8f7-78344bda3a14","Type":"ContainerDied","Data":"fa0fcb64498b31e53a6ecf7706de3fe02f3c42e48b4e4f9410b8b3b34e584fa9"}
Sep 10 23:27:34.061782 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:34.061623    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa0fcb64498b31e53a6ecf7706de3fe02f3c42e48b4e4f9410b8b3b34e584fa9"
Sep 10 23:27:36.858972 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:36.858917    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"]
Sep 10 23:27:36.859447 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:36.859341    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6" podUID="2ff13daf-5973-4a1f-a1ef-d818233e7e71" containerName="payload-processing" containerID="cri-o://cb97ed5ce11760dd90896a0e016d6c25fb7b29f25f01bd4e114af992b3a6d6a5" gracePeriod=30
Sep 10 23:27:37.033966 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:37.033928    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z"]
Sep 10 23:27:37.038635 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:37.038608    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-2cdd19-hvx2z"]
Sep 10 23:27:37.081430 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:37.081400    2585 generic.go:356] "Generic (PLEG): container finished" podID="2ff13daf-5973-4a1f-a1ef-d818233e7e71" containerID="cb97ed5ce11760dd90896a0e016d6c25fb7b29f25f01bd4e114af992b3a6d6a5" exitCode=0
Sep 10 23:27:37.081606 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:37.081445    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6" event={"ID":"2ff13daf-5973-4a1f-a1ef-d818233e7e71","Type":"ContainerDied","Data":"cb97ed5ce11760dd90896a0e016d6c25fb7b29f25f01bd4e114af992b3a6d6a5"}
Sep 10 23:27:37.140104 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:37.139894    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"
Sep 10 23:27:37.290068 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:37.290031    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mqwf\" (UniqueName: \"kubernetes.io/projected/2ff13daf-5973-4a1f-a1ef-d818233e7e71-kube-api-access-9mqwf\") pod \"2ff13daf-5973-4a1f-a1ef-d818233e7e71\" (UID: \"2ff13daf-5973-4a1f-a1ef-d818233e7e71\") "
Sep 10 23:27:37.290244 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:37.290081    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ff13daf-5973-4a1f-a1ef-d818233e7e71-plugins-config-volume\") pod \"2ff13daf-5973-4a1f-a1ef-d818233e7e71\" (UID: \"2ff13daf-5973-4a1f-a1ef-d818233e7e71\") "
Sep 10 23:27:37.290487 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:37.290462    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ff13daf-5973-4a1f-a1ef-d818233e7e71-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2ff13daf-5973-4a1f-a1ef-d818233e7e71" (UID: "2ff13daf-5973-4a1f-a1ef-d818233e7e71"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:27:37.292157 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:37.292136    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ff13daf-5973-4a1f-a1ef-d818233e7e71-kube-api-access-9mqwf" (OuterVolumeSpecName: "kube-api-access-9mqwf") pod "2ff13daf-5973-4a1f-a1ef-d818233e7e71" (UID: "2ff13daf-5973-4a1f-a1ef-d818233e7e71"). InnerVolumeSpecName "kube-api-access-9mqwf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:27:37.390927 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:37.390842    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mqwf\" (UniqueName: \"kubernetes.io/projected/2ff13daf-5973-4a1f-a1ef-d818233e7e71-kube-api-access-9mqwf\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:27:37.390927 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:37.390874    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ff13daf-5973-4a1f-a1ef-d818233e7e71-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:27:38.088926 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:38.088892    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"
Sep 10 23:27:38.089385 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:38.088926    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6" event={"ID":"2ff13daf-5973-4a1f-a1ef-d818233e7e71","Type":"ContainerDied","Data":"1fa999da42f5ccca1acd70fc9b65ece556d5506296a753c78d69036f4e4c02c1"}
Sep 10 23:27:38.089385 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:38.088993    2585 scope.go:117] "RemoveContainer" containerID="cb97ed5ce11760dd90896a0e016d6c25fb7b29f25f01bd4e114af992b3a6d6a5"
Sep 10 23:27:38.120234 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:38.120197    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"]
Sep 10 23:27:38.124962 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:38.124930    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-2cdd19-687d54d885-jmkh6"]
Sep 10 23:27:38.345706 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:38.345063    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ff13daf-5973-4a1f-a1ef-d818233e7e71" path="/var/lib/kubelet/pods/2ff13daf-5973-4a1f-a1ef-d818233e7e71/volumes"
Sep 10 23:27:38.345706 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:38.345630    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7d61609-5aa2-41f9-a8f7-78344bda3a14" path="/var/lib/kubelet/pods/c7d61609-5aa2-41f9-a8f7-78344bda3a14/volumes"
Sep 10 23:27:47.509449 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.509409    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl"]
Sep 10 23:27:47.509895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.509880    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ff13daf-5973-4a1f-a1ef-d818233e7e71" containerName="payload-processing"
Sep 10 23:27:47.509942 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.509897    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ff13daf-5973-4a1f-a1ef-d818233e7e71" containerName="payload-processing"
Sep 10 23:27:47.509942 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.509910    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7d61609-5aa2-41f9-a8f7-78344bda3a14" containerName="revoke-keys"
Sep 10 23:27:47.509942 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.509916    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7d61609-5aa2-41f9-a8f7-78344bda3a14" containerName="revoke-keys"
Sep 10 23:27:47.510037 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.509999    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ff13daf-5973-4a1f-a1ef-d818233e7e71" containerName="payload-processing"
Sep 10 23:27:47.510037 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.510008    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7d61609-5aa2-41f9-a8f7-78344bda3a14" containerName="revoke-keys"
Sep 10 23:27:47.513238 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.513223    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl"
Sep 10 23:27:47.515512 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.515490    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:27:47.515656 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.515638    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:27:47.524688 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.524664    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl"]
Sep 10 23:27:47.590755 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.590724    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5ab030b-fcd8-498c-92ab-82a369df8d57-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-595479-wtczl\" (UID: \"e5ab030b-fcd8-498c-92ab-82a369df8d57\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl"
Sep 10 23:27:47.691524 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.691483    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5ab030b-fcd8-498c-92ab-82a369df8d57-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-595479-wtczl\" (UID: \"e5ab030b-fcd8-498c-92ab-82a369df8d57\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl"
Sep 10 23:27:47.692141 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.692123    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5ab030b-fcd8-498c-92ab-82a369df8d57-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-595479-wtczl\" (UID: \"e5ab030b-fcd8-498c-92ab-82a369df8d57\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl"
Sep 10 23:27:47.825008 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:47.824978    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl"
Sep 10 23:27:48.098826 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:48.098791    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl"]
Sep 10 23:27:48.099910 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:27:48.099877    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ab030b_fcd8_498c_92ab_82a369df8d57.slice/crio-807a63196fcc96119d1b56521bba686024334df4ad56f3135d3b4cbf56042459 WatchSource:0}: Error finding container 807a63196fcc96119d1b56521bba686024334df4ad56f3135d3b4cbf56042459: Status 404 returned error can't find the container with id 807a63196fcc96119d1b56521bba686024334df4ad56f3135d3b4cbf56042459
Sep 10 23:27:48.154801 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:48.154770    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl" event={"ID":"e5ab030b-fcd8-498c-92ab-82a369df8d57","Type":"ContainerStarted","Data":"807a63196fcc96119d1b56521bba686024334df4ad56f3135d3b4cbf56042459"}
Sep 10 23:27:49.161979 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:49.161890    2585 generic.go:356] "Generic (PLEG): container finished" podID="e5ab030b-fcd8-498c-92ab-82a369df8d57" containerID="edb1901fae8293cf7a4a8f6f9b9fd771ba69782cf53d64c16b2a760d3c6975d9" exitCode=0
Sep 10 23:27:49.162312 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:49.161976    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl" event={"ID":"e5ab030b-fcd8-498c-92ab-82a369df8d57","Type":"ContainerDied","Data":"edb1901fae8293cf7a4a8f6f9b9fd771ba69782cf53d64c16b2a760d3c6975d9"}
Sep 10 23:27:50.314975 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:50.314948    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl"
Sep 10 23:27:50.420170 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:50.420085    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5ab030b-fcd8-498c-92ab-82a369df8d57-maas-api-service-ca\") pod \"e5ab030b-fcd8-498c-92ab-82a369df8d57\" (UID: \"e5ab030b-fcd8-498c-92ab-82a369df8d57\") "
Sep 10 23:27:50.420511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:50.420484    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5ab030b-fcd8-498c-92ab-82a369df8d57-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e5ab030b-fcd8-498c-92ab-82a369df8d57" (UID: "e5ab030b-fcd8-498c-92ab-82a369df8d57"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:27:50.522060 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:50.522021    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e5ab030b-fcd8-498c-92ab-82a369df8d57-maas-api-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:27:51.175817 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:51.175787    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl"
Sep 10 23:27:51.175993 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:51.175816    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl" event={"ID":"e5ab030b-fcd8-498c-92ab-82a369df8d57","Type":"ContainerDied","Data":"807a63196fcc96119d1b56521bba686024334df4ad56f3135d3b4cbf56042459"}
Sep 10 23:27:51.175993 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:27:51.175862    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="807a63196fcc96119d1b56521bba686024334df4ad56f3135d3b4cbf56042459"
Sep 10 23:28:02.997009 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:02.996925    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"]
Sep 10 23:28:02.997572 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:02.997181    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw" podUID="aed426ef-e12f-4150-b252-fccf24d57364" containerName="payload-processing" containerID="cri-o://93b26bf6a5664680bd47aca12d326d94ea58ffe3141852fcb74741bee09f520d" gracePeriod=30
Sep 10 23:28:03.004395 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.004369    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"]
Sep 10 23:28:03.004764 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.004732    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv" podUID="26098b74-026f-4068-92c2-c56d774fc09c" containerName="payload-pre-processing" containerID="cri-o://c3916abf1bccbf1e52b579dfc0e6f658dffd160fc46e4fc0ab39932c6a1120d9" gracePeriod=30
Sep 10 23:28:03.169166 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.169130    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl"]
Sep 10 23:28:03.172695 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.172667    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-595479-wtczl"]
Sep 10 23:28:03.254941 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.254862    2585 generic.go:356] "Generic (PLEG): container finished" podID="aed426ef-e12f-4150-b252-fccf24d57364" containerID="93b26bf6a5664680bd47aca12d326d94ea58ffe3141852fcb74741bee09f520d" exitCode=0
Sep 10 23:28:03.255098 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.254941    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw" event={"ID":"aed426ef-e12f-4150-b252-fccf24d57364","Type":"ContainerDied","Data":"93b26bf6a5664680bd47aca12d326d94ea58ffe3141852fcb74741bee09f520d"}
Sep 10 23:28:03.256737 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.256714    2585 generic.go:356] "Generic (PLEG): container finished" podID="26098b74-026f-4068-92c2-c56d774fc09c" containerID="c3916abf1bccbf1e52b579dfc0e6f658dffd160fc46e4fc0ab39932c6a1120d9" exitCode=0
Sep 10 23:28:03.256876 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.256783    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv" event={"ID":"26098b74-026f-4068-92c2-c56d774fc09c","Type":"ContainerDied","Data":"c3916abf1bccbf1e52b579dfc0e6f658dffd160fc46e4fc0ab39932c6a1120d9"}
Sep 10 23:28:03.293958 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.293937    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"
Sep 10 23:28:03.308720 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.308698    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"
Sep 10 23:28:03.466747 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.466711    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88mm9\" (UniqueName: \"kubernetes.io/projected/26098b74-026f-4068-92c2-c56d774fc09c-kube-api-access-88mm9\") pod \"26098b74-026f-4068-92c2-c56d774fc09c\" (UID: \"26098b74-026f-4068-92c2-c56d774fc09c\") "
Sep 10 23:28:03.466919 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.466784    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6kdx\" (UniqueName: \"kubernetes.io/projected/aed426ef-e12f-4150-b252-fccf24d57364-kube-api-access-k6kdx\") pod \"aed426ef-e12f-4150-b252-fccf24d57364\" (UID: \"aed426ef-e12f-4150-b252-fccf24d57364\") "
Sep 10 23:28:03.466919 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.466828    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aed426ef-e12f-4150-b252-fccf24d57364-plugins-config-volume\") pod \"aed426ef-e12f-4150-b252-fccf24d57364\" (UID: \"aed426ef-e12f-4150-b252-fccf24d57364\") "
Sep 10 23:28:03.466919 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.466889    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26098b74-026f-4068-92c2-c56d774fc09c-plugins-config-volume\") pod \"26098b74-026f-4068-92c2-c56d774fc09c\" (UID: \"26098b74-026f-4068-92c2-c56d774fc09c\") "
Sep 10 23:28:03.467226 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.467199    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aed426ef-e12f-4150-b252-fccf24d57364-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aed426ef-e12f-4150-b252-fccf24d57364" (UID: "aed426ef-e12f-4150-b252-fccf24d57364"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:28:03.467296 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.467279    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26098b74-026f-4068-92c2-c56d774fc09c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "26098b74-026f-4068-92c2-c56d774fc09c" (UID: "26098b74-026f-4068-92c2-c56d774fc09c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:28:03.468984 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.468959    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26098b74-026f-4068-92c2-c56d774fc09c-kube-api-access-88mm9" (OuterVolumeSpecName: "kube-api-access-88mm9") pod "26098b74-026f-4068-92c2-c56d774fc09c" (UID: "26098b74-026f-4068-92c2-c56d774fc09c"). InnerVolumeSpecName "kube-api-access-88mm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:28:03.469089 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.469066    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aed426ef-e12f-4150-b252-fccf24d57364-kube-api-access-k6kdx" (OuterVolumeSpecName: "kube-api-access-k6kdx") pod "aed426ef-e12f-4150-b252-fccf24d57364" (UID: "aed426ef-e12f-4150-b252-fccf24d57364"). InnerVolumeSpecName "kube-api-access-k6kdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:28:03.568481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.568432    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26098b74-026f-4068-92c2-c56d774fc09c-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:28:03.568481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.568477    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88mm9\" (UniqueName: \"kubernetes.io/projected/26098b74-026f-4068-92c2-c56d774fc09c-kube-api-access-88mm9\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:28:03.568481 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.568491    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6kdx\" (UniqueName: \"kubernetes.io/projected/aed426ef-e12f-4150-b252-fccf24d57364-kube-api-access-k6kdx\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:28:03.568754 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:03.568503    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aed426ef-e12f-4150-b252-fccf24d57364-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:28:04.264193 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:04.264163    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"
Sep 10 23:28:04.264643 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:04.264188    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv" event={"ID":"26098b74-026f-4068-92c2-c56d774fc09c","Type":"ContainerDied","Data":"6da9b8bdfaae74c77544997ce564f6eb26bf244c217947f4cdb310aa7f66c09d"}
Sep 10 23:28:04.264643 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:04.264283    2585 scope.go:117] "RemoveContainer" containerID="c3916abf1bccbf1e52b579dfc0e6f658dffd160fc46e4fc0ab39932c6a1120d9"
Sep 10 23:28:04.265767 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:04.265603    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw" event={"ID":"aed426ef-e12f-4150-b252-fccf24d57364","Type":"ContainerDied","Data":"3d8207ca0d52bc8503ebd4d479115bfc7a41f1e44561f03b3d2c7ea9aab69d2a"}
Sep 10 23:28:04.265767 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:04.265636    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"
Sep 10 23:28:04.274194 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:04.274175    2585 scope.go:117] "RemoveContainer" containerID="93b26bf6a5664680bd47aca12d326d94ea58ffe3141852fcb74741bee09f520d"
Sep 10 23:28:04.289062 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:04.289030    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"]
Sep 10 23:28:04.293329 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:04.293308    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-595479-f6545889f-4hndw"]
Sep 10 23:28:04.304154 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:04.304124    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"]
Sep 10 23:28:04.306512 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:04.306491    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-595479-57f996b554-2qxkv"]
Sep 10 23:28:04.341507 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:04.341486    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26098b74-026f-4068-92c2-c56d774fc09c" path="/var/lib/kubelet/pods/26098b74-026f-4068-92c2-c56d774fc09c/volumes"
Sep 10 23:28:04.341852 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:04.341839    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aed426ef-e12f-4150-b252-fccf24d57364" path="/var/lib/kubelet/pods/aed426ef-e12f-4150-b252-fccf24d57364/volumes"
Sep 10 23:28:04.342120 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:04.342109    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5ab030b-fcd8-498c-92ab-82a369df8d57" path="/var/lib/kubelet/pods/e5ab030b-fcd8-498c-92ab-82a369df8d57/volumes"
Sep 10 23:28:08.474497 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:08.474470    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:28:08.482019 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:08.481994    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:28:08.483336 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:08.483318    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:28:08.490271 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:08.490252    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:28:08.533430 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:08.533397    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"]
Sep 10 23:28:23.553726 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.553669    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk" podUID="28f8e046-e2e8-4da4-b6b7-60b568a2497d" containerName="main" containerID="cri-o://ab40d7e4a224fb0fd148d3acd1b5ec6b39160a37c8b5d5c727f6d3ca230b7afe" gracePeriod=45
Sep 10 23:28:23.810475 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.810419    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:28:23.870805 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.870775    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-tmp-dir\") pod \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") "
Sep 10 23:28:23.870987 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.870863    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tfgb\" (UniqueName: \"kubernetes.io/projected/28f8e046-e2e8-4da4-b6b7-60b568a2497d-kube-api-access-9tfgb\") pod \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") "
Sep 10 23:28:23.870987 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.870905    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-dshm\") pod \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") "
Sep 10 23:28:23.870987 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.870952    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28f8e046-e2e8-4da4-b6b7-60b568a2497d-tls-certs\") pod \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") "
Sep 10 23:28:23.871162 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.871036    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "28f8e046-e2e8-4da4-b6b7-60b568a2497d" (UID: "28f8e046-e2e8-4da4-b6b7-60b568a2497d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:28:23.871162 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.871055    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-model-cache\") pod \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") "
Sep 10 23:28:23.871162 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.871155    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-home\") pod \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\" (UID: \"28f8e046-e2e8-4da4-b6b7-60b568a2497d\") "
Sep 10 23:28:23.871335 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.871221    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-model-cache" (OuterVolumeSpecName: "model-cache") pod "28f8e046-e2e8-4da4-b6b7-60b568a2497d" (UID: "28f8e046-e2e8-4da4-b6b7-60b568a2497d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:28:23.871511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.871488    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-tmp-dir\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:28:23.871511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.871506    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-home" (OuterVolumeSpecName: "home") pod "28f8e046-e2e8-4da4-b6b7-60b568a2497d" (UID: "28f8e046-e2e8-4da4-b6b7-60b568a2497d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:28:23.871678 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.871516    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-model-cache\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:28:23.873480 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.873454    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-dshm" (OuterVolumeSpecName: "dshm") pod "28f8e046-e2e8-4da4-b6b7-60b568a2497d" (UID: "28f8e046-e2e8-4da4-b6b7-60b568a2497d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:28:23.873480 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.873454    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28f8e046-e2e8-4da4-b6b7-60b568a2497d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "28f8e046-e2e8-4da4-b6b7-60b568a2497d" (UID: "28f8e046-e2e8-4da4-b6b7-60b568a2497d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:28:23.873707 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.873526    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28f8e046-e2e8-4da4-b6b7-60b568a2497d-kube-api-access-9tfgb" (OuterVolumeSpecName: "kube-api-access-9tfgb") pod "28f8e046-e2e8-4da4-b6b7-60b568a2497d" (UID: "28f8e046-e2e8-4da4-b6b7-60b568a2497d"). InnerVolumeSpecName "kube-api-access-9tfgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:28:23.979077 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.979034    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tfgb\" (UniqueName: \"kubernetes.io/projected/28f8e046-e2e8-4da4-b6b7-60b568a2497d-kube-api-access-9tfgb\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:28:23.979230 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.979188    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-dshm\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:28:23.979230 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.979200    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28f8e046-e2e8-4da4-b6b7-60b568a2497d-tls-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:28:23.979230 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:23.979209    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28f8e046-e2e8-4da4-b6b7-60b568a2497d-home\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:28:24.388857 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:24.388821    2585 generic.go:356] "Generic (PLEG): container finished" podID="28f8e046-e2e8-4da4-b6b7-60b568a2497d" containerID="ab40d7e4a224fb0fd148d3acd1b5ec6b39160a37c8b5d5c727f6d3ca230b7afe" exitCode=0
Sep 10 23:28:24.389047 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:24.388878    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"
Sep 10 23:28:24.389047 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:24.388902    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk" event={"ID":"28f8e046-e2e8-4da4-b6b7-60b568a2497d","Type":"ContainerDied","Data":"ab40d7e4a224fb0fd148d3acd1b5ec6b39160a37c8b5d5c727f6d3ca230b7afe"}
Sep 10 23:28:24.389047 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:24.388954    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk" event={"ID":"28f8e046-e2e8-4da4-b6b7-60b568a2497d","Type":"ContainerDied","Data":"0b6dc3b4f4c68041ba349c8745a18fcebd1db77f4c19e4d05ba3338bf8161764"}
Sep 10 23:28:24.389047 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:24.388980    2585 scope.go:117] "RemoveContainer" containerID="ab40d7e4a224fb0fd148d3acd1b5ec6b39160a37c8b5d5c727f6d3ca230b7afe"
Sep 10 23:28:24.400684 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:24.400662    2585 scope.go:117] "RemoveContainer" containerID="ab40d7e4a224fb0fd148d3acd1b5ec6b39160a37c8b5d5c727f6d3ca230b7afe"
Sep 10 23:28:24.401147 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:28:24.401124    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab40d7e4a224fb0fd148d3acd1b5ec6b39160a37c8b5d5c727f6d3ca230b7afe\": container with ID starting with ab40d7e4a224fb0fd148d3acd1b5ec6b39160a37c8b5d5c727f6d3ca230b7afe not found: ID does not exist" containerID="ab40d7e4a224fb0fd148d3acd1b5ec6b39160a37c8b5d5c727f6d3ca230b7afe"
Sep 10 23:28:24.401238 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:24.401157    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab40d7e4a224fb0fd148d3acd1b5ec6b39160a37c8b5d5c727f6d3ca230b7afe"} err="failed to get container status \"ab40d7e4a224fb0fd148d3acd1b5ec6b39160a37c8b5d5c727f6d3ca230b7afe\": rpc error: code = NotFound desc = could not find container \"ab40d7e4a224fb0fd148d3acd1b5ec6b39160a37c8b5d5c727f6d3ca230b7afe\": container with ID starting with ab40d7e4a224fb0fd148d3acd1b5ec6b39160a37c8b5d5c727f6d3ca230b7afe not found: ID does not exist"
Sep 10 23:28:24.412836 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:24.412812    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"]
Sep 10 23:28:24.416230 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:24.416208    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-595479/ipp-route-595479-kserve-76f45bc55f-d84dk"]
Sep 10 23:28:26.341979 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:28:26.341945    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28f8e046-e2e8-4da4-b6b7-60b568a2497d" path="/var/lib/kubelet/pods/28f8e046-e2e8-4da4-b6b7-60b568a2497d/volumes"
Sep 10 23:29:07.182472 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:07.182437    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"]
Sep 10 23:29:07.183097 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:07.182697    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy" containerID="cri-o://a59a469fccafdf462cac445aeaa52140daf4705a1e6e28fcb6879a0ada56d351" gracePeriod=30
Sep 10 23:29:12.192034 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.191985    2585 patch_prober.go:28] interesting pod/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused" start-of-body=
Sep 10 23:29:12.192479 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.192072    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.90:15021/healthz/ready\": dial tcp 10.134.0.90:15021: connect: connection refused"
Sep 10 23:29:12.446236 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.446172    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:29:12.565746 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.565708    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-istio-data\") pod \"def58862-7d87-4492-a88d-8b4fb8981439\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") "
Sep 10 23:29:12.566052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.565762    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcvpk\" (UniqueName: \"kubernetes.io/projected/def58862-7d87-4492-a88d-8b4fb8981439-kube-api-access-mcvpk\") pod \"def58862-7d87-4492-a88d-8b4fb8981439\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") "
Sep 10 23:29:12.566052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.565789    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def58862-7d87-4492-a88d-8b4fb8981439-istiod-ca-cert\") pod \"def58862-7d87-4492-a88d-8b4fb8981439\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") "
Sep 10 23:29:12.566052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.565804    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-istio-envoy\") pod \"def58862-7d87-4492-a88d-8b4fb8981439\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") "
Sep 10 23:29:12.566052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.565932    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-workload-socket\") pod \"def58862-7d87-4492-a88d-8b4fb8981439\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") "
Sep 10 23:29:12.566052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.565997    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-workload-certs\") pod \"def58862-7d87-4492-a88d-8b4fb8981439\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") "
Sep 10 23:29:12.566052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.566023    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def58862-7d87-4492-a88d-8b4fb8981439-istio-token\") pod \"def58862-7d87-4492-a88d-8b4fb8981439\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") "
Sep 10 23:29:12.566399 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.566078    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-credential-socket\") pod \"def58862-7d87-4492-a88d-8b4fb8981439\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") "
Sep 10 23:29:12.566399 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.566108    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def58862-7d87-4492-a88d-8b4fb8981439-istio-podinfo\") pod \"def58862-7d87-4492-a88d-8b4fb8981439\" (UID: \"def58862-7d87-4492-a88d-8b4fb8981439\") "
Sep 10 23:29:12.566399 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.566133    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-istio-data" (OuterVolumeSpecName: "istio-data") pod "def58862-7d87-4492-a88d-8b4fb8981439" (UID: "def58862-7d87-4492-a88d-8b4fb8981439"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:29:12.566399 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.566217    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "def58862-7d87-4492-a88d-8b4fb8981439" (UID: "def58862-7d87-4492-a88d-8b4fb8981439"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:29:12.566399 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.566242    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/def58862-7d87-4492-a88d-8b4fb8981439-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "def58862-7d87-4492-a88d-8b4fb8981439" (UID: "def58862-7d87-4492-a88d-8b4fb8981439"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:29:12.566399 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.566310    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "def58862-7d87-4492-a88d-8b4fb8981439" (UID: "def58862-7d87-4492-a88d-8b4fb8981439"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:29:12.566731 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.566484    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def58862-7d87-4492-a88d-8b4fb8981439-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:12.566731 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.566505    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:12.566731 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.566518    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:12.566731 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.566531    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:12.566731 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.566549    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "def58862-7d87-4492-a88d-8b4fb8981439" (UID: "def58862-7d87-4492-a88d-8b4fb8981439"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:29:12.568284 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.568254    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "def58862-7d87-4492-a88d-8b4fb8981439" (UID: "def58862-7d87-4492-a88d-8b4fb8981439"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:29:12.568386 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.568303    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def58862-7d87-4492-a88d-8b4fb8981439-istio-token" (OuterVolumeSpecName: "istio-token") pod "def58862-7d87-4492-a88d-8b4fb8981439" (UID: "def58862-7d87-4492-a88d-8b4fb8981439"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:29:12.568502 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.568479    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def58862-7d87-4492-a88d-8b4fb8981439-kube-api-access-mcvpk" (OuterVolumeSpecName: "kube-api-access-mcvpk") pod "def58862-7d87-4492-a88d-8b4fb8981439" (UID: "def58862-7d87-4492-a88d-8b4fb8981439"). InnerVolumeSpecName "kube-api-access-mcvpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:29:12.568601 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.568555    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/def58862-7d87-4492-a88d-8b4fb8981439-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "def58862-7d87-4492-a88d-8b4fb8981439" (UID: "def58862-7d87-4492-a88d-8b4fb8981439"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:29:12.667279 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.667240    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def58862-7d87-4492-a88d-8b4fb8981439-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:12.667279 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.667272    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:12.667279 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.667282    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def58862-7d87-4492-a88d-8b4fb8981439-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:12.667627 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.667291    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcvpk\" (UniqueName: \"kubernetes.io/projected/def58862-7d87-4492-a88d-8b4fb8981439-kube-api-access-mcvpk\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:12.667627 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.667301    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def58862-7d87-4492-a88d-8b4fb8981439-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:12.684222 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.684183    2585 generic.go:356] "Generic (PLEG): container finished" podID="def58862-7d87-4492-a88d-8b4fb8981439" containerID="a59a469fccafdf462cac445aeaa52140daf4705a1e6e28fcb6879a0ada56d351" exitCode=0
Sep 10 23:29:12.684376 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.684247    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"
Sep 10 23:29:12.684376 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.684264    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" event={"ID":"def58862-7d87-4492-a88d-8b4fb8981439","Type":"ContainerDied","Data":"a59a469fccafdf462cac445aeaa52140daf4705a1e6e28fcb6879a0ada56d351"}
Sep 10 23:29:12.684376 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.684347    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7" event={"ID":"def58862-7d87-4492-a88d-8b4fb8981439","Type":"ContainerDied","Data":"1db4c94c2b043162187d9deedd5c8213e8678b13cb530ec161e7a6bc8e3a9d8d"}
Sep 10 23:29:12.684376 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.684375    2585 scope.go:117] "RemoveContainer" containerID="a59a469fccafdf462cac445aeaa52140daf4705a1e6e28fcb6879a0ada56d351"
Sep 10 23:29:12.694527 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.694506    2585 scope.go:117] "RemoveContainer" containerID="75f36dbc22399387a1ea32670b913c97bffaab5b26a3189ddcf8dba44b3474e8"
Sep 10 23:29:12.703460 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.703440    2585 scope.go:117] "RemoveContainer" containerID="a59a469fccafdf462cac445aeaa52140daf4705a1e6e28fcb6879a0ada56d351"
Sep 10 23:29:12.703729 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:29:12.703711    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a59a469fccafdf462cac445aeaa52140daf4705a1e6e28fcb6879a0ada56d351\": container with ID starting with a59a469fccafdf462cac445aeaa52140daf4705a1e6e28fcb6879a0ada56d351 not found: ID does not exist" containerID="a59a469fccafdf462cac445aeaa52140daf4705a1e6e28fcb6879a0ada56d351"
Sep 10 23:29:12.703792 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.703739    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a59a469fccafdf462cac445aeaa52140daf4705a1e6e28fcb6879a0ada56d351"} err="failed to get container status \"a59a469fccafdf462cac445aeaa52140daf4705a1e6e28fcb6879a0ada56d351\": rpc error: code = NotFound desc = could not find container \"a59a469fccafdf462cac445aeaa52140daf4705a1e6e28fcb6879a0ada56d351\": container with ID starting with a59a469fccafdf462cac445aeaa52140daf4705a1e6e28fcb6879a0ada56d351 not found: ID does not exist"
Sep 10 23:29:12.703792 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.703755    2585 scope.go:117] "RemoveContainer" containerID="75f36dbc22399387a1ea32670b913c97bffaab5b26a3189ddcf8dba44b3474e8"
Sep 10 23:29:12.704019 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:29:12.704003    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75f36dbc22399387a1ea32670b913c97bffaab5b26a3189ddcf8dba44b3474e8\": container with ID starting with 75f36dbc22399387a1ea32670b913c97bffaab5b26a3189ddcf8dba44b3474e8 not found: ID does not exist" containerID="75f36dbc22399387a1ea32670b913c97bffaab5b26a3189ddcf8dba44b3474e8"
Sep 10 23:29:12.704073 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.704020    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75f36dbc22399387a1ea32670b913c97bffaab5b26a3189ddcf8dba44b3474e8"} err="failed to get container status \"75f36dbc22399387a1ea32670b913c97bffaab5b26a3189ddcf8dba44b3474e8\": rpc error: code = NotFound desc = could not find container \"75f36dbc22399387a1ea32670b913c97bffaab5b26a3189ddcf8dba44b3474e8\": container with ID starting with 75f36dbc22399387a1ea32670b913c97bffaab5b26a3189ddcf8dba44b3474e8 not found: ID does not exist"
Sep 10 23:29:12.708160 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.708137    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"]
Sep 10 23:29:12.712488 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:12.712464    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-595479-openshift-default-85649bb55b-pv8m7"]
Sep 10 23:29:14.342648 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:14.342609    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="def58862-7d87-4492-a88d-8b4fb8981439" path="/var/lib/kubelet/pods/def58862-7d87-4492-a88d-8b4fb8981439/volumes"
Sep 10 23:29:18.080699 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.080663    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"]
Sep 10 23:29:18.081328 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.081294    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj" podUID="fb04e713-7075-4901-a4ab-85f8bc356f21" containerName="payload-processing" containerID="cri-o://40751eaad45754cafc2e72e02833422bdb723f9244a6067c6a0680f0ca4d5193" gracePeriod=30
Sep 10 23:29:18.088047 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.087999    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"]
Sep 10 23:29:18.089776 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.088774    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9" podUID="b2954a32-5ef5-4289-aa14-75417f0ab282" containerName="payload-pre-processing" containerID="cri-o://eb1970fdb26c551a02838a66002abdca8bf1a20ef9c34ef6790893c05e33c115" gracePeriod=30
Sep 10 23:29:18.429490 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.412485    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"
Sep 10 23:29:18.439134 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.439105    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"
Sep 10 23:29:18.524692 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.524657    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2954a32-5ef5-4289-aa14-75417f0ab282-plugins-config-volume\") pod \"b2954a32-5ef5-4289-aa14-75417f0ab282\" (UID: \"b2954a32-5ef5-4289-aa14-75417f0ab282\") "
Sep 10 23:29:18.524902 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.524765    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb04e713-7075-4901-a4ab-85f8bc356f21-plugins-config-volume\") pod \"fb04e713-7075-4901-a4ab-85f8bc356f21\" (UID: \"fb04e713-7075-4901-a4ab-85f8bc356f21\") "
Sep 10 23:29:18.524902 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.524810    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n57ln\" (UniqueName: \"kubernetes.io/projected/b2954a32-5ef5-4289-aa14-75417f0ab282-kube-api-access-n57ln\") pod \"b2954a32-5ef5-4289-aa14-75417f0ab282\" (UID: \"b2954a32-5ef5-4289-aa14-75417f0ab282\") "
Sep 10 23:29:18.524902 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.524863    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jk6m4\" (UniqueName: \"kubernetes.io/projected/fb04e713-7075-4901-a4ab-85f8bc356f21-kube-api-access-jk6m4\") pod \"fb04e713-7075-4901-a4ab-85f8bc356f21\" (UID: \"fb04e713-7075-4901-a4ab-85f8bc356f21\") "
Sep 10 23:29:18.525089 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.525063    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2954a32-5ef5-4289-aa14-75417f0ab282-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b2954a32-5ef5-4289-aa14-75417f0ab282" (UID: "b2954a32-5ef5-4289-aa14-75417f0ab282"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:29:18.525147 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.525085    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb04e713-7075-4901-a4ab-85f8bc356f21-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fb04e713-7075-4901-a4ab-85f8bc356f21" (UID: "fb04e713-7075-4901-a4ab-85f8bc356f21"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:29:18.525202 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.525148    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2954a32-5ef5-4289-aa14-75417f0ab282-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:18.525202 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.525169    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fb04e713-7075-4901-a4ab-85f8bc356f21-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:18.527076 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.527049    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2954a32-5ef5-4289-aa14-75417f0ab282-kube-api-access-n57ln" (OuterVolumeSpecName: "kube-api-access-n57ln") pod "b2954a32-5ef5-4289-aa14-75417f0ab282" (UID: "b2954a32-5ef5-4289-aa14-75417f0ab282"). InnerVolumeSpecName "kube-api-access-n57ln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:29:18.527181 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.527055    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb04e713-7075-4901-a4ab-85f8bc356f21-kube-api-access-jk6m4" (OuterVolumeSpecName: "kube-api-access-jk6m4") pod "fb04e713-7075-4901-a4ab-85f8bc356f21" (UID: "fb04e713-7075-4901-a4ab-85f8bc356f21"). InnerVolumeSpecName "kube-api-access-jk6m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:29:18.625866 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.625781    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n57ln\" (UniqueName: \"kubernetes.io/projected/b2954a32-5ef5-4289-aa14-75417f0ab282-kube-api-access-n57ln\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:18.625866 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.625812    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jk6m4\" (UniqueName: \"kubernetes.io/projected/fb04e713-7075-4901-a4ab-85f8bc356f21-kube-api-access-jk6m4\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:18.719600 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.719520    2585 generic.go:356] "Generic (PLEG): container finished" podID="fb04e713-7075-4901-a4ab-85f8bc356f21" containerID="40751eaad45754cafc2e72e02833422bdb723f9244a6067c6a0680f0ca4d5193" exitCode=0
Sep 10 23:29:18.719600 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.719584    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"
Sep 10 23:29:18.719821 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.719611    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj" event={"ID":"fb04e713-7075-4901-a4ab-85f8bc356f21","Type":"ContainerDied","Data":"40751eaad45754cafc2e72e02833422bdb723f9244a6067c6a0680f0ca4d5193"}
Sep 10 23:29:18.719821 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.719693    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj" event={"ID":"fb04e713-7075-4901-a4ab-85f8bc356f21","Type":"ContainerDied","Data":"097399dc0a0b775e7e8992f73a743bfc0fd392a3046898a1b6bcf01192b8bd97"}
Sep 10 23:29:18.719821 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.719720    2585 scope.go:117] "RemoveContainer" containerID="40751eaad45754cafc2e72e02833422bdb723f9244a6067c6a0680f0ca4d5193"
Sep 10 23:29:18.721099 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.721080    2585 generic.go:356] "Generic (PLEG): container finished" podID="b2954a32-5ef5-4289-aa14-75417f0ab282" containerID="eb1970fdb26c551a02838a66002abdca8bf1a20ef9c34ef6790893c05e33c115" exitCode=0
Sep 10 23:29:18.721211 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.721152    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"
Sep 10 23:29:18.721211 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.721181    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9" event={"ID":"b2954a32-5ef5-4289-aa14-75417f0ab282","Type":"ContainerDied","Data":"eb1970fdb26c551a02838a66002abdca8bf1a20ef9c34ef6790893c05e33c115"}
Sep 10 23:29:18.721339 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.721243    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9" event={"ID":"b2954a32-5ef5-4289-aa14-75417f0ab282","Type":"ContainerDied","Data":"ade52d8a470295e45ca733870df563af5f808cbf873f7c344bd6fa09106f8edc"}
Sep 10 23:29:18.729630 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.729605    2585 scope.go:117] "RemoveContainer" containerID="40751eaad45754cafc2e72e02833422bdb723f9244a6067c6a0680f0ca4d5193"
Sep 10 23:29:18.729932 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:29:18.729911    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40751eaad45754cafc2e72e02833422bdb723f9244a6067c6a0680f0ca4d5193\": container with ID starting with 40751eaad45754cafc2e72e02833422bdb723f9244a6067c6a0680f0ca4d5193 not found: ID does not exist" containerID="40751eaad45754cafc2e72e02833422bdb723f9244a6067c6a0680f0ca4d5193"
Sep 10 23:29:18.730026 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.729939    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40751eaad45754cafc2e72e02833422bdb723f9244a6067c6a0680f0ca4d5193"} err="failed to get container status \"40751eaad45754cafc2e72e02833422bdb723f9244a6067c6a0680f0ca4d5193\": rpc error: code = NotFound desc = could not find container \"40751eaad45754cafc2e72e02833422bdb723f9244a6067c6a0680f0ca4d5193\": container with ID starting with 40751eaad45754cafc2e72e02833422bdb723f9244a6067c6a0680f0ca4d5193 not found: ID does not exist"
Sep 10 23:29:18.730026 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.729956    2585 scope.go:117] "RemoveContainer" containerID="eb1970fdb26c551a02838a66002abdca8bf1a20ef9c34ef6790893c05e33c115"
Sep 10 23:29:18.738300 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.738284    2585 scope.go:117] "RemoveContainer" containerID="eb1970fdb26c551a02838a66002abdca8bf1a20ef9c34ef6790893c05e33c115"
Sep 10 23:29:18.738572 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:29:18.738543    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb1970fdb26c551a02838a66002abdca8bf1a20ef9c34ef6790893c05e33c115\": container with ID starting with eb1970fdb26c551a02838a66002abdca8bf1a20ef9c34ef6790893c05e33c115 not found: ID does not exist" containerID="eb1970fdb26c551a02838a66002abdca8bf1a20ef9c34ef6790893c05e33c115"
Sep 10 23:29:18.738627 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.738583    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb1970fdb26c551a02838a66002abdca8bf1a20ef9c34ef6790893c05e33c115"} err="failed to get container status \"eb1970fdb26c551a02838a66002abdca8bf1a20ef9c34ef6790893c05e33c115\": rpc error: code = NotFound desc = could not find container \"eb1970fdb26c551a02838a66002abdca8bf1a20ef9c34ef6790893c05e33c115\": container with ID starting with eb1970fdb26c551a02838a66002abdca8bf1a20ef9c34ef6790893c05e33c115 not found: ID does not exist"
Sep 10 23:29:18.746269 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.746245    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"]
Sep 10 23:29:18.750624 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.750597    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj"]
Sep 10 23:29:18.760945 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.760922    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"]
Sep 10 23:29:18.765283 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:18.765261    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9"]
Sep 10 23:29:19.353074 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:19.353033    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-ipp-b-c6c079-66bfdf57dc-wclnj" podUID="fb04e713-7075-4901-a4ab-85f8bc356f21" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.94:9004: i/o timeout"
Sep 10 23:29:19.353534 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:19.353039    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-c6c079-df865d78-b6cn9" podUID="b2954a32-5ef5-4289-aa14-75417f0ab282" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.93:9004: i/o timeout"
Sep 10 23:29:20.342042 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:20.342008    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2954a32-5ef5-4289-aa14-75417f0ab282" path="/var/lib/kubelet/pods/b2954a32-5ef5-4289-aa14-75417f0ab282/volumes"
Sep 10 23:29:20.342372 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:20.342358    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fb04e713-7075-4901-a4ab-85f8bc356f21" path="/var/lib/kubelet/pods/fb04e713-7075-4901-a4ab-85f8bc356f21/volumes"
Sep 10 23:29:25.656098 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656060    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl"]
Sep 10 23:29:25.656485 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656450    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2954a32-5ef5-4289-aa14-75417f0ab282" containerName="payload-pre-processing"
Sep 10 23:29:25.656485 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656461    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2954a32-5ef5-4289-aa14-75417f0ab282" containerName="payload-pre-processing"
Sep 10 23:29:25.656485 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656475    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5ab030b-fcd8-498c-92ab-82a369df8d57" containerName="revoke-keys"
Sep 10 23:29:25.656485 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656481    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5ab030b-fcd8-498c-92ab-82a369df8d57" containerName="revoke-keys"
Sep 10 23:29:25.656664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656493    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy"
Sep 10 23:29:25.656664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656499    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy"
Sep 10 23:29:25.656664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656506    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aed426ef-e12f-4150-b252-fccf24d57364" containerName="payload-processing"
Sep 10 23:29:25.656664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656511    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="aed426ef-e12f-4150-b252-fccf24d57364" containerName="payload-processing"
Sep 10 23:29:25.656664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656517    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb04e713-7075-4901-a4ab-85f8bc356f21" containerName="payload-processing"
Sep 10 23:29:25.656664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656523    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb04e713-7075-4901-a4ab-85f8bc356f21" containerName="payload-processing"
Sep 10 23:29:25.656664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656532    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28f8e046-e2e8-4da4-b6b7-60b568a2497d" containerName="main"
Sep 10 23:29:25.656664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656537    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="28f8e046-e2e8-4da4-b6b7-60b568a2497d" containerName="main"
Sep 10 23:29:25.656664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656545    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26098b74-026f-4068-92c2-c56d774fc09c" containerName="payload-pre-processing"
Sep 10 23:29:25.656664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656550    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="26098b74-026f-4068-92c2-c56d774fc09c" containerName="payload-pre-processing"
Sep 10 23:29:25.656664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656577    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy"
Sep 10 23:29:25.656664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656586    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy"
Sep 10 23:29:25.656664 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656667    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy"
Sep 10 23:29:25.657053 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656677    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb04e713-7075-4901-a4ab-85f8bc356f21" containerName="payload-processing"
Sep 10 23:29:25.657053 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656682    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="def58862-7d87-4492-a88d-8b4fb8981439" containerName="istio-proxy"
Sep 10 23:29:25.657053 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656689    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="26098b74-026f-4068-92c2-c56d774fc09c" containerName="payload-pre-processing"
Sep 10 23:29:25.657053 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656694    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="aed426ef-e12f-4150-b252-fccf24d57364" containerName="payload-processing"
Sep 10 23:29:25.657053 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656699    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="28f8e046-e2e8-4da4-b6b7-60b568a2497d" containerName="main"
Sep 10 23:29:25.657053 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656705    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5ab030b-fcd8-498c-92ab-82a369df8d57" containerName="revoke-keys"
Sep 10 23:29:25.657053 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.656710    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2954a32-5ef5-4289-aa14-75417f0ab282" containerName="payload-pre-processing"
Sep 10 23:29:25.661191 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.661175    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl"
Sep 10 23:29:25.663633 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.663610    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:29:25.663633 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.663623    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:29:25.667842 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.667809    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl"]
Sep 10 23:29:25.692045 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.692013    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfe2d2ed-18a6-4faa-9cfe-66142071fd5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl\" (UID: \"cfe2d2ed-18a6-4faa-9cfe-66142071fd5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl"
Sep 10 23:29:25.793295 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.793261    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfe2d2ed-18a6-4faa-9cfe-66142071fd5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl\" (UID: \"cfe2d2ed-18a6-4faa-9cfe-66142071fd5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl"
Sep 10 23:29:25.793918 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.793899    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfe2d2ed-18a6-4faa-9cfe-66142071fd5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl\" (UID: \"cfe2d2ed-18a6-4faa-9cfe-66142071fd5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl"
Sep 10 23:29:25.973622 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:25.973535    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl"
Sep 10 23:29:26.244506 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:26.244337    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl"]
Sep 10 23:29:26.247423 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:29:26.247396    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe2d2ed_18a6_4faa_9cfe_66142071fd5b.slice/crio-f52638ea65887ba00a15178d23e8af778f0996690f2c5c4b6a59f446be9a91d3 WatchSource:0}: Error finding container f52638ea65887ba00a15178d23e8af778f0996690f2c5c4b6a59f446be9a91d3: Status 404 returned error can't find the container with id f52638ea65887ba00a15178d23e8af778f0996690f2c5c4b6a59f446be9a91d3
Sep 10 23:29:26.774405 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:26.774314    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl" event={"ID":"cfe2d2ed-18a6-4faa-9cfe-66142071fd5b","Type":"ContainerStarted","Data":"1b5187cd164be857e49a60bd14e4f24353d8c5bcb7323ca75ee927a300066816"}
Sep 10 23:29:26.774405 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:26.774375    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl" event={"ID":"cfe2d2ed-18a6-4faa-9cfe-66142071fd5b","Type":"ContainerStarted","Data":"f52638ea65887ba00a15178d23e8af778f0996690f2c5c4b6a59f446be9a91d3"}
Sep 10 23:29:26.790474 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:26.790422    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl" podStartSLOduration=1.790404616 podStartE2EDuration="1.790404616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:29:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:29:26.789482448 +0000 UTC m=+1878.968353412" watchObservedRunningTime="2026-09-10 23:29:26.790404616 +0000 UTC m=+1878.969275580"
Sep 10 23:29:27.782493 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:27.782459    2585 generic.go:356] "Generic (PLEG): container finished" podID="cfe2d2ed-18a6-4faa-9cfe-66142071fd5b" containerID="1b5187cd164be857e49a60bd14e4f24353d8c5bcb7323ca75ee927a300066816" exitCode=0
Sep 10 23:29:27.782904 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:27.782545    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl" event={"ID":"cfe2d2ed-18a6-4faa-9cfe-66142071fd5b","Type":"ContainerDied","Data":"1b5187cd164be857e49a60bd14e4f24353d8c5bcb7323ca75ee927a300066816"}
Sep 10 23:29:28.926480 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:28.926457    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl"
Sep 10 23:29:29.020821 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:29.020789    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfe2d2ed-18a6-4faa-9cfe-66142071fd5b-maas-api-service-ca\") pod \"cfe2d2ed-18a6-4faa-9cfe-66142071fd5b\" (UID: \"cfe2d2ed-18a6-4faa-9cfe-66142071fd5b\") "
Sep 10 23:29:29.021167 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:29.021143    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfe2d2ed-18a6-4faa-9cfe-66142071fd5b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cfe2d2ed-18a6-4faa-9cfe-66142071fd5b" (UID: "cfe2d2ed-18a6-4faa-9cfe-66142071fd5b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:29:29.121938 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:29.121902    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfe2d2ed-18a6-4faa-9cfe-66142071fd5b-maas-api-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:29.796036 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:29.796005    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl" event={"ID":"cfe2d2ed-18a6-4faa-9cfe-66142071fd5b","Type":"ContainerDied","Data":"f52638ea65887ba00a15178d23e8af778f0996690f2c5c4b6a59f446be9a91d3"}
Sep 10 23:29:29.796221 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:29.796058    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f52638ea65887ba00a15178d23e8af778f0996690f2c5c4b6a59f446be9a91d3"
Sep 10 23:29:29.796221 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:29.796012    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl"
Sep 10 23:29:36.417418 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.417320    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"]
Sep 10 23:29:36.417841 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.417585    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm" podUID="45b13cd1-d0b1-4a96-bd78-ab426a88bc22" containerName="payload-processing" containerID="cri-o://5082d33c833bdbd7b09912326a8497e0e9b1f48e5fa39a22a318a5b70268c3e5" gracePeriod=30
Sep 10 23:29:36.623541 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.623504    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl"]
Sep 10 23:29:36.625791 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.625766    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-2da572-vp2bl"]
Sep 10 23:29:36.678487 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.678425    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"
Sep 10 23:29:36.794430 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.794401    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgnp4\" (UniqueName: \"kubernetes.io/projected/45b13cd1-d0b1-4a96-bd78-ab426a88bc22-kube-api-access-hgnp4\") pod \"45b13cd1-d0b1-4a96-bd78-ab426a88bc22\" (UID: \"45b13cd1-d0b1-4a96-bd78-ab426a88bc22\") "
Sep 10 23:29:36.794655 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.794484    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45b13cd1-d0b1-4a96-bd78-ab426a88bc22-plugins-config-volume\") pod \"45b13cd1-d0b1-4a96-bd78-ab426a88bc22\" (UID: \"45b13cd1-d0b1-4a96-bd78-ab426a88bc22\") "
Sep 10 23:29:36.794855 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.794833    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/45b13cd1-d0b1-4a96-bd78-ab426a88bc22-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "45b13cd1-d0b1-4a96-bd78-ab426a88bc22" (UID: "45b13cd1-d0b1-4a96-bd78-ab426a88bc22"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:29:36.796611 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.796549    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45b13cd1-d0b1-4a96-bd78-ab426a88bc22-kube-api-access-hgnp4" (OuterVolumeSpecName: "kube-api-access-hgnp4") pod "45b13cd1-d0b1-4a96-bd78-ab426a88bc22" (UID: "45b13cd1-d0b1-4a96-bd78-ab426a88bc22"). InnerVolumeSpecName "kube-api-access-hgnp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:29:36.837101 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.837066    2585 generic.go:356] "Generic (PLEG): container finished" podID="45b13cd1-d0b1-4a96-bd78-ab426a88bc22" containerID="5082d33c833bdbd7b09912326a8497e0e9b1f48e5fa39a22a318a5b70268c3e5" exitCode=0
Sep 10 23:29:36.837101 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.837102    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm" event={"ID":"45b13cd1-d0b1-4a96-bd78-ab426a88bc22","Type":"ContainerDied","Data":"5082d33c833bdbd7b09912326a8497e0e9b1f48e5fa39a22a318a5b70268c3e5"}
Sep 10 23:29:36.837267 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.837109    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"
Sep 10 23:29:36.837267 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.837171    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm" event={"ID":"45b13cd1-d0b1-4a96-bd78-ab426a88bc22","Type":"ContainerDied","Data":"1c13accbc8a360f42a16ed89ba755207410e25d21cfdd6e769363c842e5c572b"}
Sep 10 23:29:36.837267 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.837192    2585 scope.go:117] "RemoveContainer" containerID="5082d33c833bdbd7b09912326a8497e0e9b1f48e5fa39a22a318a5b70268c3e5"
Sep 10 23:29:36.846271 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.846256    2585 scope.go:117] "RemoveContainer" containerID="5082d33c833bdbd7b09912326a8497e0e9b1f48e5fa39a22a318a5b70268c3e5"
Sep 10 23:29:36.846494 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:29:36.846479    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5082d33c833bdbd7b09912326a8497e0e9b1f48e5fa39a22a318a5b70268c3e5\": container with ID starting with 5082d33c833bdbd7b09912326a8497e0e9b1f48e5fa39a22a318a5b70268c3e5 not found: ID does not exist" containerID="5082d33c833bdbd7b09912326a8497e0e9b1f48e5fa39a22a318a5b70268c3e5"
Sep 10 23:29:36.846539 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.846502    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5082d33c833bdbd7b09912326a8497e0e9b1f48e5fa39a22a318a5b70268c3e5"} err="failed to get container status \"5082d33c833bdbd7b09912326a8497e0e9b1f48e5fa39a22a318a5b70268c3e5\": rpc error: code = NotFound desc = could not find container \"5082d33c833bdbd7b09912326a8497e0e9b1f48e5fa39a22a318a5b70268c3e5\": container with ID starting with 5082d33c833bdbd7b09912326a8497e0e9b1f48e5fa39a22a318a5b70268c3e5 not found: ID does not exist"
Sep 10 23:29:36.869201 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.869174    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"]
Sep 10 23:29:36.873126 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.873102    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-2da572-89fd55cbf-86xjm"]
Sep 10 23:29:36.896131 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.896108    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgnp4\" (UniqueName: \"kubernetes.io/projected/45b13cd1-d0b1-4a96-bd78-ab426a88bc22-kube-api-access-hgnp4\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:36.896131 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:36.896131    2585 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/45b13cd1-d0b1-4a96-bd78-ab426a88bc22-plugins-config-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:38.342704 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:38.342671    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45b13cd1-d0b1-4a96-bd78-ab426a88bc22" path="/var/lib/kubelet/pods/45b13cd1-d0b1-4a96-bd78-ab426a88bc22/volumes"
Sep 10 23:29:38.343164 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:38.343005    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfe2d2ed-18a6-4faa-9cfe-66142071fd5b" path="/var/lib/kubelet/pods/cfe2d2ed-18a6-4faa-9cfe-66142071fd5b/volumes"
Sep 10 23:29:43.749474 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:43.749433    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"]
Sep 10 23:29:43.749889 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:43.749722    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerName="istio-proxy" containerID="cri-o://0b97f75c8ae6ae927bc8cc8fc33dd76222b5e170772007214fd5a3cabe2d1210" gracePeriod=30
Sep 10 23:29:44.090250 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.090215    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m"]
Sep 10 23:29:44.090598 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.090585    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45b13cd1-d0b1-4a96-bd78-ab426a88bc22" containerName="payload-processing"
Sep 10 23:29:44.090649 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.090599    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="45b13cd1-d0b1-4a96-bd78-ab426a88bc22" containerName="payload-processing"
Sep 10 23:29:44.090649 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.090618    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe2d2ed-18a6-4faa-9cfe-66142071fd5b" containerName="revoke-keys"
Sep 10 23:29:44.090649 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.090623    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe2d2ed-18a6-4faa-9cfe-66142071fd5b" containerName="revoke-keys"
Sep 10 23:29:44.090749 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.090693    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="45b13cd1-d0b1-4a96-bd78-ab426a88bc22" containerName="payload-processing"
Sep 10 23:29:44.090749 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.090700    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe2d2ed-18a6-4faa-9cfe-66142071fd5b" containerName="revoke-keys"
Sep 10 23:29:44.093784 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.093768    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m"
Sep 10 23:29:44.096051 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.096028    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 23:29:44.096175 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.096093    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:29:44.102909 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.102886    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m"]
Sep 10 23:29:44.165629 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.165595    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd68878-a06e-4576-9b05-54f9470be03e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m\" (UID: \"1bd68878-a06e-4576-9b05-54f9470be03e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m"
Sep 10 23:29:44.267122 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.267084    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd68878-a06e-4576-9b05-54f9470be03e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m\" (UID: \"1bd68878-a06e-4576-9b05-54f9470be03e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m"
Sep 10 23:29:44.268007 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.267939    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd68878-a06e-4576-9b05-54f9470be03e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m\" (UID: \"1bd68878-a06e-4576-9b05-54f9470be03e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m"
Sep 10 23:29:44.406652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.406548    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m"
Sep 10 23:29:44.678937 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.678913    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m"]
Sep 10 23:29:44.680856 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:29:44.680819    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bd68878_a06e_4576_9b05_54f9470be03e.slice/crio-dbccec0ec97214ce9eb78b57f8f6579ad7250770286064895f32693b3b2ec650 WatchSource:0}: Error finding container dbccec0ec97214ce9eb78b57f8f6579ad7250770286064895f32693b3b2ec650: Status 404 returned error can't find the container with id dbccec0ec97214ce9eb78b57f8f6579ad7250770286064895f32693b3b2ec650
Sep 10 23:29:44.886118 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:44.886079    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m" event={"ID":"1bd68878-a06e-4576-9b05-54f9470be03e","Type":"ContainerStarted","Data":"dbccec0ec97214ce9eb78b57f8f6579ad7250770286064895f32693b3b2ec650"}
Sep 10 23:29:45.892744 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:45.892712    2585 generic.go:356] "Generic (PLEG): container finished" podID="1bd68878-a06e-4576-9b05-54f9470be03e" containerID="1133c80d2d9e9ca9416a705943456f7f2dd8533d136ef7db866cb2479955bc7e" exitCode=0
Sep 10 23:29:45.893144 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:45.892797    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m" event={"ID":"1bd68878-a06e-4576-9b05-54f9470be03e","Type":"ContainerDied","Data":"1133c80d2d9e9ca9416a705943456f7f2dd8533d136ef7db866cb2479955bc7e"}
Sep 10 23:29:47.029791 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:47.029758    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m"
Sep 10 23:29:47.200048 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:47.199942    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd68878-a06e-4576-9b05-54f9470be03e-maas-api-service-ca\") pod \"1bd68878-a06e-4576-9b05-54f9470be03e\" (UID: \"1bd68878-a06e-4576-9b05-54f9470be03e\") "
Sep 10 23:29:47.200317 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:47.200292    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bd68878-a06e-4576-9b05-54f9470be03e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1bd68878-a06e-4576-9b05-54f9470be03e" (UID: "1bd68878-a06e-4576-9b05-54f9470be03e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:29:47.301362 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:47.301320    2585 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1bd68878-a06e-4576-9b05-54f9470be03e-maas-api-service-ca\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:47.547322 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:47.547285    2585 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 23:29:47.547515 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:47.547346    2585 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 23:29:47.905469 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:47.905385    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m"
Sep 10 23:29:47.905469 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:47.905410    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m" event={"ID":"1bd68878-a06e-4576-9b05-54f9470be03e","Type":"ContainerDied","Data":"dbccec0ec97214ce9eb78b57f8f6579ad7250770286064895f32693b3b2ec650"}
Sep 10 23:29:47.905469 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:47.905453    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbccec0ec97214ce9eb78b57f8f6579ad7250770286064895f32693b3b2ec650"
Sep 10 23:29:48.913658 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:48.913553    2585 generic.go:356] "Generic (PLEG): container finished" podID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerID="0b97f75c8ae6ae927bc8cc8fc33dd76222b5e170772007214fd5a3cabe2d1210" exitCode=0
Sep 10 23:29:48.913658 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:48.913594    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" event={"ID":"e20fdc2c-bd2e-4cc1-905e-02b0817703d5","Type":"ContainerDied","Data":"0b97f75c8ae6ae927bc8cc8fc33dd76222b5e170772007214fd5a3cabe2d1210"}
Sep 10 23:29:48.914153 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:48.913674    2585 scope.go:117] "RemoveContainer" containerID="1a200f2cbc0d1dc3ff8bc10e4b8906259bc55c3d17e06d79ad64f6e04b55784e"
Sep 10 23:29:49.012221 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.012194    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:29:49.115786 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.115755    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-data\") pod \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") "
Sep 10 23:29:49.115981 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.115839    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-workload-socket\") pod \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") "
Sep 10 23:29:49.115981 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.115933    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fct5v\" (UniqueName: \"kubernetes.io/projected/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-kube-api-access-fct5v\") pod \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") "
Sep 10 23:29:49.116121 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.115982    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-credential-socket\") pod \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") "
Sep 10 23:29:49.116121 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116006    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-workload-certs\") pod \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") "
Sep 10 23:29:49.116121 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116045    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-token\") pod \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") "
Sep 10 23:29:49.116121 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116053    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "e20fdc2c-bd2e-4cc1-905e-02b0817703d5" (UID: "e20fdc2c-bd2e-4cc1-905e-02b0817703d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:29:49.116121 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116076    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-envoy\") pod \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") "
Sep 10 23:29:49.116384 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116132    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-podinfo\") pod \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") "
Sep 10 23:29:49.116384 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116195    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istiod-ca-cert\") pod \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\" (UID: \"e20fdc2c-bd2e-4cc1-905e-02b0817703d5\") "
Sep 10 23:29:49.116384 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116210    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e20fdc2c-bd2e-4cc1-905e-02b0817703d5" (UID: "e20fdc2c-bd2e-4cc1-905e-02b0817703d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:29:49.116384 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116264    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e20fdc2c-bd2e-4cc1-905e-02b0817703d5" (UID: "e20fdc2c-bd2e-4cc1-905e-02b0817703d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:29:49.116384 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116297    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e20fdc2c-bd2e-4cc1-905e-02b0817703d5" (UID: "e20fdc2c-bd2e-4cc1-905e-02b0817703d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:29:49.116652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116533    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:49.116652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116553    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:49.116652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116594    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e20fdc2c-bd2e-4cc1-905e-02b0817703d5" (UID: "e20fdc2c-bd2e-4cc1-905e-02b0817703d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:29:49.116652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116601    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:49.116652 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.116623    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:49.118736 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.118705    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-kube-api-access-fct5v" (OuterVolumeSpecName: "kube-api-access-fct5v") pod "e20fdc2c-bd2e-4cc1-905e-02b0817703d5" (UID: "e20fdc2c-bd2e-4cc1-905e-02b0817703d5"). InnerVolumeSpecName "kube-api-access-fct5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:29:49.118736 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.118714    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e20fdc2c-bd2e-4cc1-905e-02b0817703d5" (UID: "e20fdc2c-bd2e-4cc1-905e-02b0817703d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:29:49.118736 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.118722    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "e20fdc2c-bd2e-4cc1-905e-02b0817703d5" (UID: "e20fdc2c-bd2e-4cc1-905e-02b0817703d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:29:49.118883 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.118773    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e20fdc2c-bd2e-4cc1-905e-02b0817703d5" (UID: "e20fdc2c-bd2e-4cc1-905e-02b0817703d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:29:49.217404 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.217373    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fct5v\" (UniqueName: \"kubernetes.io/projected/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-kube-api-access-fct5v\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:49.217404 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.217402    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:49.217404 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.217412    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:49.217676 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.217422    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:49.217676 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.217429    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e20fdc2c-bd2e-4cc1-905e-02b0817703d5-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:29:49.920989 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.920964    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"
Sep 10 23:29:49.920989 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.920981    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp" event={"ID":"e20fdc2c-bd2e-4cc1-905e-02b0817703d5","Type":"ContainerDied","Data":"d39ded985bcdf5073b327e50bb87aba235ecea4c186fcb3a9d1ccae0b2292552"}
Sep 10 23:29:49.921500 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.921034    2585 scope.go:117] "RemoveContainer" containerID="0b97f75c8ae6ae927bc8cc8fc33dd76222b5e170772007214fd5a3cabe2d1210"
Sep 10 23:29:49.945994 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.945966    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"]
Sep 10 23:29:49.950276 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:49.950255    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2da572-openshift-default-cc847cb78-ggjvp"]
Sep 10 23:29:50.340998 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:50.340970    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" path="/var/lib/kubelet/pods/e20fdc2c-bd2e-4cc1-905e-02b0817703d5/volumes"
Sep 10 23:29:55.456143 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:55.456107    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m"]
Sep 10 23:29:55.459968 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:55.459942    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-4b268f-8sz8m"]
Sep 10 23:29:56.341501 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:29:56.341468    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bd68878-a06e-4576-9b05-54f9470be03e" path="/var/lib/kubelet/pods/1bd68878-a06e-4576-9b05-54f9470be03e/volumes"
Sep 10 23:30:00.162381 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.162346    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818050-j5lcn"]
Sep 10 23:30:00.162856 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.162722    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerName="istio-proxy"
Sep 10 23:30:00.162856 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.162736    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerName="istio-proxy"
Sep 10 23:30:00.162856 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.162750    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerName="istio-proxy"
Sep 10 23:30:00.162856 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.162756    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerName="istio-proxy"
Sep 10 23:30:00.162856 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.162774    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bd68878-a06e-4576-9b05-54f9470be03e" containerName="revoke-keys"
Sep 10 23:30:00.162856 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.162780    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bd68878-a06e-4576-9b05-54f9470be03e" containerName="revoke-keys"
Sep 10 23:30:00.162856 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.162851    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bd68878-a06e-4576-9b05-54f9470be03e" containerName="revoke-keys"
Sep 10 23:30:00.162856 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.162861    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerName="istio-proxy"
Sep 10 23:30:00.163145 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.162869    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="e20fdc2c-bd2e-4cc1-905e-02b0817703d5" containerName="istio-proxy"
Sep 10 23:30:00.167682 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.167663    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818050-j5lcn"
Sep 10 23:30:00.170844 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.170821    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-79mcz\""
Sep 10 23:30:00.176096 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.176072    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818050-j5lcn"]
Sep 10 23:30:00.179018 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.179000    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818050-j5lcn"
Sep 10 23:30:00.467115 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.467084    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818050-j5lcn"]
Sep 10 23:30:00.987286 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.987195    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818050-j5lcn" event={"ID":"77a11145-a035-4e83-a5a8-ec836ad7294c","Type":"ContainerStarted","Data":"ea690b1c72160284141fba484e8503cac3c4afbaa9f40f72063f8770bd6706dd"}
Sep 10 23:30:00.987286 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:00.987248    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818050-j5lcn" event={"ID":"77a11145-a035-4e83-a5a8-ec836ad7294c","Type":"ContainerStarted","Data":"739d93ac2194b2216f81900c46c4cebcda03639fc52fb0b68e4d4c4f8914ba18"}
Sep 10 23:30:01.017290 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:01.017232    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818050-j5lcn" podStartSLOduration=1.017217315 podStartE2EDuration="1.017217315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:30:01.014143745 +0000 UTC m=+1913.193014708" watchObservedRunningTime="2026-09-10 23:30:01.017217315 +0000 UTC m=+1913.196088277"
Sep 10 23:30:01.995431 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:01.995398    2585 generic.go:356] "Generic (PLEG): container finished" podID="77a11145-a035-4e83-a5a8-ec836ad7294c" containerID="ea690b1c72160284141fba484e8503cac3c4afbaa9f40f72063f8770bd6706dd" exitCode=0
Sep 10 23:30:01.995868 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:01.995490    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818050-j5lcn" event={"ID":"77a11145-a035-4e83-a5a8-ec836ad7294c","Type":"ContainerDied","Data":"ea690b1c72160284141fba484e8503cac3c4afbaa9f40f72063f8770bd6706dd"}
Sep 10 23:30:03.136347 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:03.136324    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818050-j5lcn"
Sep 10 23:30:04.010745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:04.010709    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818050-j5lcn" event={"ID":"77a11145-a035-4e83-a5a8-ec836ad7294c","Type":"ContainerDied","Data":"739d93ac2194b2216f81900c46c4cebcda03639fc52fb0b68e4d4c4f8914ba18"}
Sep 10 23:30:04.010745 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:04.010728    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818050-j5lcn"
Sep 10 23:30:04.011004 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:04.010758    2585 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="739d93ac2194b2216f81900c46c4cebcda03639fc52fb0b68e4d4c4f8914ba18"
Sep 10 23:30:04.408176 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:04.408143    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"]
Sep 10 23:30:04.408660 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:04.408410    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerName="istio-proxy" containerID="cri-o://d92ef8b1f4881e349d124739d936145b42cfc28c207de3b55c9c7526ed2e2f24" gracePeriod=30
Sep 10 23:30:08.782205 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:08.782174    2585 scope.go:117] "RemoveContainer" containerID="888ad235ce1d9893323ef6ba748d249363f79ebd51fb96c753f63abb7780e270"
Sep 10 23:30:08.791001 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:08.790977    2585 scope.go:117] "RemoveContainer" containerID="c38b89d503103242158444836d724b96cf84b78063c2e8afed81874844eed6e9"
Sep 10 23:30:09.679790 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.679730    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:30:09.800204 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800166    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-credential-socket\") pod \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") "
Sep 10 23:30:09.800741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800233    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-podinfo\") pod \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") "
Sep 10 23:30:09.800741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800258    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-workload-socket\") pod \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") "
Sep 10 23:30:09.800741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800288    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istiod-ca-cert\") pod \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") "
Sep 10 23:30:09.800741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800335    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-token\") pod \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") "
Sep 10 23:30:09.800741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800407    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bxsf\" (UniqueName: \"kubernetes.io/projected/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-kube-api-access-6bxsf\") pod \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") "
Sep 10 23:30:09.800741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800439    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-workload-certs\") pod \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") "
Sep 10 23:30:09.800741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800468    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-data\") pod \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") "
Sep 10 23:30:09.800741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800476    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9727a30a-60bc-4e7b-8a6b-92dce685f5c3" (UID: "9727a30a-60bc-4e7b-8a6b-92dce685f5c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:30:09.800741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800518    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9727a30a-60bc-4e7b-8a6b-92dce685f5c3" (UID: "9727a30a-60bc-4e7b-8a6b-92dce685f5c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:30:09.800741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800532    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-envoy\") pod \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\" (UID: \"9727a30a-60bc-4e7b-8a6b-92dce685f5c3\") "
Sep 10 23:30:09.800741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800672    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9727a30a-60bc-4e7b-8a6b-92dce685f5c3" (UID: "9727a30a-60bc-4e7b-8a6b-92dce685f5c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 23:30:09.800741 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800718    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9727a30a-60bc-4e7b-8a6b-92dce685f5c3" (UID: "9727a30a-60bc-4e7b-8a6b-92dce685f5c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:30:09.801387 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800849    2585 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-workload-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:30:09.801387 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800867    2585 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-credential-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:30:09.801387 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800870    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "9727a30a-60bc-4e7b-8a6b-92dce685f5c3" (UID: "9727a30a-60bc-4e7b-8a6b-92dce685f5c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:30:09.801387 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800881    2585 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-workload-socket\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:30:09.801387 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.800915    2585 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istiod-ca-cert\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:30:09.802855 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.802828    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9727a30a-60bc-4e7b-8a6b-92dce685f5c3" (UID: "9727a30a-60bc-4e7b-8a6b-92dce685f5c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 23:30:09.803009 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.802990    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "9727a30a-60bc-4e7b-8a6b-92dce685f5c3" (UID: "9727a30a-60bc-4e7b-8a6b-92dce685f5c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:30:09.803129 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.803106    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9727a30a-60bc-4e7b-8a6b-92dce685f5c3" (UID: "9727a30a-60bc-4e7b-8a6b-92dce685f5c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:30:09.803171 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.803136    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-kube-api-access-6bxsf" (OuterVolumeSpecName: "kube-api-access-6bxsf") pod "9727a30a-60bc-4e7b-8a6b-92dce685f5c3" (UID: "9727a30a-60bc-4e7b-8a6b-92dce685f5c3"). InnerVolumeSpecName "kube-api-access-6bxsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:30:09.902052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.902019    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bxsf\" (UniqueName: \"kubernetes.io/projected/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-kube-api-access-6bxsf\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:30:09.902052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.902047    2585 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-data\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:30:09.902052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.902057    2585 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-envoy\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:30:09.902286 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.902064    2585 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-podinfo\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:30:09.902286 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:09.902073    2585 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9727a30a-60bc-4e7b-8a6b-92dce685f5c3-istio-token\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:30:10.052111 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:10.052072    2585 generic.go:356] "Generic (PLEG): container finished" podID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerID="d92ef8b1f4881e349d124739d936145b42cfc28c207de3b55c9c7526ed2e2f24" exitCode=0
Sep 10 23:30:10.052111 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:10.052117    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" event={"ID":"9727a30a-60bc-4e7b-8a6b-92dce685f5c3","Type":"ContainerDied","Data":"d92ef8b1f4881e349d124739d936145b42cfc28c207de3b55c9c7526ed2e2f24"}
Sep 10 23:30:10.052333 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:10.052128    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"
Sep 10 23:30:10.052333 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:10.052189    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq" event={"ID":"9727a30a-60bc-4e7b-8a6b-92dce685f5c3","Type":"ContainerDied","Data":"1788d3de8764a67b8edc4559e5bdf639e95b6829af22ea4f233a3ff0dc201fc5"}
Sep 10 23:30:10.052333 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:10.052216    2585 scope.go:117] "RemoveContainer" containerID="d92ef8b1f4881e349d124739d936145b42cfc28c207de3b55c9c7526ed2e2f24"
Sep 10 23:30:10.062302 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:10.062279    2585 scope.go:117] "RemoveContainer" containerID="fb7624aa02af4561ff81ba2afc9cd43cd87af09e9e2df5eaf8d680b6b802aa63"
Sep 10 23:30:10.071366 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:10.071311    2585 scope.go:117] "RemoveContainer" containerID="d92ef8b1f4881e349d124739d936145b42cfc28c207de3b55c9c7526ed2e2f24"
Sep 10 23:30:10.071635 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:30:10.071609    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d92ef8b1f4881e349d124739d936145b42cfc28c207de3b55c9c7526ed2e2f24\": container with ID starting with d92ef8b1f4881e349d124739d936145b42cfc28c207de3b55c9c7526ed2e2f24 not found: ID does not exist" containerID="d92ef8b1f4881e349d124739d936145b42cfc28c207de3b55c9c7526ed2e2f24"
Sep 10 23:30:10.071736 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:10.071642    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d92ef8b1f4881e349d124739d936145b42cfc28c207de3b55c9c7526ed2e2f24"} err="failed to get container status \"d92ef8b1f4881e349d124739d936145b42cfc28c207de3b55c9c7526ed2e2f24\": rpc error: code = NotFound desc = could not find container \"d92ef8b1f4881e349d124739d936145b42cfc28c207de3b55c9c7526ed2e2f24\": container with ID starting with d92ef8b1f4881e349d124739d936145b42cfc28c207de3b55c9c7526ed2e2f24 not found: ID does not exist"
Sep 10 23:30:10.071736 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:10.071660    2585 scope.go:117] "RemoveContainer" containerID="fb7624aa02af4561ff81ba2afc9cd43cd87af09e9e2df5eaf8d680b6b802aa63"
Sep 10 23:30:10.071902 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:30:10.071887    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb7624aa02af4561ff81ba2afc9cd43cd87af09e9e2df5eaf8d680b6b802aa63\": container with ID starting with fb7624aa02af4561ff81ba2afc9cd43cd87af09e9e2df5eaf8d680b6b802aa63 not found: ID does not exist" containerID="fb7624aa02af4561ff81ba2afc9cd43cd87af09e9e2df5eaf8d680b6b802aa63"
Sep 10 23:30:10.071949 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:10.071905    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb7624aa02af4561ff81ba2afc9cd43cd87af09e9e2df5eaf8d680b6b802aa63"} err="failed to get container status \"fb7624aa02af4561ff81ba2afc9cd43cd87af09e9e2df5eaf8d680b6b802aa63\": rpc error: code = NotFound desc = could not find container \"fb7624aa02af4561ff81ba2afc9cd43cd87af09e9e2df5eaf8d680b6b802aa63\": container with ID starting with fb7624aa02af4561ff81ba2afc9cd43cd87af09e9e2df5eaf8d680b6b802aa63 not found: ID does not exist"
Sep 10 23:30:10.080740 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:10.080717    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"]
Sep 10 23:30:10.088011 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:10.087989    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-4b268f-openshift-default-6cff4ff76b-bgfrq"]
Sep 10 23:30:10.341337 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:30:10.341260    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" path="/var/lib/kubelet/pods/9727a30a-60bc-4e7b-8a6b-92dce685f5c3/volumes"
Sep 10 23:32:35.345265 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:35.345184    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"]
Sep 10 23:32:35.345872 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:35.345392    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q" podUID="07524aef-a6f2-49f8-a5e0-8251dfdbd5cd" containerName="manager" containerID="cri-o://0d9e73e77edba03a8172b98eba5420a5b3b5c7e393434e3039f4f778346e9fcf" gracePeriod=10
Sep 10 23:32:35.908398 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:35.908304    2585 generic.go:356] "Generic (PLEG): container finished" podID="07524aef-a6f2-49f8-a5e0-8251dfdbd5cd" containerID="0d9e73e77edba03a8172b98eba5420a5b3b5c7e393434e3039f4f778346e9fcf" exitCode=0
Sep 10 23:32:35.908398 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:35.908376    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q" event={"ID":"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd","Type":"ContainerDied","Data":"0d9e73e77edba03a8172b98eba5420a5b3b5c7e393434e3039f4f778346e9fcf"}
Sep 10 23:32:36.202970 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:36.202946    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"
Sep 10 23:32:36.318899 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:36.318863    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v74q\" (UniqueName: \"kubernetes.io/projected/07524aef-a6f2-49f8-a5e0-8251dfdbd5cd-kube-api-access-9v74q\") pod \"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd\" (UID: \"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd\") "
Sep 10 23:32:36.319086 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:36.318912    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07524aef-a6f2-49f8-a5e0-8251dfdbd5cd-extensions-socket-volume\") pod \"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd\" (UID: \"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd\") "
Sep 10 23:32:36.319317 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:36.319295    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07524aef-a6f2-49f8-a5e0-8251dfdbd5cd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "07524aef-a6f2-49f8-a5e0-8251dfdbd5cd" (UID: "07524aef-a6f2-49f8-a5e0-8251dfdbd5cd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:32:36.321261 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:36.321237    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07524aef-a6f2-49f8-a5e0-8251dfdbd5cd-kube-api-access-9v74q" (OuterVolumeSpecName: "kube-api-access-9v74q") pod "07524aef-a6f2-49f8-a5e0-8251dfdbd5cd" (UID: "07524aef-a6f2-49f8-a5e0-8251dfdbd5cd"). InnerVolumeSpecName "kube-api-access-9v74q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:32:36.420084 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:36.420045    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v74q\" (UniqueName: \"kubernetes.io/projected/07524aef-a6f2-49f8-a5e0-8251dfdbd5cd-kube-api-access-9v74q\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:32:36.420084 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:36.420076    2585 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/07524aef-a6f2-49f8-a5e0-8251dfdbd5cd-extensions-socket-volume\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:32:36.915252 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:36.915222    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"
Sep 10 23:32:36.915456 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:36.915222    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q" event={"ID":"07524aef-a6f2-49f8-a5e0-8251dfdbd5cd","Type":"ContainerDied","Data":"385ca8d91333ecdca19cc584cfce178a4a64b2e4a06cee6f4a5318f5faf2671d"}
Sep 10 23:32:36.915456 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:36.915370    2585 scope.go:117] "RemoveContainer" containerID="0d9e73e77edba03a8172b98eba5420a5b3b5c7e393434e3039f4f778346e9fcf"
Sep 10 23:32:36.934402 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:36.934379    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"]
Sep 10 23:32:36.938083 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:36.938061    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-5jf4q"]
Sep 10 23:32:38.342310 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:32:38.342275    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07524aef-a6f2-49f8-a5e0-8251dfdbd5cd" path="/var/lib/kubelet/pods/07524aef-a6f2-49f8-a5e0-8251dfdbd5cd/volumes"
Sep 10 23:33:08.511832 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:08.511799    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:33:08.519334 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:08.519307    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:33:08.525333 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:08.525313    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:33:08.532282 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:08.532261    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-48wjr_d0caf2e2-7da3-4afa-9086-8c4e6f351c39/ovn-acl-logging/0.log"
Sep 10 23:33:36.031859 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.031825    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx"]
Sep 10 23:33:36.032247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.032185    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerName="istio-proxy"
Sep 10 23:33:36.032247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.032197    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerName="istio-proxy"
Sep 10 23:33:36.032247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.032206    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07524aef-a6f2-49f8-a5e0-8251dfdbd5cd" containerName="manager"
Sep 10 23:33:36.032247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.032212    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="07524aef-a6f2-49f8-a5e0-8251dfdbd5cd" containerName="manager"
Sep 10 23:33:36.032247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.032220    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77a11145-a035-4e83-a5a8-ec836ad7294c" containerName="cleanup"
Sep 10 23:33:36.032247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.032225    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="77a11145-a035-4e83-a5a8-ec836ad7294c" containerName="cleanup"
Sep 10 23:33:36.032247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.032234    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerName="istio-proxy"
Sep 10 23:33:36.032247 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.032239    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerName="istio-proxy"
Sep 10 23:33:36.032506 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.032296    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerName="istio-proxy"
Sep 10 23:33:36.032506 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.032305    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="07524aef-a6f2-49f8-a5e0-8251dfdbd5cd" containerName="manager"
Sep 10 23:33:36.032506 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.032311    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="9727a30a-60bc-4e7b-8a6b-92dce685f5c3" containerName="istio-proxy"
Sep 10 23:33:36.032506 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.032316    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="77a11145-a035-4e83-a5a8-ec836ad7294c" containerName="cleanup"
Sep 10 23:33:36.035265 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.035249    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx"
Sep 10 23:33:36.037515 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.037497    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-264xh\""
Sep 10 23:33:36.050151 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.050129    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx"]
Sep 10 23:33:36.152205 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.152162    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5166b5f-3bd6-490f-a357-e3f79cff2f5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qmzcx\" (UID: \"e5166b5f-3bd6-490f-a357-e3f79cff2f5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx"
Sep 10 23:33:36.152205 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.152207    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdsmg\" (UniqueName: \"kubernetes.io/projected/e5166b5f-3bd6-490f-a357-e3f79cff2f5a-kube-api-access-sdsmg\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qmzcx\" (UID: \"e5166b5f-3bd6-490f-a357-e3f79cff2f5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx"
Sep 10 23:33:36.253243 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.253213    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5166b5f-3bd6-490f-a357-e3f79cff2f5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qmzcx\" (UID: \"e5166b5f-3bd6-490f-a357-e3f79cff2f5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx"
Sep 10 23:33:36.253243 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.253250    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdsmg\" (UniqueName: \"kubernetes.io/projected/e5166b5f-3bd6-490f-a357-e3f79cff2f5a-kube-api-access-sdsmg\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qmzcx\" (UID: \"e5166b5f-3bd6-490f-a357-e3f79cff2f5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx"
Sep 10 23:33:36.253706 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.253684    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5166b5f-3bd6-490f-a357-e3f79cff2f5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qmzcx\" (UID: \"e5166b5f-3bd6-490f-a357-e3f79cff2f5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx"
Sep 10 23:33:36.263890 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.263860    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdsmg\" (UniqueName: \"kubernetes.io/projected/e5166b5f-3bd6-490f-a357-e3f79cff2f5a-kube-api-access-sdsmg\") pod \"kuadrant-operator-controller-manager-5769f99d9f-qmzcx\" (UID: \"e5166b5f-3bd6-490f-a357-e3f79cff2f5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx"
Sep 10 23:33:36.345471 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.345440    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx"
Sep 10 23:33:36.622154 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:36.622129    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx"]
Sep 10 23:33:36.624156 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:33:36.624128    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5166b5f_3bd6_490f_a357_e3f79cff2f5a.slice/crio-cf2c76fc7e07016d0cba877794462d9597e973d8501fe8799de6a46400d70d17 WatchSource:0}: Error finding container cf2c76fc7e07016d0cba877794462d9597e973d8501fe8799de6a46400d70d17: Status 404 returned error can't find the container with id cf2c76fc7e07016d0cba877794462d9597e973d8501fe8799de6a46400d70d17
Sep 10 23:33:37.256166 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:37.256128    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx" event={"ID":"e5166b5f-3bd6-490f-a357-e3f79cff2f5a","Type":"ContainerStarted","Data":"748caec13843d81e7e538332fc62ae539930bd5dd6e4b3874e9927463a185100"}
Sep 10 23:33:37.256551 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:37.256214    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx" event={"ID":"e5166b5f-3bd6-490f-a357-e3f79cff2f5a","Type":"ContainerStarted","Data":"cf2c76fc7e07016d0cba877794462d9597e973d8501fe8799de6a46400d70d17"}
Sep 10 23:33:37.256551 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:37.256326    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx"
Sep 10 23:33:37.282600 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:37.282533    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx" podStartSLOduration=1.282517344 podStartE2EDuration="1.282517344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:33:37.280360778 +0000 UTC m=+2129.459231742" watchObservedRunningTime="2026-09-10 23:33:37.282517344 +0000 UTC m=+2129.461388307"
Sep 10 23:33:48.264255 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:33:48.264222    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-qmzcx"
Sep 10 23:34:08.872320 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:08.872245    2585 scope.go:117] "RemoveContainer" containerID="e840c54e5e53f2334442807dfea0fe568ea940beafc21ef06fa6f3f51d40a2e0"
Sep 10 23:34:08.883811 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:08.883785    2585 scope.go:117] "RemoveContainer" containerID="edb1901fae8293cf7a4a8f6f9b9fd771ba69782cf53d64c16b2a760d3c6975d9"
Sep 10 23:34:22.153164 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.153127    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"]
Sep 10 23:34:22.156604 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.156581    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.159895 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.159866    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 23:34:22.160037 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.159920    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-85z7r\""
Sep 10 23:34:22.160037 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.160014    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-0f5618a7-kserve-self-signed-certs\""
Sep 10 23:34:22.160160 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.160142    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 23:34:22.167391 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.167363    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"]
Sep 10 23:34:22.276982 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.276933    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-dshm\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.276982 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.276986    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs4kw\" (UniqueName: \"kubernetes.io/projected/2e28309e-a8b0-4320-b739-4ac9c9627291-kube-api-access-gs4kw\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.277252 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.277054    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e28309e-a8b0-4320-b739-4ac9c9627291-tls-certs\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.277252 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.277089    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-model-cache\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.277252 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.277160    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-tmp-dir\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.277252 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.277203    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-home\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.377950 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.377905    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-tmp-dir\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.378157 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.377968    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-home\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.378157 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.378024    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-dshm\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.378157 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.378053    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs4kw\" (UniqueName: \"kubernetes.io/projected/2e28309e-a8b0-4320-b739-4ac9c9627291-kube-api-access-gs4kw\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.378157 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.378093    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e28309e-a8b0-4320-b739-4ac9c9627291-tls-certs\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.378157 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.378120    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-model-cache\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.378435 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.378339    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-tmp-dir\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.378435 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.378393    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-home\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.378550 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.378513    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-model-cache\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.380332 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.380311    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-dshm\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.380514 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.380497    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e28309e-a8b0-4320-b739-4ac9c9627291-tls-certs\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.386584 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.386547    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs4kw\" (UniqueName: \"kubernetes.io/projected/2e28309e-a8b0-4320-b739-4ac9c9627291-kube-api-access-gs4kw\") pod \"e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") " pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.468716 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.468628    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:22.748576 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:22.748527    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"]
Sep 10 23:34:22.750413 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:34:22.750386    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e28309e_a8b0_4320_b739_4ac9c9627291.slice/crio-862dd41180fc58860fdbf4fdd5c6266a1c1808be6a49332e53cb62dad53c5239 WatchSource:0}: Error finding container 862dd41180fc58860fdbf4fdd5c6266a1c1808be6a49332e53cb62dad53c5239: Status 404 returned error can't find the container with id 862dd41180fc58860fdbf4fdd5c6266a1c1808be6a49332e53cb62dad53c5239
Sep 10 23:34:23.523028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:23.522991    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp" event={"ID":"2e28309e-a8b0-4320-b739-4ac9c9627291","Type":"ContainerStarted","Data":"0672ac5c397f1ba371463fc8926e4edff62318a33b0d3f2f749b6e6ff7701434"}
Sep 10 23:34:23.523028 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:23.523033    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp" event={"ID":"2e28309e-a8b0-4320-b739-4ac9c9627291","Type":"ContainerStarted","Data":"862dd41180fc58860fdbf4fdd5c6266a1c1808be6a49332e53cb62dad53c5239"}
Sep 10 23:34:23.540162 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:23.540085    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp" podStartSLOduration=1.5400696059999999 podStartE2EDuration="1.540069606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:23.538821749 +0000 UTC m=+2175.717692707" watchObservedRunningTime="2026-09-10 23:34:23.540069606 +0000 UTC m=+2175.718940568"
Sep 10 23:34:32.469684 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:32.469648    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:32.470071 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:32.469703    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:32.482693 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:32.482666    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:32.583822 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:32.583797    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:34:44.453277 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.453236    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"]
Sep 10 23:34:44.456860 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.456837    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.459037 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.459002    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-0f5618a7-kserve-self-signed-certs\""
Sep 10 23:34:44.469116 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.469092    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"]
Sep 10 23:34:44.483431 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.483399    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-dshm\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.483572 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.483480    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-home\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.483572 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.483513    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-model-cache\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.483572 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.483548    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbgq4\" (UniqueName: \"kubernetes.io/projected/79c0a76b-4530-4c3f-b680-e838c899a71e-kube-api-access-wbgq4\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.483691 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.483642    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-tmp-dir\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.483691 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.483680    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79c0a76b-4530-4c3f-b680-e838c899a71e-tls-certs\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.584421 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.584386    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-tmp-dir\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.584421 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.584424    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79c0a76b-4530-4c3f-b680-e838c899a71e-tls-certs\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.584697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.584462    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-dshm\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.584697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.584507    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-home\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.584697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.584523    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-model-cache\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.584869 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.584835    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbgq4\" (UniqueName: \"kubernetes.io/projected/79c0a76b-4530-4c3f-b680-e838c899a71e-kube-api-access-wbgq4\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.584974 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.584942    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-home\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.584974 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.584965    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-tmp-dir\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.585161 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.584998    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-model-cache\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.586809 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.586785    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-dshm\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.587054 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.587037    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79c0a76b-4530-4c3f-b680-e838c899a71e-tls-certs\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.596689 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.596666    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbgq4\" (UniqueName: \"kubernetes.io/projected/79c0a76b-4530-4c3f-b680-e838c899a71e-kube-api-access-wbgq4\") pod \"e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") " pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:44.766776 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:44.766682    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:45.042830 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:45.041000    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"]
Sep 10 23:34:45.042906 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:34:45.042844    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79c0a76b_4530_4c3f_b680_e838c899a71e.slice/crio-a43812face390a261ee0c93d6ebdca0da2fcb49de522f01ef99795141fd9cd30 WatchSource:0}: Error finding container a43812face390a261ee0c93d6ebdca0da2fcb49de522f01ef99795141fd9cd30: Status 404 returned error can't find the container with id a43812face390a261ee0c93d6ebdca0da2fcb49de522f01ef99795141fd9cd30
Sep 10 23:34:45.646819 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:45.646779    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w" event={"ID":"79c0a76b-4530-4c3f-b680-e838c899a71e","Type":"ContainerStarted","Data":"2499cbf17c1e6fe6ca6ce5c54ea37643b29127d7f55eada0b13a897d5fb754fd"}
Sep 10 23:34:45.646819 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:45.646823    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w" event={"ID":"79c0a76b-4530-4c3f-b680-e838c899a71e","Type":"ContainerStarted","Data":"a43812face390a261ee0c93d6ebdca0da2fcb49de522f01ef99795141fd9cd30"}
Sep 10 23:34:45.663998 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:45.663924    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w" podStartSLOduration=1.663909876 podStartE2EDuration="1.663909876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:34:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:34:45.662620319 +0000 UTC m=+2197.841491281" watchObservedRunningTime="2026-09-10 23:34:45.663909876 +0000 UTC m=+2197.842780839"
Sep 10 23:34:54.767677 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:54.767633    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:54.767677 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:54.767689    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:54.780334 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:54.780306    2585 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:34:55.716022 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:34:55.715984    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:35:20.021915 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:20.021877    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"]
Sep 10 23:35:20.760511 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:20.760479    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"]
Sep 10 23:35:35.041823 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.041720    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp" podUID="2e28309e-a8b0-4320-b739-4ac9c9627291" containerName="main" containerID="cri-o://0672ac5c397f1ba371463fc8926e4edff62318a33b0d3f2f749b6e6ff7701434" gracePeriod=45
Sep 10 23:35:35.292397 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.292335    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:35:35.357120 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.357084    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gs4kw\" (UniqueName: \"kubernetes.io/projected/2e28309e-a8b0-4320-b739-4ac9c9627291-kube-api-access-gs4kw\") pod \"2e28309e-a8b0-4320-b739-4ac9c9627291\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") "
Sep 10 23:35:35.357319 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.357147    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e28309e-a8b0-4320-b739-4ac9c9627291-tls-certs\") pod \"2e28309e-a8b0-4320-b739-4ac9c9627291\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") "
Sep 10 23:35:35.357319 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.357188    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-dshm\") pod \"2e28309e-a8b0-4320-b739-4ac9c9627291\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") "
Sep 10 23:35:35.357319 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.357221    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-tmp-dir\") pod \"2e28309e-a8b0-4320-b739-4ac9c9627291\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") "
Sep 10 23:35:35.357319 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.357293    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-model-cache\") pod \"2e28309e-a8b0-4320-b739-4ac9c9627291\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") "
Sep 10 23:35:35.357538 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.357356    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-home\") pod \"2e28309e-a8b0-4320-b739-4ac9c9627291\" (UID: \"2e28309e-a8b0-4320-b739-4ac9c9627291\") "
Sep 10 23:35:35.357620 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.357529    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2e28309e-a8b0-4320-b739-4ac9c9627291" (UID: "2e28309e-a8b0-4320-b739-4ac9c9627291"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:35:35.357680 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.357640    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-model-cache" (OuterVolumeSpecName: "model-cache") pod "2e28309e-a8b0-4320-b739-4ac9c9627291" (UID: "2e28309e-a8b0-4320-b739-4ac9c9627291"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:35:35.357742 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.357682    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-tmp-dir\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:35:35.357786 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.357730    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-home" (OuterVolumeSpecName: "home") pod "2e28309e-a8b0-4320-b739-4ac9c9627291" (UID: "2e28309e-a8b0-4320-b739-4ac9c9627291"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:35:35.359534 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.359505    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e28309e-a8b0-4320-b739-4ac9c9627291-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2e28309e-a8b0-4320-b739-4ac9c9627291" (UID: "2e28309e-a8b0-4320-b739-4ac9c9627291"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:35.359534 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.359508    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-dshm" (OuterVolumeSpecName: "dshm") pod "2e28309e-a8b0-4320-b739-4ac9c9627291" (UID: "2e28309e-a8b0-4320-b739-4ac9c9627291"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:35:35.359700 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.359589    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e28309e-a8b0-4320-b739-4ac9c9627291-kube-api-access-gs4kw" (OuterVolumeSpecName: "kube-api-access-gs4kw") pod "2e28309e-a8b0-4320-b739-4ac9c9627291" (UID: "2e28309e-a8b0-4320-b739-4ac9c9627291"). InnerVolumeSpecName "kube-api-access-gs4kw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:35:35.458990 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.458951    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-model-cache\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:35:35.458990 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.458979    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-home\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:35:35.458990 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.458989    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs4kw\" (UniqueName: \"kubernetes.io/projected/2e28309e-a8b0-4320-b739-4ac9c9627291-kube-api-access-gs4kw\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:35:35.459300 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.459066    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2e28309e-a8b0-4320-b739-4ac9c9627291-tls-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:35:35.459300 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.459075    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2e28309e-a8b0-4320-b739-4ac9c9627291-dshm\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:35:35.780052 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.779936    2585 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w" podUID="79c0a76b-4530-4c3f-b680-e838c899a71e" containerName="main" containerID="cri-o://2499cbf17c1e6fe6ca6ce5c54ea37643b29127d7f55eada0b13a897d5fb754fd" gracePeriod=45
Sep 10 23:35:35.939231 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.939196    2585 generic.go:356] "Generic (PLEG): container finished" podID="79c0a76b-4530-4c3f-b680-e838c899a71e" containerID="2499cbf17c1e6fe6ca6ce5c54ea37643b29127d7f55eada0b13a897d5fb754fd" exitCode=0
Sep 10 23:35:35.939421 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.939275    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w" event={"ID":"79c0a76b-4530-4c3f-b680-e838c899a71e","Type":"ContainerDied","Data":"2499cbf17c1e6fe6ca6ce5c54ea37643b29127d7f55eada0b13a897d5fb754fd"}
Sep 10 23:35:35.940744 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.940717    2585 generic.go:356] "Generic (PLEG): container finished" podID="2e28309e-a8b0-4320-b739-4ac9c9627291" containerID="0672ac5c397f1ba371463fc8926e4edff62318a33b0d3f2f749b6e6ff7701434" exitCode=0
Sep 10 23:35:35.940864 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.940761    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"
Sep 10 23:35:35.940864 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.940830    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp" event={"ID":"2e28309e-a8b0-4320-b739-4ac9c9627291","Type":"ContainerDied","Data":"0672ac5c397f1ba371463fc8926e4edff62318a33b0d3f2f749b6e6ff7701434"}
Sep 10 23:35:35.940864 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.940855    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp" event={"ID":"2e28309e-a8b0-4320-b739-4ac9c9627291","Type":"ContainerDied","Data":"862dd41180fc58860fdbf4fdd5c6266a1c1808be6a49332e53cb62dad53c5239"}
Sep 10 23:35:35.941005 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.940872    2585 scope.go:117] "RemoveContainer" containerID="0672ac5c397f1ba371463fc8926e4edff62318a33b0d3f2f749b6e6ff7701434"
Sep 10 23:35:35.950827 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.950806    2585 scope.go:117] "RemoveContainer" containerID="0672ac5c397f1ba371463fc8926e4edff62318a33b0d3f2f749b6e6ff7701434"
Sep 10 23:35:35.951122 ip-10-0-138-139 kubenswrapper[2585]: E0910 23:35:35.951102    2585 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0672ac5c397f1ba371463fc8926e4edff62318a33b0d3f2f749b6e6ff7701434\": container with ID starting with 0672ac5c397f1ba371463fc8926e4edff62318a33b0d3f2f749b6e6ff7701434 not found: ID does not exist" containerID="0672ac5c397f1ba371463fc8926e4edff62318a33b0d3f2f749b6e6ff7701434"
Sep 10 23:35:35.951200 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.951134    2585 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0672ac5c397f1ba371463fc8926e4edff62318a33b0d3f2f749b6e6ff7701434"} err="failed to get container status \"0672ac5c397f1ba371463fc8926e4edff62318a33b0d3f2f749b6e6ff7701434\": rpc error: code = NotFound desc = could not find container \"0672ac5c397f1ba371463fc8926e4edff62318a33b0d3f2f749b6e6ff7701434\": container with ID starting with 0672ac5c397f1ba371463fc8926e4edff62318a33b0d3f2f749b6e6ff7701434 not found: ID does not exist"
Sep 10 23:35:35.966234 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.966203    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"]
Sep 10 23:35:35.970148 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:35.970116    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-0f5618a7-kserve-6967796d59-bwwcp"]
Sep 10 23:35:36.017867 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.017840    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:35:36.065781 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.065754    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-home\") pod \"79c0a76b-4530-4c3f-b680-e838c899a71e\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") "
Sep 10 23:35:36.066141 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.065798    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-model-cache\") pod \"79c0a76b-4530-4c3f-b680-e838c899a71e\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") "
Sep 10 23:35:36.066141 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.065877    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79c0a76b-4530-4c3f-b680-e838c899a71e-tls-certs\") pod \"79c0a76b-4530-4c3f-b680-e838c899a71e\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") "
Sep 10 23:35:36.066141 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.065904    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbgq4\" (UniqueName: \"kubernetes.io/projected/79c0a76b-4530-4c3f-b680-e838c899a71e-kube-api-access-wbgq4\") pod \"79c0a76b-4530-4c3f-b680-e838c899a71e\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") "
Sep 10 23:35:36.066141 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.065932    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-dshm\") pod \"79c0a76b-4530-4c3f-b680-e838c899a71e\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") "
Sep 10 23:35:36.066141 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.065958    2585 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-tmp-dir\") pod \"79c0a76b-4530-4c3f-b680-e838c899a71e\" (UID: \"79c0a76b-4530-4c3f-b680-e838c899a71e\") "
Sep 10 23:35:36.066141 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.066049    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-home" (OuterVolumeSpecName: "home") pod "79c0a76b-4530-4c3f-b680-e838c899a71e" (UID: "79c0a76b-4530-4c3f-b680-e838c899a71e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:35:36.066141 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.066060    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-model-cache" (OuterVolumeSpecName: "model-cache") pod "79c0a76b-4530-4c3f-b680-e838c899a71e" (UID: "79c0a76b-4530-4c3f-b680-e838c899a71e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:35:36.066516 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.066199    2585 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-home\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:35:36.066516 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.066214    2585 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-model-cache\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:35:36.066516 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.066288    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "79c0a76b-4530-4c3f-b680-e838c899a71e" (UID: "79c0a76b-4530-4c3f-b680-e838c899a71e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:35:36.068244 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.068220    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-dshm" (OuterVolumeSpecName: "dshm") pod "79c0a76b-4530-4c3f-b680-e838c899a71e" (UID: "79c0a76b-4530-4c3f-b680-e838c899a71e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 23:35:36.068355 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.068302    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79c0a76b-4530-4c3f-b680-e838c899a71e-kube-api-access-wbgq4" (OuterVolumeSpecName: "kube-api-access-wbgq4") pod "79c0a76b-4530-4c3f-b680-e838c899a71e" (UID: "79c0a76b-4530-4c3f-b680-e838c899a71e"). InnerVolumeSpecName "kube-api-access-wbgq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 23:35:36.068355 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.068306    2585 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79c0a76b-4530-4c3f-b680-e838c899a71e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "79c0a76b-4530-4c3f-b680-e838c899a71e" (UID: "79c0a76b-4530-4c3f-b680-e838c899a71e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 23:35:36.167345 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.167317    2585 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/79c0a76b-4530-4c3f-b680-e838c899a71e-tls-certs\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:35:36.167345 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.167342    2585 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbgq4\" (UniqueName: \"kubernetes.io/projected/79c0a76b-4530-4c3f-b680-e838c899a71e-kube-api-access-wbgq4\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:35:36.167345 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.167351    2585 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-dshm\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:35:36.167607 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.167361    2585 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/79c0a76b-4530-4c3f-b680-e838c899a71e-tmp-dir\") on node \"ip-10-0-138-139.ec2.internal\" DevicePath \"\""
Sep 10 23:35:36.342076 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.341999    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e28309e-a8b0-4320-b739-4ac9c9627291" path="/var/lib/kubelet/pods/2e28309e-a8b0-4320-b739-4ac9c9627291/volumes"
Sep 10 23:35:36.948060 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.948025    2585 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"
Sep 10 23:35:36.948255 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.948062    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w" event={"ID":"79c0a76b-4530-4c3f-b680-e838c899a71e","Type":"ContainerDied","Data":"a43812face390a261ee0c93d6ebdca0da2fcb49de522f01ef99795141fd9cd30"}
Sep 10 23:35:36.948255 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.948110    2585 scope.go:117] "RemoveContainer" containerID="2499cbf17c1e6fe6ca6ce5c54ea37643b29127d7f55eada0b13a897d5fb754fd"
Sep 10 23:35:36.964679 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.964652    2585 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"]
Sep 10 23:35:36.968817 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:36.968786    2585 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-0f5618a7-kserve-8d649dc7f-nnq9w"]
Sep 10 23:35:38.346754 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:35:38.344013    2585 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79c0a76b-4530-4c3f-b680-e838c899a71e" path="/var/lib/kubelet/pods/79c0a76b-4530-4c3f-b680-e838c899a71e/volumes"
Sep 10 23:36:08.918405 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:08.918372    2585 scope.go:117] "RemoveContainer" containerID="1b5187cd164be857e49a60bd14e4f24353d8c5bcb7323ca75ee927a300066816"
Sep 10 23:36:08.927315 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:08.927292    2585 scope.go:117] "RemoveContainer" containerID="1133c80d2d9e9ca9416a705943456f7f2dd8533d136ef7db866cb2479955bc7e"
Sep 10 23:36:16.879886 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:16.879855    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-n64zt_ba2bbdc1-7755-4055-becf-aa8567d0af73/manager/0.log"
Sep 10 23:36:17.223968 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:17.223880    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bl6kg_0be5071d-f955-441b-8b3e-c5855bdc69e7/manager/0.log"
Sep 10 23:36:17.572556 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:17.572528    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7_326dd1a2-19d6-4c64-93c2-b823e685521d/copy-manifests/0.log"
Sep 10 23:36:17.579690 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:17.579669    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7_326dd1a2-19d6-4c64-93c2-b823e685521d/manager/0.log"
Sep 10 23:36:18.131957 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:18.131929    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818035-djws8_b38eff99-82e9-460f-ab21-e75623b52921/cleanup/0.log"
Sep 10 23:36:18.237367 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:18.237334    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818050-j5lcn_77a11145-a035-4e83-a5a8-ec836ad7294c/cleanup/0.log"
Sep 10 23:36:19.436584 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:19.436532    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-g6dgk_3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e/kuadrant-console-plugin/0.log"
Sep 10 23:36:19.554336 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:19.554303    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-qmzcx_e5166b5f-3bd6-490f-a357-e3f79cff2f5a/manager/0.log"
Sep 10 23:36:20.141462 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:20.141430    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr_d13acf5c-3a29-4bae-bb41-222232226508/istio-proxy/0.log"
Sep 10 23:36:20.615111 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:20.615079    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9ks5r_f38eef04-b82b-4f71-94c2-5f768febbfb7/istio-proxy/1.log"
Sep 10 23:36:20.857078 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:20.857048    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pdlcg_3faa5574-b510-4949-b387-cc6607c9b0ac/payload-processing/0.log"
Sep 10 23:36:20.977900 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:20.977820    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dbbc657dd-v7w6k_88dce041-58b1-456d-94ad-ac2f44a11c07/router/0.log"
Sep 10 23:36:26.918112 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:26.918080    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r674h/must-gather-cn4fs"]
Sep 10 23:36:26.918866 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:26.918425    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79c0a76b-4530-4c3f-b680-e838c899a71e" containerName="main"
Sep 10 23:36:26.918866 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:26.918438    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="79c0a76b-4530-4c3f-b680-e838c899a71e" containerName="main"
Sep 10 23:36:26.918866 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:26.918446    2585 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e28309e-a8b0-4320-b739-4ac9c9627291" containerName="main"
Sep 10 23:36:26.918866 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:26.918451    2585 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e28309e-a8b0-4320-b739-4ac9c9627291" containerName="main"
Sep 10 23:36:26.918866 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:26.918511    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e28309e-a8b0-4320-b739-4ac9c9627291" containerName="main"
Sep 10 23:36:26.918866 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:26.918519    2585 memory_manager.go:368] "RemoveStaleState removing state" podUID="79c0a76b-4530-4c3f-b680-e838c899a71e" containerName="main"
Sep 10 23:36:26.921814 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:26.921794    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r674h/must-gather-cn4fs"
Sep 10 23:36:26.923850 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:26.923799    2585 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r674h\"/\"default-dockercfg-2cv5k\""
Sep 10 23:36:26.923985 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:26.923887    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r674h\"/\"openshift-service-ca.crt\""
Sep 10 23:36:26.924053 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:26.924019    2585 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r674h\"/\"kube-root-ca.crt\""
Sep 10 23:36:26.931717 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:26.931683    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r674h/must-gather-cn4fs"]
Sep 10 23:36:27.023982 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:27.023941    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3c6f8651-ef29-43a5-8c75-1dba58fcd15d-must-gather-output\") pod \"must-gather-cn4fs\" (UID: \"3c6f8651-ef29-43a5-8c75-1dba58fcd15d\") " pod="openshift-must-gather-r674h/must-gather-cn4fs"
Sep 10 23:36:27.024178 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:27.024070    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hdrj\" (UniqueName: \"kubernetes.io/projected/3c6f8651-ef29-43a5-8c75-1dba58fcd15d-kube-api-access-6hdrj\") pod \"must-gather-cn4fs\" (UID: \"3c6f8651-ef29-43a5-8c75-1dba58fcd15d\") " pod="openshift-must-gather-r674h/must-gather-cn4fs"
Sep 10 23:36:27.124516 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:27.124477    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hdrj\" (UniqueName: \"kubernetes.io/projected/3c6f8651-ef29-43a5-8c75-1dba58fcd15d-kube-api-access-6hdrj\") pod \"must-gather-cn4fs\" (UID: \"3c6f8651-ef29-43a5-8c75-1dba58fcd15d\") " pod="openshift-must-gather-r674h/must-gather-cn4fs"
Sep 10 23:36:27.124717 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:27.124528    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3c6f8651-ef29-43a5-8c75-1dba58fcd15d-must-gather-output\") pod \"must-gather-cn4fs\" (UID: \"3c6f8651-ef29-43a5-8c75-1dba58fcd15d\") " pod="openshift-must-gather-r674h/must-gather-cn4fs"
Sep 10 23:36:27.124861 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:27.124845    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3c6f8651-ef29-43a5-8c75-1dba58fcd15d-must-gather-output\") pod \"must-gather-cn4fs\" (UID: \"3c6f8651-ef29-43a5-8c75-1dba58fcd15d\") " pod="openshift-must-gather-r674h/must-gather-cn4fs"
Sep 10 23:36:27.133064 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:27.133041    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hdrj\" (UniqueName: \"kubernetes.io/projected/3c6f8651-ef29-43a5-8c75-1dba58fcd15d-kube-api-access-6hdrj\") pod \"must-gather-cn4fs\" (UID: \"3c6f8651-ef29-43a5-8c75-1dba58fcd15d\") " pod="openshift-must-gather-r674h/must-gather-cn4fs"
Sep 10 23:36:27.232085 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:27.231979    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r674h/must-gather-cn4fs"
Sep 10 23:36:27.506903 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:27.506871    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r674h/must-gather-cn4fs"]
Sep 10 23:36:27.508425 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:36:27.508403    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c6f8651_ef29_43a5_8c75_1dba58fcd15d.slice/crio-e3f8161ce293c0ab10f49a730f5e9b42141b7b471cb3275b2c111d9e54600f25 WatchSource:0}: Error finding container e3f8161ce293c0ab10f49a730f5e9b42141b7b471cb3275b2c111d9e54600f25: Status 404 returned error can't find the container with id e3f8161ce293c0ab10f49a730f5e9b42141b7b471cb3275b2c111d9e54600f25
Sep 10 23:36:27.510816 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:27.510798    2585 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 23:36:28.240862 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:28.240825    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r674h/must-gather-cn4fs" event={"ID":"3c6f8651-ef29-43a5-8c75-1dba58fcd15d","Type":"ContainerStarted","Data":"e3f8161ce293c0ab10f49a730f5e9b42141b7b471cb3275b2c111d9e54600f25"}
Sep 10 23:36:29.248958 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:29.248911    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r674h/must-gather-cn4fs" event={"ID":"3c6f8651-ef29-43a5-8c75-1dba58fcd15d","Type":"ContainerStarted","Data":"f3ffed2857b612c8b6eae387c8da03f772b08d16b5470ea4bd0d53556d32ee3e"}
Sep 10 23:36:29.249436 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:29.248975    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r674h/must-gather-cn4fs" event={"ID":"3c6f8651-ef29-43a5-8c75-1dba58fcd15d","Type":"ContainerStarted","Data":"e80eaa8c9d69fc7d24bb0a5c6e71fa373503b4c339c7ab109a0002290e551f57"}
Sep 10 23:36:29.271945 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:29.271876    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r674h/must-gather-cn4fs" podStartSLOduration=2.189679694 podStartE2EDuration="3.271854562s" totalImagesPullingTime="1.082174868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 23:36:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:29.270265194 +0000 UTC m=+2301.449136158" watchObservedRunningTime="2026-09-10 23:36:29.271854562 +0000 UTC m=+2301.450725526"
Sep 10 23:36:30.195526 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:30.195485    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4466q_06db9d0f-e643-4348-9df1-b54c26f693f3/global-pull-secret-syncer/0.log"
Sep 10 23:36:30.382728 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:30.382691    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w6hsh_51782331-1214-4d02-bab5-14943abb3cc9/konnectivity-agent/0.log"
Sep 10 23:36:30.440603 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:30.440574    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-139.ec2.internal_22eaeaa462a93868d0fc1004d0e57ae7/haproxy/0.log"
Sep 10 23:36:35.066815 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:35.066777    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-g6dgk_3366cc4a-ebf8-4f94-bc7d-fadf25a78d4e/kuadrant-console-plugin/0.log"
Sep 10 23:36:35.114494 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:35.114451    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-qmzcx_e5166b5f-3bd6-490f-a357-e3f79cff2f5a/manager/0.log"
Sep 10 23:36:37.108604 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:37.108549    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-k6gll_8649af02-d941-4210-89d8-5d5d6298af5d/kube-state-metrics/0.log"
Sep 10 23:36:37.138221 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:37.138155    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-k6gll_8649af02-d941-4210-89d8-5d5d6298af5d/kube-rbac-proxy-main/0.log"
Sep 10 23:36:37.163108 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:37.163066    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-k6gll_8649af02-d941-4210-89d8-5d5d6298af5d/kube-rbac-proxy-self/0.log"
Sep 10 23:36:37.258992 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:37.258948    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gjk9_48625286-6991-426a-bed9-47f7d187b6fe/node-exporter/0.log"
Sep 10 23:36:37.281867 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:37.281804    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gjk9_48625286-6991-426a-bed9-47f7d187b6fe/kube-rbac-proxy/0.log"
Sep 10 23:36:37.309539 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:37.309515    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7gjk9_48625286-6991-426a-bed9-47f7d187b6fe/init-textfile/0.log"
Sep 10 23:36:37.500276 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:37.500134    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-sgqpk_722999e9-86ba-4545-880d-dbd28eed011f/kube-rbac-proxy-main/0.log"
Sep 10 23:36:37.529865 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:37.529838    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-sgqpk_722999e9-86ba-4545-880d-dbd28eed011f/kube-rbac-proxy-self/0.log"
Sep 10 23:36:37.558914 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:37.557526    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-sgqpk_722999e9-86ba-4545-880d-dbd28eed011f/openshift-state-metrics/0.log"
Sep 10 23:36:37.857824 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:37.857787    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-t64mb_b83a5035-8413-4717-85c4-a311d5d35588/prometheus-operator/0.log"
Sep 10 23:36:37.894820 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:37.894782    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-68bcd7f987-t64mb_b83a5035-8413-4717-85c4-a311d5d35588/kube-rbac-proxy/0.log"
Sep 10 23:36:40.254288 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.254261    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/2.log"
Sep 10 23:36:40.261262 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.261200    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-dfl96_bc6adc43-c475-4abd-ba1a-5bba5d3f2235/console-operator/3.log"
Sep 10 23:36:40.642283 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.642248    2585 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"]
Sep 10 23:36:40.650147 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.650101    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.654308 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.654278    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"]
Sep 10 23:36:40.782520 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.782473    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8aae749-256c-4bb0-a0c5-caea274ec5a1-sys\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.782729 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.782526    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8aae749-256c-4bb0-a0c5-caea274ec5a1-podres\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.782729 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.782622    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8aae749-256c-4bb0-a0c5-caea274ec5a1-lib-modules\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.782729 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.782674    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8aae749-256c-4bb0-a0c5-caea274ec5a1-proc\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.782908 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.782744    2585 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqzck\" (UniqueName: \"kubernetes.io/projected/a8aae749-256c-4bb0-a0c5-caea274ec5a1-kube-api-access-wqzck\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.869297 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.869267    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-67c9888cd-xnchc_71c8f4d0-1dca-4e81-8cd6-3d13c6826477/console/0.log"
Sep 10 23:36:40.883995 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.883961    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqzck\" (UniqueName: \"kubernetes.io/projected/a8aae749-256c-4bb0-a0c5-caea274ec5a1-kube-api-access-wqzck\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.884181 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.884058    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8aae749-256c-4bb0-a0c5-caea274ec5a1-sys\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.884181 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.884087    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8aae749-256c-4bb0-a0c5-caea274ec5a1-podres\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.884181 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.884137    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8aae749-256c-4bb0-a0c5-caea274ec5a1-lib-modules\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.884181 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.884169    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a8aae749-256c-4bb0-a0c5-caea274ec5a1-sys\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.884395 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.884189    2585 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8aae749-256c-4bb0-a0c5-caea274ec5a1-proc\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.884395 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.884248    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a8aae749-256c-4bb0-a0c5-caea274ec5a1-proc\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.884395 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.884269    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a8aae749-256c-4bb0-a0c5-caea274ec5a1-podres\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.884395 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.884336    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a8aae749-256c-4bb0-a0c5-caea274ec5a1-lib-modules\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.893625 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.893543    2585 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqzck\" (UniqueName: \"kubernetes.io/projected/a8aae749-256c-4bb0-a0c5-caea274ec5a1-kube-api-access-wqzck\") pod \"perf-node-gather-daemonset-qgpnj\" (UID: \"a8aae749-256c-4bb0-a0c5-caea274ec5a1\") " pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:40.904434 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.904409    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-ccgm8_2c708949-c6cf-477c-851c-1f9168f7fac9/download-server/0.log"
Sep 10 23:36:40.964786 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:40.964749    2585 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:41.300903 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:41.298344    2585 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"]
Sep 10 23:36:41.303163 ip-10-0-138-139 kubenswrapper[2585]: W0910 23:36:41.303137    2585 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda8aae749_256c_4bb0_a0c5_caea274ec5a1.slice/crio-aae968652673efb8d2a4bf42c176d0711ce52f6e53fb15fbf95085aaad1d1098 WatchSource:0}: Error finding container aae968652673efb8d2a4bf42c176d0711ce52f6e53fb15fbf95085aaad1d1098: Status 404 returned error can't find the container with id aae968652673efb8d2a4bf42c176d0711ce52f6e53fb15fbf95085aaad1d1098
Sep 10 23:36:41.359619 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:41.359539    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj" event={"ID":"a8aae749-256c-4bb0-a0c5-caea274ec5a1","Type":"ContainerStarted","Data":"aae968652673efb8d2a4bf42c176d0711ce52f6e53fb15fbf95085aaad1d1098"}
Sep 10 23:36:42.370863 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:42.370824    2585 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj" event={"ID":"a8aae749-256c-4bb0-a0c5-caea274ec5a1","Type":"ContainerStarted","Data":"9f454f06b4cd910fd3066adc1ec4b1e39166cf27dc45ce80fc1cd71aeabd6146"}
Sep 10 23:36:42.371368 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:42.371259    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:42.388878 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:42.388819    2585 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj" podStartSLOduration=2.388797373 podStartE2EDuration="2.388797373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 23:36:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 23:36:42.387911239 +0000 UTC m=+2314.566782227" watchObservedRunningTime="2026-09-10 23:36:42.388797373 +0000 UTC m=+2314.567668353"
Sep 10 23:36:42.831757 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:42.831724    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xz27k_37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2/dns/0.log"
Sep 10 23:36:42.857605 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:42.857552    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xz27k_37a4bbac-29ef-41a5-b1e6-9b56e2af3fc2/kube-rbac-proxy/0.log"
Sep 10 23:36:42.909024 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:42.908986    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fkrjd_c681d59b-784f-4e80-94b7-95040c092c61/dns-node-resolver/0.log"
Sep 10 23:36:43.511633 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:43.511599    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7bbd5b85b-kpfvl_8a406887-a0f4-4e85-93e8-e365cee0e920/registry/0.log"
Sep 10 23:36:43.534157 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:43.534112    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2gkn6_54a85272-748c-47b2-9725-e51e37b82c38/node-ca/0.log"
Sep 10 23:36:44.548155 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:44.548123    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr_d13acf5c-3a29-4bae-bb41-222232226508/istio-proxy/0.log"
Sep 10 23:36:44.884522 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:44.884446    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9ks5r_f38eef04-b82b-4f71-94c2-5f768febbfb7/istio-proxy/0.log"
Sep 10 23:36:44.895027 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:44.894988    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9ks5r_f38eef04-b82b-4f71-94c2-5f768febbfb7/istio-proxy/1.log"
Sep 10 23:36:44.974390 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:44.974361    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pdlcg_3faa5574-b510-4949-b387-cc6607c9b0ac/payload-processing/0.log"
Sep 10 23:36:45.002098 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:45.002071    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dbbc657dd-v7w6k_88dce041-58b1-456d-94ad-ac2f44a11c07/router/0.log"
Sep 10 23:36:45.906875 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:45.906842    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ngpz6_dcb845f5-719b-4eaf-a17c-9e2d72f32635/serve-healthcheck-canary/0.log"
Sep 10 23:36:46.495196 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:46.495164    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-lg2tg_feb57e6c-d860-43e5-b331-5167bbef45fe/insights-operator/0.log"
Sep 10 23:36:46.496322 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:46.496287    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-lg2tg_feb57e6c-d860-43e5-b331-5167bbef45fe/insights-operator/1.log"
Sep 10 23:36:46.601853 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:46.601820    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8x6kl_1ca85274-350b-496c-a38a-0cac6e0bd084/kube-rbac-proxy/0.log"
Sep 10 23:36:46.624406 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:46.624378    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8x6kl_1ca85274-350b-496c-a38a-0cac6e0bd084/exporter/0.log"
Sep 10 23:36:46.649932 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:46.649898    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8x6kl_1ca85274-350b-496c-a38a-0cac6e0bd084/extractor/0.log"
Sep 10 23:36:48.389496 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:48.389458    2585 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r674h/perf-node-gather-daemonset-qgpnj"
Sep 10 23:36:49.098104 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:49.098069    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-n64zt_ba2bbdc1-7755-4055-becf-aa8567d0af73/manager/0.log"
Sep 10 23:36:49.281070 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:49.281037    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bl6kg_0be5071d-f955-441b-8b3e-c5855bdc69e7/manager/0.log"
Sep 10 23:36:49.476532 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:49.476453    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7_326dd1a2-19d6-4c64-93c2-b823e685521d/manager/0.log"
Sep 10 23:36:49.509419 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:49.509386    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dbfbc5c4d-x5hf7_326dd1a2-19d6-4c64-93c2-b823e685521d/copy-manifests/0.log"
Sep 10 23:36:50.996991 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:50.996963    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr_d13acf5c-3a29-4bae-bb41-222232226508/istio-proxy/0.log"
Sep 10 23:36:51.068950 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:51.068917    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67777b886f-7m8zp_a20d62e9-63d5-4642-aaff-2924b45cec31/manager/0.log"
Sep 10 23:36:51.146164 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:51.146139    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9xp4b_1e944a16-3f97-4009-8754-56cc12a37229/openshift-lws-operator/0.log"
Sep 10 23:36:51.272478 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:51.272404    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9ks5r_f38eef04-b82b-4f71-94c2-5f768febbfb7/istio-proxy/0.log"
Sep 10 23:36:51.281118 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:51.281090    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9ks5r_f38eef04-b82b-4f71-94c2-5f768febbfb7/istio-proxy/1.log"
Sep 10 23:36:51.340549 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:51.340520    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pdlcg_3faa5574-b510-4949-b387-cc6607c9b0ac/payload-processing/0.log"
Sep 10 23:36:51.355720 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:51.355694    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dbbc657dd-v7w6k_88dce041-58b1-456d-94ad-ac2f44a11c07/router/0.log"
Sep 10 23:36:52.854676 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:52.854649    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-hrsxr_d13acf5c-3a29-4bae-bb41-222232226508/istio-proxy/0.log"
Sep 10 23:36:53.135575 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:53.135533    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9ks5r_f38eef04-b82b-4f71-94c2-5f768febbfb7/istio-proxy/0.log"
Sep 10 23:36:53.144850 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:53.144823    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-9ks5r_f38eef04-b82b-4f71-94c2-5f768febbfb7/istio-proxy/1.log"
Sep 10 23:36:53.202025 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:53.201997    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-pdlcg_3faa5574-b510-4949-b387-cc6607c9b0ac/payload-processing/0.log"
Sep 10 23:36:53.217758 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:53.217730    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5dbbc657dd-v7w6k_88dce041-58b1-456d-94ad-ac2f44a11c07/router/0.log"
Sep 10 23:36:58.005950 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:58.005873    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dptvg_1e378e8e-e4df-467d-9818-b56e92facd83/kube-multus-additional-cni-plugins/0.log"
Sep 10 23:36:58.029454 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:58.029428    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dptvg_1e378e8e-e4df-467d-9818-b56e92facd83/egress-router-binary-copy/0.log"
Sep 10 23:36:58.051634 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:58.051589    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dptvg_1e378e8e-e4df-467d-9818-b56e92facd83/cni-plugins/0.log"
Sep 10 23:36:58.075201 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:58.075154    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dptvg_1e378e8e-e4df-467d-9818-b56e92facd83/bond-cni-plugin/0.log"
Sep 10 23:36:58.098050 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:58.098001    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dptvg_1e378e8e-e4df-467d-9818-b56e92facd83/routeoverride-cni/0.log"
Sep 10 23:36:58.120813 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:58.120741    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dptvg_1e378e8e-e4df-467d-9818-b56e92facd83/whereabouts-cni-bincopy/0.log"
Sep 10 23:36:58.143697 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:58.143650    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dptvg_1e378e8e-e4df-467d-9818-b56e92facd83/whereabouts-cni/0.log"
Sep 10 23:36:58.386201 ip-10-0-138-139 kubenswrapper[2585]: I0910 23:36:58.386173    2585 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bs529_7b30ce23-27fa-474a-bc25-f0dc91a16892/kube-multus/0.log"