Sep 08 14:14:31.358497 ip-10-0-131-123 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 14:14:31.358510 ip-10-0-131-123 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 14:14:31.358520 ip-10-0-131-123 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 14:14:31.358723 ip-10-0-131-123 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 14:14:42.781087 ip-10-0-131-123 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 08 14:14:42.781108 ip-10-0-131-123 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e1fe1c9a22d643158ca0c4d85980cd95 --
Sep 08 14:16:37.253077 ip-10-0-131-123 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 14:16:37.589500 ip-10-0-131-123 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:16:37.589500 ip-10-0-131-123 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 14:16:37.589500 ip-10-0-131-123 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:16:37.589500 ip-10-0-131-123 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 14:16:37.589500 ip-10-0-131-123 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 14:16:37.591041 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.590954    2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 14:16:37.594833 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594819    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:16:37.594833 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594833    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594837    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594840    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594844    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594847    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594850    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594853    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594856    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594859    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594862    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594873    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594876    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594878    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594882    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594885    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594887    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594890    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594893    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594895    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:16:37.594896 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594898    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594901    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594904    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594906    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594909    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594912    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594915    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594918    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594921    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594923    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594926    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594928    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594931    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594934    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594936    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594939    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594942    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594944    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594947    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594950    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:16:37.595384 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594952    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594955    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594957    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594962    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594966    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594969    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594972    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594975    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594978    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594980    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594983    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594986    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594989    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594991    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594995    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.594997    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595000    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595003    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595006    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595009    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:16:37.596155 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595011    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595014    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595017    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595019    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595022    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595024    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595027    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595030    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595033    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595035    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595038    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595040    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595045    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595049    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595052    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595055    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595057    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595060    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595063    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595065    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:16:37.596669 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595068    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595070    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595073    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595075    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595077    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595080    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595084    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595086    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595089    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595092    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595094    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595097    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595100    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595102    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595105    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595107    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595110    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595113    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:16:37.597430 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.595117    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598036    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598053    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598059    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598064    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598069    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598073    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598078    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598082    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598086    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598092    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598096    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598101    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598106    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598110    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598114    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598118    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598130    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598134    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598138    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:16:37.598217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598142    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598146    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598151    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598155    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598159    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598163    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598168    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598172    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598176    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598180    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598186    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598190    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598194    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598199    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598204    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598208    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598212    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598218    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598225    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:16:37.599135 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598230    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598235    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598241    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598248    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598253    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598257    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598261    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598266    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598272    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598278    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598282    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598286    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598291    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598295    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598299    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598303    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598308    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598312    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598316    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598320    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:16:37.599972 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598324    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598328    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598333    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598338    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598343    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598348    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598353    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598357    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598362    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598365    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598369    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598374    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598378    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598382    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598386    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598390    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598394    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598398    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598402    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598407    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:16:37.600850 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598411    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598416    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598420    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598426    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598430    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598440    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598445    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598449    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598453    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598457    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598461    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598465    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598469    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598473    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598477    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598481    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598486    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598490    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598494    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598500    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:16:37.601524 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.598505    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599155    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599164    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599170    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599174    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599178    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599182    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599187    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599191    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599195    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599199    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599203    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599210    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599216    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599221    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599226    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599231    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599236    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599240    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:16:37.602131 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599244    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599248    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599252    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599257    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599261    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599266    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599270    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599274    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599279    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599283    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599287    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599292    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599296    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599307    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599311    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599316    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599320    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599325    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599329    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:16:37.602635 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599333    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599338    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599342    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599346    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599350    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599354    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599359    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599363    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599367    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599371    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599376    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599379    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599384    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599389    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599393    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599401    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599407    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599412    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599416    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:16:37.603311 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599420    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599424    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599431    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599437    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599442    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599447    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599452    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599457    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599461    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599465    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599470    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599474    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599478    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599482    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599486    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599491    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599495    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599499    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599503    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599515    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:16:37.603906 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599519    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599524    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599528    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599532    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599536    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599540    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599545    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599550    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599555    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599560    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599564    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599568    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599573    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599577    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599581    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599585    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599589    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599594    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599598    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599603    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:16:37.604483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599607    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599611    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.599615    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599732    2564 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599805    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599817    2564 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599824    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599831    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599836    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599843    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599850    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599855    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599860    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599865    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599871    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599876    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599881    2564 flags.go:64] FLAG: --cgroup-root=""
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599885    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599890    2564 flags.go:64] FLAG: --client-ca-file=""
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599896    2564 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599901    2564 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599908    2564 flags.go:64] FLAG: --cluster-domain=""
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599912    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 14:16:37.605017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599917    2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599922    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599928    2564 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599934    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599939    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599944    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599949    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599955    2564 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599960    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599964    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599969    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599974    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599980    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599985    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599989    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599994    2564 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.599998    2564 flags.go:64] FLAG: --enable-server="true"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600003    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600011    2564 flags.go:64] FLAG: --event-burst="100"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600016    2564 flags.go:64] FLAG: --event-qps="50"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600021    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600026    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600033    2564 flags.go:64] FLAG: --eviction-hard=""
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600039    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 14:16:37.605604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600044    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600049    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600054    2564 flags.go:64] FLAG: --eviction-soft=""
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600059    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600063    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600069    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600074    2564 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600078    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600083    2564 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600088    2564 flags.go:64] FLAG: --feature-gates=""
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600094    2564 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600099    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600104    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600109    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600114    2564 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600119    2564 flags.go:64] FLAG: --help="false"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600124    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-131-123.ec2.internal"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600129    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600134    2564 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600138    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600144    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600149    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600154    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 14:16:37.606225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600158    2564 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600162    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600167    2564 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600172    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600177    2564 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600182    2564 flags.go:64] FLAG: --kube-reserved=""
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600186    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600193    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600198    2564 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600202    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600207    2564 flags.go:64] FLAG: --lock-file=""
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600211    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600217    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600222    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600230    2564 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600236    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600240    2564 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600245    2564 flags.go:64] FLAG: --logging-format="text"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600249    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600255    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600260    2564 flags.go:64] FLAG: --manifest-url=""
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600264    2564 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600272    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600277    2564 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600283    2564 flags.go:64] FLAG: --max-pods="110"
Sep 08 14:16:37.606820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600288    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600293    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600298    2564 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600302    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600308    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600312    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600317    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600328    2564 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600333    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600338    2564 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600343    2564 flags.go:64] FLAG: --pod-cidr=""
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600347    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600356    2564 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600361    2564 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600367    2564 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600372    2564 flags.go:64] FLAG: --port="10250"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600376    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600382    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07a5727e5b009db6a"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600388    2564 flags.go:64] FLAG: --qos-reserved=""
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600393    2564 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600398    2564 flags.go:64] FLAG: --register-node="true"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600402    2564 flags.go:64] FLAG: --register-with-taints=""
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600408    2564 flags.go:64] FLAG: --registry-burst="10"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600413    2564 flags.go:64] FLAG: --registry-qps="5"
Sep 08 14:16:37.607533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600418    2564 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600422    2564 flags.go:64] FLAG: --reserved-memory=""
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600429    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600434    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600439    2564 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600444    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600449    2564 flags.go:64] FLAG: --runonce="false"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600453    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600458    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600463    2564 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600468    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600472    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600477    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600482    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600486    2564 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600491    2564 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600496    2564 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600501    2564 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600505    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600510    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600515    2564 flags.go:64] FLAG: --system-cgroups=""
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600519    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600530    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600534    2564 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600539    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 14:16:37.608136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600545    2564 flags.go:64] FLAG: --tls-min-version=""
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600550    2564 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600555    2564 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600560    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600565    2564 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600569    2564 flags.go:64] FLAG: --v="2"
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600575    2564 flags.go:64] FLAG: --version="false"
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600583    2564 flags.go:64] FLAG: --vmodule=""
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600589    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.600595    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600775    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600782    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600803    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600808    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600812    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600816    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600821    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600825    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600829    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600833    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600837    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600841    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:16:37.608755 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600845    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600849    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600853    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600857    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600861    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600865    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600869    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600873    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600877    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600881    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600885    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600890    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600894    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600898    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600903    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600907    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600911    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600918    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600924    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600928    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:16:37.609334 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600932    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600937    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600941    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600945    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600949    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600953    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600957    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600961    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600965    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600972    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600978    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600983    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600988    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600993    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.600997    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601002    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601006    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601010    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601014    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:16:37.609837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601019    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601023    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601027    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601031    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601036    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601040    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601046    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601051    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601056    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601060    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601066    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601070    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601075    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601079    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601084    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601088    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601092    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601096    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601100    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:16:37.610317 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601104    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601108    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601112    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601116    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601121    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601125    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601129    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601133    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601137    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601142    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601148    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601154    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601159    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601164    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601169    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601173    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601177    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601182    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601186    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:16:37.610806 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601190    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601194    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601199    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601203    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601211    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601215    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601219    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601224    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601229    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.601233    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.601663    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.608647    2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.608663    2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.608677    2564 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.608682    2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 14:16:37.611265 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608738    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608742    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608745    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608749    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608752    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608755    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608759    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608762    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608765    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608768    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608772    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608774    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608777    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608780    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608783    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608802    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608806    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608809    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608812    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608815    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:16:37.611644 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608818    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608821    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608824    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608826    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608829    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608832    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608834    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608837    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608839    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608844    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608847    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608850    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608853    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608856    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608858    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608861    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608864    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608867    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608869    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608872    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:16:37.612213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608875    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608877    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608880    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608883    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608885    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608888    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608890    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608893    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608896    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608898    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608901    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608904    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608906    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608909    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608911    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608914    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608917    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608921    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608924    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:16:37.612742 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608927    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608930    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608934    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608937    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608940    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608943    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608947    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608949    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608952    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608955    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608957    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608960    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608962    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608965    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608967    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608970    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608973    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608975    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608978    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608980    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:16:37.613232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608983    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608986    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608988    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608991    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608993    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608996    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.608998    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609001    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609003    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609006    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609008    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609011    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609013    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609018    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609023    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609026    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609029    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609033    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609037    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:16:37.613739 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609040    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.609045    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609158    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609162    2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609166    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609169    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609173    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609176    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609178    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609181    2564 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609184    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609186    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609189    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609191    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 14:16:37.614232 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609194    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609197    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609199    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609202    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609205    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609207    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609210    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609213    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609216    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609219    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609221    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609224    2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609227    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609229    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609232    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609235    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609238    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609240    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609243    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609246    2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 14:16:37.614583 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609248    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609251    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609253    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609256    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609258    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609261    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609263    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609266    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609269    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609271    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609274    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609276    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609279    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609282    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609284    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609287    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609289    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609292    2564 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609294    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609297    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 14:16:37.615094 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609299    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609302    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609304    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609307    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609310    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609312    2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609315    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609318    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609320    2564 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609323    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609326    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609328    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609331    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609333    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609336    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609339    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609341    2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609344    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609346    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609349    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 14:16:37.615599 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609352    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609354    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609357    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609359    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609362    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609364    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609367    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609370    2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609372    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609375    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609377    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609380    2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609382    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609385    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609387    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609392    2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609395    2564 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609398    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609401    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 14:16:37.616172 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609405    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 14:16:37.616632 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609408    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 14:16:37.616632 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609411    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 14:16:37.616632 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609414    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 14:16:37.616632 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609417    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 14:16:37.616632 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609420    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 14:16:37.616632 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609422    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 14:16:37.616632 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:37.609425    2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 14:16:37.616632 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.609430    2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 14:16:37.616632 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.609529    2564 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 14:16:37.616632 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.611377    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 14:16:37.616632 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.612071    2564 server.go:1019] "Starting client certificate rotation"
Sep 08 14:16:37.616632 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.612187    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 14:16:37.616632 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.612227    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 14:16:37.616985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.614038    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 14:16:37.616985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.615236    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 14:16:37.624828 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.624773    2564 log.go:25] "Validated CRI v1 runtime API"
Sep 08 14:16:37.627891 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.627876    2564 log.go:25] "Validated CRI v1 image API"
Sep 08 14:16:37.628701 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.628687    2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 14:16:37.632431 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.632413    2564 fs.go:135] Filesystem UUIDs: map[75aa62e7-3892-4a3d-bba3-adfa10cd8c17:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7ef9a1fd-2948-4339-a8ca-b73cf8032d7d:/dev/nvme0n1p4]
Sep 08 14:16:37.632501 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.632432    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 14:16:37.636776 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.636677    2564 manager.go:216] Machine: {Timestamp:2026-09-08 14:16:37.636196156 +0000 UTC m=+0.285853674 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101080 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23f947cbe256a7e5aa684f870fca6b SystemUUID:ec23f947-cbe2-56a7-e5aa-684f870fca6b BootID:e1fe1c9a-22d6-4315-8ca0-c4d85980cd95 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:47:7e:cb:70:4f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:47:7e:cb:70:4f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:9e:d3:a4:1e:6a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 14:16:37.636776 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.636770    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 14:16:37.636884 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.636857    2564 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 14:16:37.639365 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.639341    2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 14:16:37.639510 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.639368    2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-123.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 14:16:37.639980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.639970    2564 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 14:16:37.640016 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.639982    2564 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 14:16:37.640016 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.639990    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 14:16:37.640613 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.640603    2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 14:16:37.641714 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.641701    2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 14:16:37.644087 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.644069    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 14:16:37.644540 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.644527    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 14:16:37.644679 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.644669    2564 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 14:16:37.644711 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.644701    2564 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 14:16:37.644738 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.644712    2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 14:16:37.644738 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.644726    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 14:16:37.644738 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.644736    2564 kubelet.go:398] "Adding apiserver pod source"
Sep 08 14:16:37.644888 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.644745    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 14:16:37.645156 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.645143    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 14:16:37.645211 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.645164    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 14:16:37.647196 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.647174    2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 14:16:37.649090 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649073    2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 14:16:37.649135 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649108    2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 14:16:37.649756 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649746    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 14:16:37.649802 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649762    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 14:16:37.649802 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649768    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 14:16:37.649802 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649773    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 14:16:37.649802 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649782    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 14:16:37.649919 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649805    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 14:16:37.649919 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649858    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 14:16:37.649919 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649864    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 14:16:37.649919 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649872    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 14:16:37.649919 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649877    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 14:16:37.649919 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649886    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 14:16:37.649919 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.649894    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 14:16:37.650518 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.650507    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 14:16:37.650518 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.650518    2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 14:16:37.653953 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.653939    2564 server.go:1268] "Started kubelet"
Sep 08 14:16:37.654110 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.654052    2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 14:16:37.654206 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.654191    2564 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 14:16:37.654259 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.654184    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 14:16:37.654995 ip-10-0-131-123 systemd[1]: Started Kubernetes Kubelet.
Sep 08 14:16:37.655246 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.655180    2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 14:16:37.658007 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.657984    2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-123.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 14:16:37.658348 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.658323    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 14:16:37.659026 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.659009    2564 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 14:16:37.660130 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.659974    2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 14:16:37.660693 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.660553    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 14:16:37.661861 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.661841    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 14:16:37.661861 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.661852    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 14:16:37.662448 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.662410    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:37.662530 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.662500    2564 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 14:16:37.662530 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.662517    2564 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 14:16:37.662628 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.662542    2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 14:16:37.662684 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.662646    2564 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 14:16:37.662684 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.662655    2564 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 14:16:37.663292 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.663277    2564 factory.go:55] Registering systemd factory
Sep 08 14:16:37.663292 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.663295    2564 factory.go:223] Registration of the systemd container factory successfully
Sep 08 14:16:37.663532 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.663518    2564 factory.go:153] Registering CRI-O factory
Sep 08 14:16:37.663532 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.663532    2564 factory.go:223] Registration of the crio container factory successfully
Sep 08 14:16:37.663638 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.663569    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 14:16:37.663638 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.663586    2564 factory.go:103] Registering Raw factory
Sep 08 14:16:37.663638 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.663598    2564 manager.go:1196] Started watching for new ooms in manager
Sep 08 14:16:37.663638 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.662815    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-123.ec2.internal.18d35e26c807582a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-123.ec2.internal,UID:ip-10-0-131-123.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-123.ec2.internal,},FirstTimestamp:2026-09-08 14:16:37.653911594 +0000 UTC m=+0.303569097,LastTimestamp:2026-09-08 14:16:37.653911594 +0000 UTC m=+0.303569097,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-123.ec2.internal,}"
Sep 08 14:16:37.663961 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.663945    2564 manager.go:349] Starting recovery of all containers
Sep 08 14:16:37.673377 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.673359    2564 manager.go:354] Recovery completed
Sep 08 14:16:37.674646 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.674611    2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-123.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 14:16:37.674727 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.674650    2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 14:16:37.676699 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.676678    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vmbf4"
Sep 08 14:16:37.678010 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.677986    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:16:37.679765 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.679747    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:16:37.679847 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.679780    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:16:37.679847 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.679809    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:16:37.680427 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.680413    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:16:37.680494 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.680415    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 14:16:37.680494 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.680470    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 14:16:37.680494 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.680489    2564 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 14:16:37.681137 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.681122    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:16:37.681195 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.681149    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:16:37.681195 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.681158    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:16:37.681597 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.681585    2564 policy_none.go:49] "None policy: Start"
Sep 08 14:16:37.681641 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.681604    2564 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 14:16:37.681641 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.681615    2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 14:16:37.682494 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.682484    2564 policy_none.go:47] "Start"
Sep 08 14:16:37.683666 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.683563    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vmbf4"
Sep 08 14:16:37.711352 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.711339    2564 manager.go:337] "Starting Device Plugin manager"
Sep 08 14:16:37.711432 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.711370    2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 14:16:37.711432 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.711380    2564 server.go:87] "Starting device plugin registration server"
Sep 08 14:16:37.711634 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.711623    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 14:16:37.711688 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.711634    2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 14:16:37.711773 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.711757    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 14:16:37.711861 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.711849    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 14:16:37.711912 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.711877    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 14:16:37.712414 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.712396    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 14:16:37.712497 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.712447    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:37.736006 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.735982    2564 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2596 into the system container \"/system.slice\": <nil>"
Sep 08 14:16:37.811782 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.811749    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:16:37.812834 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.812816    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:16:37.812925 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.812848    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:16:37.812925 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.812865    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:16:37.812925 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.812893    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-123.ec2.internal"
Sep 08 14:16:37.821828 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.821812    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-123.ec2.internal"
Sep 08 14:16:37.821903 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.821837    2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-123.ec2.internal\": node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:37.844357 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.844269    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:37.924236 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.924196    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 14:16:37.925555 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.925540    2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 14:16:37.925634 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.925594    2564 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 14:16:37.925634 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.925621    2564 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 14:16:37.925726 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.925716    2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 14:16:37.928354 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:37.928337    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:16:37.945167 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:37.945152    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:38.026705 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.026676    2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"]
Sep 08 14:16:38.026812 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.026757    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:16:38.027751 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.027737    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:16:38.027830 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.027767    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:16:38.027830 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.027777    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:16:38.029011 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.029000    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:16:38.029127 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.029112    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:38.029163 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.029144    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:16:38.029721 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.029708    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:16:38.029796 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.029734    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:16:38.029796 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.029746    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:16:38.029889 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.029829    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:16:38.029889 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.029852    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:16:38.029889 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.029862    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:16:38.030940 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.030925    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:38.031024 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.030949    2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 14:16:38.035250 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.034778    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 14:16:38.035250 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.034817    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 14:16:38.035250 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.034833    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeHasSufficientPID"
Sep 08 14:16:38.046229 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:38.046212    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:38.048328 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:38.048313    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-123.ec2.internal\" not found" node="ip-10-0-131-123.ec2.internal"
Sep 08 14:16:38.053600 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:38.053583    2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-123.ec2.internal\" not found" node="ip-10-0-131-123.ec2.internal"
Sep 08 14:16:38.066424 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.066402    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b6dddcb8c682c982b23c18df04e5a1a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-123.ec2.internal\" (UID: \"8b6dddcb8c682c982b23c18df04e5a1a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:38.066500 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.066434    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee7d50ebd78415dd81a944a4e21070c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal\" (UID: \"ee7d50ebd78415dd81a944a4e21070c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:38.066500 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.066452    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee7d50ebd78415dd81a944a4e21070c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal\" (UID: \"ee7d50ebd78415dd81a944a4e21070c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:38.147224 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:38.147155    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:38.167594 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.167564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee7d50ebd78415dd81a944a4e21070c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal\" (UID: \"ee7d50ebd78415dd81a944a4e21070c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:38.167594 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.167599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee7d50ebd78415dd81a944a4e21070c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal\" (UID: \"ee7d50ebd78415dd81a944a4e21070c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:38.167750 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.167616    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b6dddcb8c682c982b23c18df04e5a1a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-123.ec2.internal\" (UID: \"8b6dddcb8c682c982b23c18df04e5a1a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:38.167750 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.167704    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ee7d50ebd78415dd81a944a4e21070c2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal\" (UID: \"ee7d50ebd78415dd81a944a4e21070c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:38.167853 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.167748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b6dddcb8c682c982b23c18df04e5a1a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-123.ec2.internal\" (UID: \"8b6dddcb8c682c982b23c18df04e5a1a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:38.167853 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:38.167805    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ee7d50ebd78415dd81a944a4e21070c2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal\" (UID: \"ee7d50ebd78415dd81a944a4e21070c2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:38.247704 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:38.247686    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:39.601907 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:39.601882    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:39.605041 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:39.605024    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:39.610365 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:39.610349    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:39.702736 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:39.702661    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:39.781740 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:39.781716    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:16:39.802746 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:39.802718    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:39.866213 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:39.866184    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 14:16:39.866666 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:39.866349    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 14:16:39.866666 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:39.866376    2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 14:16:39.903637 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:39.903614    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:39.939558 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:39.939517    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 14:11:38 +0000 UTC" deadline="2028-05-26 15:30:08.664422486 +0000 UTC"
Sep 08 14:16:39.939558 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:39.939554    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15025h13m28.724871577s"
Sep 08 14:16:40.004643 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:40.004571    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:40.104679 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.104653    2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:16:40.104679 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:40.104665    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:40.205290 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:40.205258    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:40.305799 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:40.305736    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:40.406590 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:40.406568    2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-123.ec2.internal\" not found"
Sep 08 14:16:40.407915 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.407898    2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:16:40.415877 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.415863    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:40.425685 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.425669    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 14:16:40.426538 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.426527    2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal"
Sep 08 14:16:40.437474 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.437462    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 14:16:40.853861 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:40.853833    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6dddcb8c682c982b23c18df04e5a1a.slice/crio-d85f9a6f8825b63dcb84f813d330a040329de7b7e0302a50381cd9aba539cf66 WatchSource:0}: Error finding container d85f9a6f8825b63dcb84f813d330a040329de7b7e0302a50381cd9aba539cf66: Status 404 returned error can't find the container with id d85f9a6f8825b63dcb84f813d330a040329de7b7e0302a50381cd9aba539cf66
Sep 08 14:16:40.859294 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.859278    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:16:40.900429 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.900408    2564 apiserver.go:52] "Watching apiserver"
Sep 08 14:16:40.909434 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.909413    2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 14:16:40.910318 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.910298    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-2m9dd","openshift-network-diagnostics/network-check-target-26mk9","openshift-network-operator/iptables-alerter-g98xx","openshift-ovn-kubernetes/ovnkube-node-lw56g","kube-system/global-pull-secret-syncer-k6dcv","kube-system/konnectivity-agent-pw4zx","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal","openshift-multus/multus-5mbnm","openshift-multus/multus-additional-cni-plugins-s8jwt","openshift-multus/network-metrics-daemon-x8tbj","kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal","openshift-cluster-node-tuning-operator/tuned-m9hl9","openshift-dns/node-resolver-9dfbq"]
Sep 08 14:16:40.912093 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.912079    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:40.913081 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.913059    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.914060 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.914043    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g98xx"
Sep 08 14:16:40.914816 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.914799    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 14:16:40.915137 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.915112    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 14:16:40.915218 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.915139    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 14:16:40.915218 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.915191    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7cx8f\""
Sep 08 14:16:40.915334 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.915289    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.915758 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.915743    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:16:40.915905 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.915891    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zvvrz\""
Sep 08 14:16:40.916004 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.915932    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 14:16:40.916193 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.916178    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:40.916256 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:40.916229    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:16:40.916417 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.916390    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 14:16:40.916640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.916621    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:16:40.916768 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.916751    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 14:16:40.916846 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.916831    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 14:16:40.916909 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.916873    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gcdkf\""
Sep 08 14:16:40.917267 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.917251    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pw4zx"
Sep 08 14:16:40.917448 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.917362    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 14:16:40.917733 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.917716    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 14:16:40.917825 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.917754    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8bjnm\""
Sep 08 14:16:40.917825 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.917725    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 14:16:40.918463 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.918448    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:40.918824 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.918807    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 14:16:40.918902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.918873    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 14:16:40.918953 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.918927    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 14:16:40.919122 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.919109    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 14:16:40.919421 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.919404    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 14:16:40.919484 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.919442    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jt4sg\""
Sep 08 14:16:40.919794 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.919777    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2m9dd"
Sep 08 14:16:40.920677 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.920659    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 14:16:40.920772 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.920705    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 14:16:40.920772 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.920715    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 14:16:40.920883 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.920822    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f9jmp\""
Sep 08 14:16:40.920969 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.920955    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:40.921086 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:40.921071    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:16:40.921680 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.921652    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 14:16:40.921970 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.921956    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 14:16:40.922044 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.921987    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 14:16:40.922044 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.921998    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 14:16:40.922491 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.922467    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vzjrl\""
Sep 08 14:16:40.922658 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.922641    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:40.924140 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.924124    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:40.924206 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:40.924184    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:16:40.924895 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.924880    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 14:16:40.924975 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.924888    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jdmbq\""
Sep 08 14:16:40.924975 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.924960    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 14:16:40.925404 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.925389    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9dfbq"
Sep 08 14:16:40.927212 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.927189    2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-sys\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928209    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-run-systemd\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-run-openvswitch\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928302    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928314    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-kubernetes\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928362    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-systemd\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928389    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-var-lib-kubelet\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928417    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d82c9c8d-bc21-43cf-99f4-1be094f66a89-iptables-alerter-script\") pod \"iptables-alerter-g98xx\" (UID: \"d82c9c8d-bc21-43cf-99f4-1be094f66a89\") " pod="openshift-network-operator/iptables-alerter-g98xx"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-device-dir\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928475    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-etc-selinux\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928523    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-sysctl-d\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928564    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-kubelet\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928637    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-etc-openvswitch\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-cni-netd\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.929088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928730    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d8ba03c-1050-4ff4-86fe-4276c9a7467a-agent-certs\") pod \"konnectivity-agent-pw4zx\" (UID: \"2d8ba03c-1050-4ff4-86fe-4276c9a7467a\") " pod="kube-system/konnectivity-agent-pw4zx"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928787    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-modprobe-d\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928807    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jffcq\""
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-sysconfig\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-systemd-units\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-slash\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.928945    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-var-lib-openvswitch\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929000    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-log-socket\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929049    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-sys-fs\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929100    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-lib-modules\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929209    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-host\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929242    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-tmp\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929270    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-run-ovn\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929302    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-node-log\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw24r\" (UniqueName: \"kubernetes.io/projected/42661186-579d-4652-ad16-764ddae21302-kube-api-access-hw24r\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929385    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9298k\" (UniqueName: \"kubernetes.io/projected/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-kube-api-access-9298k\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929449    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d82c9c8d-bc21-43cf-99f4-1be094f66a89-host-slash\") pod \"iptables-alerter-g98xx\" (UID: \"d82c9c8d-bc21-43cf-99f4-1be094f66a89\") " pod="openshift-network-operator/iptables-alerter-g98xx"
Sep 08 14:16:40.929985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929522    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6005a281-88ef-4c26-b69a-fd8d5381fa72-ovn-node-metrics-cert\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929571    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27jvg\" (UniqueName: \"kubernetes.io/projected/6005a281-88ef-4c26-b69a-fd8d5381fa72-kube-api-access-27jvg\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929594    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929630    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bc9c240-9b7e-45bf-99d5-849d87a774da-kubelet-config\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929657    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bc9c240-9b7e-45bf-99d5-849d87a774da-dbus\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929686    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-socket-dir\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929768    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-sysctl-conf\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929795    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-run\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929840    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-tuned\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929883    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6005a281-88ef-4c26-b69a-fd8d5381fa72-ovnkube-config\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.929922    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6005a281-88ef-4c26-b69a-fd8d5381fa72-env-overrides\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.930006    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6005a281-88ef-4c26-b69a-fd8d5381fa72-ovnkube-script-lib\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.930065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp6k8\" (UniqueName: \"kubernetes.io/projected/d82c9c8d-bc21-43cf-99f4-1be094f66a89-kube-api-access-tp6k8\") pod \"iptables-alerter-g98xx\" (UID: \"d82c9c8d-bc21-43cf-99f4-1be094f66a89\") " pod="openshift-network-operator/iptables-alerter-g98xx"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.930095    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-run-netns\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.930127    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-run-ovn-kubernetes\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.930225    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-cni-bin\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:40.930663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.930263    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d8ba03c-1050-4ff4-86fe-4276c9a7467a-konnectivity-ca\") pod \"konnectivity-agent-pw4zx\" (UID: \"2d8ba03c-1050-4ff4-86fe-4276c9a7467a\") " pod="kube-system/konnectivity-agent-pw4zx"
Sep 08 14:16:40.931286 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.930284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-registration-dir\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:40.956830 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.956814    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mwrn9"
Sep 08 14:16:40.965101 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:40.965082    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mwrn9"
Sep 08 14:16:41.017977 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.017917    2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 14:16:41.030944 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.030925    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-tmp\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.031034 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.030957    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs\") pod \"network-metrics-daemon-x8tbj\" (UID: \"5f09cf98-dd58-4ed2-a064-4d078539840b\") " pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:41.031034 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.030980    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-multus-cni-dir\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.031143 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031089    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75982462-3b1d-40d0-bf77-f59fd69ac4cf-cnibin\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.031143 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031118    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6005a281-88ef-4c26-b69a-fd8d5381fa72-ovn-node-metrics-cert\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.031226 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031143    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bc9c240-9b7e-45bf-99d5-849d87a774da-kubelet-config\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:41.031226 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.031226 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031220    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-multus-socket-dir-parent\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.031381 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031249    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-var-lib-cni-bin\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.031381 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031270    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3bc9c240-9b7e-45bf-99d5-849d87a774da-kubelet-config\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:41.031381 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-multus-conf-dir\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.031381 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031295    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-kubelet-dir\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.031381 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031324    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 14:16:41.031381 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031332    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75982462-3b1d-40d0-bf77-f59fd69ac4cf-system-cni-dir\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.031618 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031409    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-run\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.031618 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-var-lib-kubelet\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.031618 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-hostroot\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.031618 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031452    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-run\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.031618 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031464    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp6k8\" (UniqueName: \"kubernetes.io/projected/d82c9c8d-bc21-43cf-99f4-1be094f66a89-kube-api-access-tp6k8\") pod \"iptables-alerter-g98xx\" (UID: \"d82c9c8d-bc21-43cf-99f4-1be094f66a89\") " pod="openshift-network-operator/iptables-alerter-g98xx"
Sep 08 14:16:41.031618 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031516    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-run-netns\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.031618 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031560    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-run-netns\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.031618 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031568    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-run-ovn-kubernetes\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.031934 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031677    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-run-ovn-kubernetes\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.031934 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031711    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75982462-3b1d-40d0-bf77-f59fd69ac4cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.031934 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031737    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75982462-3b1d-40d0-bf77-f59fd69ac4cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.031934 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-sys\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.031934 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031796    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-run-openvswitch\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.031934 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031858    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-run-openvswitch\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.031934 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-sys\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.031934 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031879    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.031934 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69f38441-5795-4fdd-ba8f-45c6a6a1776f-multus-daemon-config\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031961    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cde9e505-47fa-40ac-872c-cbd86b1fcf6e-serviceca\") pod \"node-ca-2m9dd\" (UID: \"cde9e505-47fa-40ac-872c-cbd86b1fcf6e\") " pod="openshift-image-registry/node-ca-2m9dd"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031977    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.031987    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75982462-3b1d-40d0-bf77-f59fd69ac4cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.031998    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032011    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a84aaf4-f043-431c-8168-0185682c8629-tmp-dir\") pod \"node-resolver-9dfbq\" (UID: \"7a84aaf4-f043-431c-8168-0185682c8629\") " pod="openshift-dns/node-resolver-9dfbq"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032037    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-kubernetes\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.032061    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret podName:3bc9c240-9b7e-45bf-99d5-849d87a774da nodeName:}" failed. No retries permitted until 2026-09-08 14:16:41.532033815 +0000 UTC m=+2.927983244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret") pod "global-pull-secret-syncer-k6dcv" (UID: "3bc9c240-9b7e-45bf-99d5-849d87a774da") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032111    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-var-lib-kubelet\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032124    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-kubernetes\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032136    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-sysctl-d\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032156    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-cni-netd\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-var-lib-kubelet\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032186    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-var-lib-cni-multus\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032207    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-systemd-units\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032216    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-cni-netd\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.032330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-slash\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032244    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-sysctl-d\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032250    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-var-lib-openvswitch\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032273    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-slash\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032281    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-log-socket\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032291    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-systemd-units\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-var-lib-openvswitch\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032307    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-sys-fs\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032311    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-log-socket\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032336    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-run-multus-certs\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032380    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-lib-modules\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-host\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032414    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-sys-fs\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-run-ovn\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032454    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-run-ovn\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032487    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-node-log\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032491    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-host\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032455    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-node-log\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032558    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-lib-modules\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032560    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-run-k8s-cni-cncf-io\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75982462-3b1d-40d0-bf77-f59fd69ac4cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a84aaf4-f043-431c-8168-0185682c8629-hosts-file\") pod \"node-resolver-9dfbq\" (UID: \"7a84aaf4-f043-431c-8168-0185682c8629\") " pod="openshift-dns/node-resolver-9dfbq"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032644    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9298k\" (UniqueName: \"kubernetes.io/projected/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-kube-api-access-9298k\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032677    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d82c9c8d-bc21-43cf-99f4-1be094f66a89-host-slash\") pod \"iptables-alerter-g98xx\" (UID: \"d82c9c8d-bc21-43cf-99f4-1be094f66a89\") " pod="openshift-network-operator/iptables-alerter-g98xx"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032700    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27jvg\" (UniqueName: \"kubernetes.io/projected/6005a281-88ef-4c26-b69a-fd8d5381fa72-kube-api-access-27jvg\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032723    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bc9c240-9b7e-45bf-99d5-849d87a774da-dbus\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032747    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-socket-dir\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-cnibin\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032794    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3bc9c240-9b7e-45bf-99d5-849d87a774da-dbus\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032748    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d82c9c8d-bc21-43cf-99f4-1be094f66a89-host-slash\") pod \"iptables-alerter-g98xx\" (UID: \"d82c9c8d-bc21-43cf-99f4-1be094f66a89\") " pod="openshift-network-operator/iptables-alerter-g98xx"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032900    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-sysctl-conf\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-socket-dir\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032929    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-tuned\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032972    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6005a281-88ef-4c26-b69a-fd8d5381fa72-ovnkube-config\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.032996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6005a281-88ef-4c26-b69a-fd8d5381fa72-env-overrides\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.033957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6005a281-88ef-4c26-b69a-fd8d5381fa72-ovnkube-script-lib\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033046    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69f38441-5795-4fdd-ba8f-45c6a6a1776f-cni-binary-copy\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033058    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-sysctl-conf\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-etc-kubernetes\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033092    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cde9e505-47fa-40ac-872c-cbd86b1fcf6e-host\") pod \"node-ca-2m9dd\" (UID: \"cde9e505-47fa-40ac-872c-cbd86b1fcf6e\") " pod="openshift-image-registry/node-ca-2m9dd"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033162    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-cni-bin\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033198    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d8ba03c-1050-4ff4-86fe-4276c9a7467a-konnectivity-ca\") pod \"konnectivity-agent-pw4zx\" (UID: \"2d8ba03c-1050-4ff4-86fe-4276c9a7467a\") " pod="kube-system/konnectivity-agent-pw4zx"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-registration-dir\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n9w6\" (UniqueName: \"kubernetes.io/projected/cde9e505-47fa-40ac-872c-cbd86b1fcf6e-kube-api-access-9n9w6\") pod \"node-ca-2m9dd\" (UID: \"cde9e505-47fa-40ac-872c-cbd86b1fcf6e\") " pod="openshift-image-registry/node-ca-2m9dd"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033304    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-run-systemd\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033346    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-systemd\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033370    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d82c9c8d-bc21-43cf-99f4-1be094f66a89-iptables-alerter-script\") pod \"iptables-alerter-g98xx\" (UID: \"d82c9c8d-bc21-43cf-99f4-1be094f66a89\") " pod="openshift-network-operator/iptables-alerter-g98xx"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-device-dir\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033425    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-etc-selinux\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033451    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gnz2\" (UniqueName: \"kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2\") pod \"network-check-target-26mk9\" (UID: \"0ea34c19-9fd2-45ab-a64d-f6d4052bcae7\") " pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033519    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-run-systemd\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033562    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-system-cni-dir\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.034686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033576    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-systemd\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033609    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64g6w\" (UniqueName: \"kubernetes.io/projected/7a84aaf4-f043-431c-8168-0185682c8629-kube-api-access-64g6w\") pod \"node-resolver-9dfbq\" (UID: \"7a84aaf4-f043-431c-8168-0185682c8629\") " pod="openshift-dns/node-resolver-9dfbq"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-kubelet\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-etc-openvswitch\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033675    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6005a281-88ef-4c26-b69a-fd8d5381fa72-ovnkube-script-lib\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033696    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d8ba03c-1050-4ff4-86fe-4276c9a7467a-agent-certs\") pod \"konnectivity-agent-pw4zx\" (UID: \"2d8ba03c-1050-4ff4-86fe-4276c9a7467a\") " pod="kube-system/konnectivity-agent-pw4zx"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033725    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-device-dir\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033768    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8kp9\" (UniqueName: \"kubernetes.io/projected/5f09cf98-dd58-4ed2-a064-4d078539840b-kube-api-access-k8kp9\") pod \"network-metrics-daemon-x8tbj\" (UID: \"5f09cf98-dd58-4ed2-a064-4d078539840b\") " pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-cni-bin\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsnmj\" (UniqueName: \"kubernetes.io/projected/69f38441-5795-4fdd-ba8f-45c6a6a1776f-kube-api-access-gsnmj\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033827    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-modprobe-d\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-sysconfig\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033881    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw24r\" (UniqueName: \"kubernetes.io/projected/42661186-579d-4652-ad16-764ddae21302-kube-api-access-hw24r\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033906    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-run-netns\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033932    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7q2w\" (UniqueName: \"kubernetes.io/projected/75982462-3b1d-40d0-bf77-f59fd69ac4cf-kube-api-access-s7q2w\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.034058    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-modprobe-d\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.034114    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-sysconfig\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.035178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.034183    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d82c9c8d-bc21-43cf-99f4-1be094f66a89-iptables-alerter-script\") pod \"iptables-alerter-g98xx\" (UID: \"d82c9c8d-bc21-43cf-99f4-1be094f66a89\") " pod="openshift-network-operator/iptables-alerter-g98xx"
Sep 08 14:16:41.035702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.034265    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-etc-selinux\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.035702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.034321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-host-kubelet\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.035702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.034349    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2d8ba03c-1050-4ff4-86fe-4276c9a7467a-konnectivity-ca\") pod \"konnectivity-agent-pw4zx\" (UID: \"2d8ba03c-1050-4ff4-86fe-4276c9a7467a\") " pod="kube-system/konnectivity-agent-pw4zx"
Sep 08 14:16:41.035702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.034352    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6005a281-88ef-4c26-b69a-fd8d5381fa72-etc-openvswitch\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.035702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.034366    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6005a281-88ef-4c26-b69a-fd8d5381fa72-env-overrides\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.035702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.034386    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/42661186-579d-4652-ad16-764ddae21302-registration-dir\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.035702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.033666    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6005a281-88ef-4c26-b69a-fd8d5381fa72-ovnkube-config\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.035702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.034768    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-tmp\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.035702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.034961    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6005a281-88ef-4c26-b69a-fd8d5381fa72-ovn-node-metrics-cert\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.035702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.034974    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-etc-tuned\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.036023 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.035990    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2d8ba03c-1050-4ff4-86fe-4276c9a7467a-agent-certs\") pod \"konnectivity-agent-pw4zx\" (UID: \"2d8ba03c-1050-4ff4-86fe-4276c9a7467a\") " pod="kube-system/konnectivity-agent-pw4zx"
Sep 08 14:16:41.044470 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.044438    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp6k8\" (UniqueName: \"kubernetes.io/projected/d82c9c8d-bc21-43cf-99f4-1be094f66a89-kube-api-access-tp6k8\") pod \"iptables-alerter-g98xx\" (UID: \"d82c9c8d-bc21-43cf-99f4-1be094f66a89\") " pod="openshift-network-operator/iptables-alerter-g98xx"
Sep 08 14:16:41.045279 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.045262    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27jvg\" (UniqueName: \"kubernetes.io/projected/6005a281-88ef-4c26-b69a-fd8d5381fa72-kube-api-access-27jvg\") pod \"ovnkube-node-lw56g\" (UID: \"6005a281-88ef-4c26-b69a-fd8d5381fa72\") " pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.045523 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.045466    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9298k\" (UniqueName: \"kubernetes.io/projected/c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0-kube-api-access-9298k\") pod \"tuned-m9hl9\" (UID: \"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0\") " pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.045560 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.045529    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw24r\" (UniqueName: \"kubernetes.io/projected/42661186-579d-4652-ad16-764ddae21302-kube-api-access-hw24r\") pod \"aws-ebs-csi-driver-node-87jcc\" (UID: \"42661186-579d-4652-ad16-764ddae21302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.134755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.134722    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69f38441-5795-4fdd-ba8f-45c6a6a1776f-multus-daemon-config\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.134755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.134759    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cde9e505-47fa-40ac-872c-cbd86b1fcf6e-serviceca\") pod \"node-ca-2m9dd\" (UID: \"cde9e505-47fa-40ac-872c-cbd86b1fcf6e\") " pod="openshift-image-registry/node-ca-2m9dd"
Sep 08 14:16:41.134980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.134781    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75982462-3b1d-40d0-bf77-f59fd69ac4cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.134980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.134804    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a84aaf4-f043-431c-8168-0185682c8629-tmp-dir\") pod \"node-resolver-9dfbq\" (UID: \"7a84aaf4-f043-431c-8168-0185682c8629\") " pod="openshift-dns/node-resolver-9dfbq"
Sep 08 14:16:41.134980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.134827    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-var-lib-cni-multus\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.134980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.134852    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-run-multus-certs\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.134980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.134874    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-run-k8s-cni-cncf-io\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.134980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.134898    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75982462-3b1d-40d0-bf77-f59fd69ac4cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.134980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.134922    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a84aaf4-f043-431c-8168-0185682c8629-hosts-file\") pod \"node-resolver-9dfbq\" (UID: \"7a84aaf4-f043-431c-8168-0185682c8629\") " pod="openshift-dns/node-resolver-9dfbq"
Sep 08 14:16:41.134980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.134948    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-cnibin\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.134980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.134946    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-var-lib-cni-multus\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.134980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.134958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-run-multus-certs\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.135395 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135001    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69f38441-5795-4fdd-ba8f-45c6a6a1776f-cni-binary-copy\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.135395 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135015    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-cnibin\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.135395 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135074    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7a84aaf4-f043-431c-8168-0185682c8629-hosts-file\") pod \"node-resolver-9dfbq\" (UID: \"7a84aaf4-f043-431c-8168-0185682c8629\") " pod="openshift-dns/node-resolver-9dfbq"
Sep 08 14:16:41.135395 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135121    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-run-k8s-cni-cncf-io\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.135395 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-etc-kubernetes\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.135395 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135308    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a84aaf4-f043-431c-8168-0185682c8629-tmp-dir\") pod \"node-resolver-9dfbq\" (UID: \"7a84aaf4-f043-431c-8168-0185682c8629\") " pod="openshift-dns/node-resolver-9dfbq"
Sep 08 14:16:41.135395 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cde9e505-47fa-40ac-872c-cbd86b1fcf6e-serviceca\") pod \"node-ca-2m9dd\" (UID: \"cde9e505-47fa-40ac-872c-cbd86b1fcf6e\") " pod="openshift-image-registry/node-ca-2m9dd"
Sep 08 14:16:41.135395 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-etc-kubernetes\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135396    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cde9e505-47fa-40ac-872c-cbd86b1fcf6e-host\") pod \"node-ca-2m9dd\" (UID: \"cde9e505-47fa-40ac-872c-cbd86b1fcf6e\") " pod="openshift-image-registry/node-ca-2m9dd"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n9w6\" (UniqueName: \"kubernetes.io/projected/cde9e505-47fa-40ac-872c-cbd86b1fcf6e-kube-api-access-9n9w6\") pod \"node-ca-2m9dd\" (UID: \"cde9e505-47fa-40ac-872c-cbd86b1fcf6e\") " pod="openshift-image-registry/node-ca-2m9dd"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135457    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/69f38441-5795-4fdd-ba8f-45c6a6a1776f-multus-daemon-config\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnz2\" (UniqueName: \"kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2\") pod \"network-check-target-26mk9\" (UID: \"0ea34c19-9fd2-45ab-a64d-f6d4052bcae7\") " pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135489    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cde9e505-47fa-40ac-872c-cbd86b1fcf6e-host\") pod \"node-ca-2m9dd\" (UID: \"cde9e505-47fa-40ac-872c-cbd86b1fcf6e\") " pod="openshift-image-registry/node-ca-2m9dd"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135467    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75982462-3b1d-40d0-bf77-f59fd69ac4cf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135517    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-system-cni-dir\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135552    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64g6w\" (UniqueName: \"kubernetes.io/projected/7a84aaf4-f043-431c-8168-0185682c8629-kube-api-access-64g6w\") pod \"node-resolver-9dfbq\" (UID: \"7a84aaf4-f043-431c-8168-0185682c8629\") " pod="openshift-dns/node-resolver-9dfbq"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135556    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-system-cni-dir\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135572    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8kp9\" (UniqueName: \"kubernetes.io/projected/5f09cf98-dd58-4ed2-a064-4d078539840b-kube-api-access-k8kp9\") pod \"network-metrics-daemon-x8tbj\" (UID: \"5f09cf98-dd58-4ed2-a064-4d078539840b\") " pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsnmj\" (UniqueName: \"kubernetes.io/projected/69f38441-5795-4fdd-ba8f-45c6a6a1776f-kube-api-access-gsnmj\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135612    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-run-netns\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7q2w\" (UniqueName: \"kubernetes.io/projected/75982462-3b1d-40d0-bf77-f59fd69ac4cf-kube-api-access-s7q2w\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135650    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs\") pod \"network-metrics-daemon-x8tbj\" (UID: \"5f09cf98-dd58-4ed2-a064-4d078539840b\") " pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135570    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/69f38441-5795-4fdd-ba8f-45c6a6a1776f-cni-binary-copy\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135673    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-multus-cni-dir\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.135811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135673    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-run-netns\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135708    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75982462-3b1d-40d0-bf77-f59fd69ac4cf-cnibin\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.135723    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135728    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-multus-cni-dir\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135732    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-multus-socket-dir-parent\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135763    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-var-lib-cni-bin\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.135773    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs podName:5f09cf98-dd58-4ed2-a064-4d078539840b nodeName:}" failed. No retries permitted until 2026-09-08 14:16:41.635757902 +0000 UTC m=+3.031707323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs") pod "network-metrics-daemon-x8tbj" (UID: "5f09cf98-dd58-4ed2-a064-4d078539840b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135776    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-multus-socket-dir-parent\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135781    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75982462-3b1d-40d0-bf77-f59fd69ac4cf-cnibin\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135792    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-var-lib-cni-bin\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135812    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-multus-conf-dir\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75982462-3b1d-40d0-bf77-f59fd69ac4cf-system-cni-dir\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135871    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-var-lib-kubelet\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135874    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-multus-conf-dir\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135889    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75982462-3b1d-40d0-bf77-f59fd69ac4cf-system-cni-dir\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-hostroot\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135926    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-hostroot\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.136445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135929    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/69f38441-5795-4fdd-ba8f-45c6a6a1776f-host-var-lib-kubelet\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.136950 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135949    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75982462-3b1d-40d0-bf77-f59fd69ac4cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.136950 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135954    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75982462-3b1d-40d0-bf77-f59fd69ac4cf-cni-binary-copy\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.136950 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.135971    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75982462-3b1d-40d0-bf77-f59fd69ac4cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.136950 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.136144    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75982462-3b1d-40d0-bf77-f59fd69ac4cf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.136950 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.136309    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75982462-3b1d-40d0-bf77-f59fd69ac4cf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.157673 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.157652    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:16:41.157673 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.157673    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:16:41.157874 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.157685    2564 projected.go:196] Error preparing data for projected volume kube-api-access-7gnz2 for pod openshift-network-diagnostics/network-check-target-26mk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:16:41.157874 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.157750    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2 podName:0ea34c19-9fd2-45ab-a64d-f6d4052bcae7 nodeName:}" failed. No retries permitted until 2026-09-08 14:16:41.657733608 +0000 UTC m=+3.053683019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7gnz2" (UniqueName: "kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2") pod "network-check-target-26mk9" (UID: "0ea34c19-9fd2-45ab-a64d-f6d4052bcae7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:16:41.160078 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.160051    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7q2w\" (UniqueName: \"kubernetes.io/projected/75982462-3b1d-40d0-bf77-f59fd69ac4cf-kube-api-access-s7q2w\") pod \"multus-additional-cni-plugins-s8jwt\" (UID: \"75982462-3b1d-40d0-bf77-f59fd69ac4cf\") " pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.160182 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.160139    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsnmj\" (UniqueName: \"kubernetes.io/projected/69f38441-5795-4fdd-ba8f-45c6a6a1776f-kube-api-access-gsnmj\") pod \"multus-5mbnm\" (UID: \"69f38441-5795-4fdd-ba8f-45c6a6a1776f\") " pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.160182 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.160151    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8kp9\" (UniqueName: \"kubernetes.io/projected/5f09cf98-dd58-4ed2-a064-4d078539840b-kube-api-access-k8kp9\") pod \"network-metrics-daemon-x8tbj\" (UID: \"5f09cf98-dd58-4ed2-a064-4d078539840b\") " pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:41.160484 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.160468    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64g6w\" (UniqueName: \"kubernetes.io/projected/7a84aaf4-f043-431c-8168-0185682c8629-kube-api-access-64g6w\") pod \"node-resolver-9dfbq\" (UID: \"7a84aaf4-f043-431c-8168-0185682c8629\") " pod="openshift-dns/node-resolver-9dfbq"
Sep 08 14:16:41.160537 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.160480    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n9w6\" (UniqueName: \"kubernetes.io/projected/cde9e505-47fa-40ac-872c-cbd86b1fcf6e-kube-api-access-9n9w6\") pod \"node-ca-2m9dd\" (UID: \"cde9e505-47fa-40ac-872c-cbd86b1fcf6e\") " pod="openshift-image-registry/node-ca-2m9dd"
Sep 08 14:16:41.183506 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.183457    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal" event={"ID":"8b6dddcb8c682c982b23c18df04e5a1a","Type":"ContainerStarted","Data":"d85f9a6f8825b63dcb84f813d330a040329de7b7e0302a50381cd9aba539cf66"}
Sep 08 14:16:41.223693 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.223668    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc"
Sep 08 14:16:41.230100 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.230080    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m9hl9"
Sep 08 14:16:41.231973 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:41.231947    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42661186_579d_4652_ad16_764ddae21302.slice/crio-834e8841dabaf1e510f2ff6672402e216e857630d7541d3f94a17858c06b0321 WatchSource:0}: Error finding container 834e8841dabaf1e510f2ff6672402e216e857630d7541d3f94a17858c06b0321: Status 404 returned error can't find the container with id 834e8841dabaf1e510f2ff6672402e216e857630d7541d3f94a17858c06b0321
Sep 08 14:16:41.237105 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.237086    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-g98xx"
Sep 08 14:16:41.237245 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:41.237227    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a63a23_7b6f_4bc2_a0a4_1e3056f019f0.slice/crio-b2f2eff93183d1a38a28d93377071d86c27b4cee7ecfc56fd3afb8c35b8a992b WatchSource:0}: Error finding container b2f2eff93183d1a38a28d93377071d86c27b4cee7ecfc56fd3afb8c35b8a992b: Status 404 returned error can't find the container with id b2f2eff93183d1a38a28d93377071d86c27b4cee7ecfc56fd3afb8c35b8a992b
Sep 08 14:16:41.241426 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.241411    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:16:41.245746 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:41.245727    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd82c9c8d_bc21_43cf_99f4_1be094f66a89.slice/crio-97be83e3f4ae88b0ca493020ed298195d81169a141c26f659095b34e8b5cf530 WatchSource:0}: Error finding container 97be83e3f4ae88b0ca493020ed298195d81169a141c26f659095b34e8b5cf530: Status 404 returned error can't find the container with id 97be83e3f4ae88b0ca493020ed298195d81169a141c26f659095b34e8b5cf530
Sep 08 14:16:41.246451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.246434    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pw4zx"
Sep 08 14:16:41.251329 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.251311    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5mbnm"
Sep 08 14:16:41.251458 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:41.251435    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6005a281_88ef_4c26_b69a_fd8d5381fa72.slice/crio-61d69704077144aaaa9623c17a81f964082a29b241e3d7d4173dcf5563cc4c23 WatchSource:0}: Error finding container 61d69704077144aaaa9623c17a81f964082a29b241e3d7d4173dcf5563cc4c23: Status 404 returned error can't find the container with id 61d69704077144aaaa9623c17a81f964082a29b241e3d7d4173dcf5563cc4c23
Sep 08 14:16:41.254813 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:41.254754    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d8ba03c_1050_4ff4_86fe_4276c9a7467a.slice/crio-ff9a316517f41bcc13f46d5953bfce4a5259d1e89f30fe0c03dbd8c6c077c90f WatchSource:0}: Error finding container ff9a316517f41bcc13f46d5953bfce4a5259d1e89f30fe0c03dbd8c6c077c90f: Status 404 returned error can't find the container with id ff9a316517f41bcc13f46d5953bfce4a5259d1e89f30fe0c03dbd8c6c077c90f
Sep 08 14:16:41.258148 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.258127    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2m9dd"
Sep 08 14:16:41.258608 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:41.258589    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f38441_5795_4fdd_ba8f_45c6a6a1776f.slice/crio-c87a43d936a26aff7861164fd71ea49e7c5fa14dde4d9bbbff9c52adcddc544d WatchSource:0}: Error finding container c87a43d936a26aff7861164fd71ea49e7c5fa14dde4d9bbbff9c52adcddc544d: Status 404 returned error can't find the container with id c87a43d936a26aff7861164fd71ea49e7c5fa14dde4d9bbbff9c52adcddc544d
Sep 08 14:16:41.262671 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.262652    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s8jwt"
Sep 08 14:16:41.265247 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:41.265230    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde9e505_47fa_40ac_872c_cbd86b1fcf6e.slice/crio-941c3cd7b542e60a077e900ce71bc8aa0dff86b3817578a63d98caf32c16c0ed WatchSource:0}: Error finding container 941c3cd7b542e60a077e900ce71bc8aa0dff86b3817578a63d98caf32c16c0ed: Status 404 returned error can't find the container with id 941c3cd7b542e60a077e900ce71bc8aa0dff86b3817578a63d98caf32c16c0ed
Sep 08 14:16:41.266372 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.266354    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9dfbq"
Sep 08 14:16:41.270492 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:41.270469    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75982462_3b1d_40d0_bf77_f59fd69ac4cf.slice/crio-d022d52985515d2b3ebcc58877283133d3a9d9e1ff1db0946006d4ae91f8f37c WatchSource:0}: Error finding container d022d52985515d2b3ebcc58877283133d3a9d9e1ff1db0946006d4ae91f8f37c: Status 404 returned error can't find the container with id d022d52985515d2b3ebcc58877283133d3a9d9e1ff1db0946006d4ae91f8f37c
Sep 08 14:16:41.273325 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:41.273304    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a84aaf4_f043_431c_8168_0185682c8629.slice/crio-a9cb82d6b23d73a911424c84b7169e83c41b26aefe7b7a2b3ec1136d1d70b68d WatchSource:0}: Error finding container a9cb82d6b23d73a911424c84b7169e83c41b26aefe7b7a2b3ec1136d1d70b68d: Status 404 returned error can't find the container with id a9cb82d6b23d73a911424c84b7169e83c41b26aefe7b7a2b3ec1136d1d70b68d
Sep 08 14:16:41.420022 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.419927    2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:16:41.539848 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.539752    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:41.540007 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.539929    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:16:41.540007 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.540003    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret podName:3bc9c240-9b7e-45bf-99d5-849d87a774da nodeName:}" failed. No retries permitted until 2026-09-08 14:16:42.539982766 +0000 UTC m=+3.935932194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret") pod "global-pull-secret-syncer-k6dcv" (UID: "3bc9c240-9b7e-45bf-99d5-849d87a774da") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:16:41.612368 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:16:41.612328    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7d50ebd78415dd81a944a4e21070c2.slice/crio-732046a55437ae68fa26cb96ebb82b6df5955e32a30fbb9debbf3f3826232460 WatchSource:0}: Error finding container 732046a55437ae68fa26cb96ebb82b6df5955e32a30fbb9debbf3f3826232460: Status 404 returned error can't find the container with id 732046a55437ae68fa26cb96ebb82b6df5955e32a30fbb9debbf3f3826232460
Sep 08 14:16:41.640720 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.640695    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs\") pod \"network-metrics-daemon-x8tbj\" (UID: \"5f09cf98-dd58-4ed2-a064-4d078539840b\") " pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:41.640866 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.640845    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:16:41.640934 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.640918    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs podName:5f09cf98-dd58-4ed2-a064-4d078539840b nodeName:}" failed. No retries permitted until 2026-09-08 14:16:42.640897415 +0000 UTC m=+4.036846831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs") pod "network-metrics-daemon-x8tbj" (UID: "5f09cf98-dd58-4ed2-a064-4d078539840b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:16:41.741815 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.741771    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnz2\" (UniqueName: \"kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2\") pod \"network-check-target-26mk9\" (UID: \"0ea34c19-9fd2-45ab-a64d-f6d4052bcae7\") " pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:41.741975 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.741956    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:16:41.742024 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.741980    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:16:41.742024 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.741994    2564 projected.go:196] Error preparing data for projected volume kube-api-access-7gnz2 for pod openshift-network-diagnostics/network-check-target-26mk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:16:41.742115 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:41.742050    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2 podName:0ea34c19-9fd2-45ab-a64d-f6d4052bcae7 nodeName:}" failed. No retries permitted until 2026-09-08 14:16:42.742031894 +0000 UTC m=+4.137981317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gnz2" (UniqueName: "kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2") pod "network-check-target-26mk9" (UID: "0ea34c19-9fd2-45ab-a64d-f6d4052bcae7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:16:41.967158 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.967060    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 14:11:40 +0000 UTC" deadline="2028-02-05 04:03:45.337080976 +0000 UTC"
Sep 08 14:16:41.967158 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:41.967098    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12349h47m3.369987422s"
Sep 08 14:16:42.181041 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.180341    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:42.181041 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:42.180483    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:16:42.181041 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.180902    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:42.181041 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:42.180990    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:16:42.188791 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.188707    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal" event={"ID":"ee7d50ebd78415dd81a944a4e21070c2","Type":"ContainerStarted","Data":"732046a55437ae68fa26cb96ebb82b6df5955e32a30fbb9debbf3f3826232460"}
Sep 08 14:16:42.190226 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.190200    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9dfbq" event={"ID":"7a84aaf4-f043-431c-8168-0185682c8629","Type":"ContainerStarted","Data":"a9cb82d6b23d73a911424c84b7169e83c41b26aefe7b7a2b3ec1136d1d70b68d"}
Sep 08 14:16:42.193717 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.193644    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8jwt" event={"ID":"75982462-3b1d-40d0-bf77-f59fd69ac4cf","Type":"ContainerStarted","Data":"d022d52985515d2b3ebcc58877283133d3a9d9e1ff1db0946006d4ae91f8f37c"}
Sep 08 14:16:42.195762 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.195716    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g98xx" event={"ID":"d82c9c8d-bc21-43cf-99f4-1be094f66a89","Type":"ContainerStarted","Data":"97be83e3f4ae88b0ca493020ed298195d81169a141c26f659095b34e8b5cf530"}
Sep 08 14:16:42.198393 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.198333    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc" event={"ID":"42661186-579d-4652-ad16-764ddae21302","Type":"ContainerStarted","Data":"834e8841dabaf1e510f2ff6672402e216e857630d7541d3f94a17858c06b0321"}
Sep 08 14:16:42.200162 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.200120    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2m9dd" event={"ID":"cde9e505-47fa-40ac-872c-cbd86b1fcf6e","Type":"ContainerStarted","Data":"941c3cd7b542e60a077e900ce71bc8aa0dff86b3817578a63d98caf32c16c0ed"}
Sep 08 14:16:42.202423 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.202398    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5mbnm" event={"ID":"69f38441-5795-4fdd-ba8f-45c6a6a1776f","Type":"ContainerStarted","Data":"c87a43d936a26aff7861164fd71ea49e7c5fa14dde4d9bbbff9c52adcddc544d"}
Sep 08 14:16:42.207230 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.207207    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pw4zx" event={"ID":"2d8ba03c-1050-4ff4-86fe-4276c9a7467a","Type":"ContainerStarted","Data":"ff9a316517f41bcc13f46d5953bfce4a5259d1e89f30fe0c03dbd8c6c077c90f"}
Sep 08 14:16:42.209021 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.208994    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g" event={"ID":"6005a281-88ef-4c26-b69a-fd8d5381fa72","Type":"ContainerStarted","Data":"61d69704077144aaaa9623c17a81f964082a29b241e3d7d4173dcf5563cc4c23"}
Sep 08 14:16:42.210928 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.210872    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m9hl9" event={"ID":"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0","Type":"ContainerStarted","Data":"b2f2eff93183d1a38a28d93377071d86c27b4cee7ecfc56fd3afb8c35b8a992b"}
Sep 08 14:16:42.548018 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.547984    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:42.548205 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:42.548152    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:16:42.548264 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:42.548208    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret podName:3bc9c240-9b7e-45bf-99d5-849d87a774da nodeName:}" failed. No retries permitted until 2026-09-08 14:16:44.548190666 +0000 UTC m=+5.944140081 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret") pod "global-pull-secret-syncer-k6dcv" (UID: "3bc9c240-9b7e-45bf-99d5-849d87a774da") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:16:42.649081 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.649047    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs\") pod \"network-metrics-daemon-x8tbj\" (UID: \"5f09cf98-dd58-4ed2-a064-4d078539840b\") " pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:42.649238 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:42.649207    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:16:42.649309 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:42.649262    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs podName:5f09cf98-dd58-4ed2-a064-4d078539840b nodeName:}" failed. No retries permitted until 2026-09-08 14:16:44.649243583 +0000 UTC m=+6.045193016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs") pod "network-metrics-daemon-x8tbj" (UID: "5f09cf98-dd58-4ed2-a064-4d078539840b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:16:42.749389 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.749355    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnz2\" (UniqueName: \"kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2\") pod \"network-check-target-26mk9\" (UID: \"0ea34c19-9fd2-45ab-a64d-f6d4052bcae7\") " pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:42.749576 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:42.749561    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:16:42.749653 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:42.749581    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:16:42.749653 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:42.749593    2564 projected.go:196] Error preparing data for projected volume kube-api-access-7gnz2 for pod openshift-network-diagnostics/network-check-target-26mk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:16:42.749653 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:42.749646    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2 podName:0ea34c19-9fd2-45ab-a64d-f6d4052bcae7 nodeName:}" failed. No retries permitted until 2026-09-08 14:16:44.749629699 +0000 UTC m=+6.145579112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gnz2" (UniqueName: "kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2") pod "network-check-target-26mk9" (UID: "0ea34c19-9fd2-45ab-a64d-f6d4052bcae7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:16:42.894486 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.894395    2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 14:16:42.968301 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.968215    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 14:11:40 +0000 UTC" deadline="2028-02-08 12:19:27.591503085 +0000 UTC"
Sep 08 14:16:42.968301 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:42.968273    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12430h2m44.62323408s"
Sep 08 14:16:43.180556 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:43.180189    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:43.180556 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:43.180327    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:16:44.180473 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:44.180238    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:44.180942 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:44.180596    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:16:44.181620 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:44.181431    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:44.181914 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:44.181862    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:16:44.564640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:44.564020    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:44.564640 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:44.564186    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:16:44.564640 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:44.564257    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret podName:3bc9c240-9b7e-45bf-99d5-849d87a774da nodeName:}" failed. No retries permitted until 2026-09-08 14:16:48.564237691 +0000 UTC m=+9.960187122 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret") pod "global-pull-secret-syncer-k6dcv" (UID: "3bc9c240-9b7e-45bf-99d5-849d87a774da") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:16:44.664858 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:44.664823    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs\") pod \"network-metrics-daemon-x8tbj\" (UID: \"5f09cf98-dd58-4ed2-a064-4d078539840b\") " pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:44.665032 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:44.664984    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:16:44.665099 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:44.665054    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs podName:5f09cf98-dd58-4ed2-a064-4d078539840b nodeName:}" failed. No retries permitted until 2026-09-08 14:16:48.665035104 +0000 UTC m=+10.060984515 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs") pod "network-metrics-daemon-x8tbj" (UID: "5f09cf98-dd58-4ed2-a064-4d078539840b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:16:44.766141 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:44.766103    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnz2\" (UniqueName: \"kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2\") pod \"network-check-target-26mk9\" (UID: \"0ea34c19-9fd2-45ab-a64d-f6d4052bcae7\") " pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:44.766328 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:44.766268    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:16:44.766328 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:44.766292    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:16:44.766328 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:44.766304    2564 projected.go:196] Error preparing data for projected volume kube-api-access-7gnz2 for pod openshift-network-diagnostics/network-check-target-26mk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:16:44.766487 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:44.766368    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2 podName:0ea34c19-9fd2-45ab-a64d-f6d4052bcae7 nodeName:}" failed. No retries permitted until 2026-09-08 14:16:48.766350065 +0000 UTC m=+10.162299478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gnz2" (UniqueName: "kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2") pod "network-check-target-26mk9" (UID: "0ea34c19-9fd2-45ab-a64d-f6d4052bcae7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:16:45.182579 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:45.182070    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:45.182579 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:45.182213    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:16:46.179566 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:46.179524    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:46.179760 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:46.179663    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:16:46.180122 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:46.179930    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:46.180122 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:46.180051    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:16:47.180569 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:47.179986    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:47.180569 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:47.180135    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:16:48.180391 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:48.180308    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:48.180391 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:48.180333    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:48.180632 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:48.180460    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:16:48.180632 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:48.180534    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:16:48.598556 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:48.598458    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:48.598718 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:48.598611    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:16:48.598718 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:48.598675    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret podName:3bc9c240-9b7e-45bf-99d5-849d87a774da nodeName:}" failed. No retries permitted until 2026-09-08 14:16:56.598657045 +0000 UTC m=+17.994606458 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret") pod "global-pull-secret-syncer-k6dcv" (UID: "3bc9c240-9b7e-45bf-99d5-849d87a774da") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:16:48.699508 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:48.699459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs\") pod \"network-metrics-daemon-x8tbj\" (UID: \"5f09cf98-dd58-4ed2-a064-4d078539840b\") " pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:48.699686 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:48.699644    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:16:48.699750 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:48.699703    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs podName:5f09cf98-dd58-4ed2-a064-4d078539840b nodeName:}" failed. No retries permitted until 2026-09-08 14:16:56.699683692 +0000 UTC m=+18.095633117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs") pod "network-metrics-daemon-x8tbj" (UID: "5f09cf98-dd58-4ed2-a064-4d078539840b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:16:48.800654 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:48.800610    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnz2\" (UniqueName: \"kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2\") pod \"network-check-target-26mk9\" (UID: \"0ea34c19-9fd2-45ab-a64d-f6d4052bcae7\") " pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:48.800840 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:48.800712    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:16:48.800840 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:48.800734    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:16:48.800840 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:48.800746    2564 projected.go:196] Error preparing data for projected volume kube-api-access-7gnz2 for pod openshift-network-diagnostics/network-check-target-26mk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:16:48.800840 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:48.800800    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2 podName:0ea34c19-9fd2-45ab-a64d-f6d4052bcae7 nodeName:}" failed. No retries permitted until 2026-09-08 14:16:56.800782699 +0000 UTC m=+18.196732115 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gnz2" (UniqueName: "kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2") pod "network-check-target-26mk9" (UID: "0ea34c19-9fd2-45ab-a64d-f6d4052bcae7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:16:49.181246 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:49.180844    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:49.181246 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:49.180963    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:16:50.179557 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:50.179525    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:50.179739 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:50.179524    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:50.179739 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:50.179651    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:16:50.179739 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:50.179732    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:16:51.179945 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:51.179905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:51.180377 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:51.180084    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:16:52.179538 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:52.179505    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:52.179738 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:52.179512    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:52.179738 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:52.179623    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:16:52.179738 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:52.179700    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:16:53.180071 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:53.180041    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:53.180470 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:53.180178    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:16:54.179793 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:54.179759    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:54.179988 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:54.179759    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:54.179988 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:54.179877    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:16:54.179988 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:54.179966    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:16:55.180572 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:55.180548    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:55.180901 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:55.180675    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:16:56.180528 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:56.180474    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:56.180528 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:56.180524    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:56.181081 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:56.180631    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:16:56.181081 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:56.180786    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:16:56.655064 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:56.654975    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:56.655262 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:56.655139    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:16:56.655262 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:56.655205    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret podName:3bc9c240-9b7e-45bf-99d5-849d87a774da nodeName:}" failed. No retries permitted until 2026-09-08 14:17:12.655185191 +0000 UTC m=+34.051134621 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret") pod "global-pull-secret-syncer-k6dcv" (UID: "3bc9c240-9b7e-45bf-99d5-849d87a774da") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:16:56.755818 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:56.755775    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs\") pod \"network-metrics-daemon-x8tbj\" (UID: \"5f09cf98-dd58-4ed2-a064-4d078539840b\") " pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:56.756056 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:56.755975    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:16:56.756056 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:56.756053    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs podName:5f09cf98-dd58-4ed2-a064-4d078539840b nodeName:}" failed. No retries permitted until 2026-09-08 14:17:12.75603188 +0000 UTC m=+34.151981290 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs") pod "network-metrics-daemon-x8tbj" (UID: "5f09cf98-dd58-4ed2-a064-4d078539840b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:16:56.856136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:56.856097    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnz2\" (UniqueName: \"kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2\") pod \"network-check-target-26mk9\" (UID: \"0ea34c19-9fd2-45ab-a64d-f6d4052bcae7\") " pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:56.856304 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:56.856288    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:16:56.856359 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:56.856310    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:16:56.856359 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:56.856337    2564 projected.go:196] Error preparing data for projected volume kube-api-access-7gnz2 for pod openshift-network-diagnostics/network-check-target-26mk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:16:56.856554 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:56.856394    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2 podName:0ea34c19-9fd2-45ab-a64d-f6d4052bcae7 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:12.856376567 +0000 UTC m=+34.252325995 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gnz2" (UniqueName: "kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2") pod "network-check-target-26mk9" (UID: "0ea34c19-9fd2-45ab-a64d-f6d4052bcae7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:16:57.179929 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:57.179883    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:57.180092 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:57.180042    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:16:58.179672 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:58.179636    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:16:58.180269 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:58.179636    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:16:58.180269 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:58.179834    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:16:58.180269 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:58.179936    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:16:59.180103 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:16:59.180076    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:16:59.180428 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:16:59.180164    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:17:00.180265 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.179975    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:17:00.180910 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.179975    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:17:00.180910 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:00.180336    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:17:00.180910 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:00.180422    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:17:00.256801 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.256705    2564 generic.go:356] "Generic (PLEG): container finished" podID="75982462-3b1d-40d0-bf77-f59fd69ac4cf" containerID="0b5fc42c8b5a4dc2a302728a4a84330be85c2ec58b121a0dcd49ad36ca218904" exitCode=0
Sep 08 14:17:00.256801 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.256789    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8jwt" event={"ID":"75982462-3b1d-40d0-bf77-f59fd69ac4cf","Type":"ContainerDied","Data":"0b5fc42c8b5a4dc2a302728a4a84330be85c2ec58b121a0dcd49ad36ca218904"}
Sep 08 14:17:00.258451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.258417    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc" event={"ID":"42661186-579d-4652-ad16-764ddae21302","Type":"ContainerStarted","Data":"bba700c015fcc6c5e28a1789710b6c29add50fa3a4b9417a022752f313af080e"}
Sep 08 14:17:00.260013 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.259954    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2m9dd" event={"ID":"cde9e505-47fa-40ac-872c-cbd86b1fcf6e","Type":"ContainerStarted","Data":"4669399cc8ea376a3a608af8222cc38ad3b516ee5d0a093caab6a099b4978148"}
Sep 08 14:17:00.261471 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.261448    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5mbnm" event={"ID":"69f38441-5795-4fdd-ba8f-45c6a6a1776f","Type":"ContainerStarted","Data":"0b08fd5bf03192c883d351036186333ce246ebdaacda08f00f2bbe9079fd458a"}
Sep 08 14:17:00.263161 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.263141    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pw4zx" event={"ID":"2d8ba03c-1050-4ff4-86fe-4276c9a7467a","Type":"ContainerStarted","Data":"ff76256c2689637d9dd6663727adc983873528e65e2d249c9e05681c593e4b2d"}
Sep 08 14:17:00.265976 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.265959    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g" event={"ID":"6005a281-88ef-4c26-b69a-fd8d5381fa72","Type":"ContainerStarted","Data":"dec9a020b2d89f74db7edab83520855b021fd96d9970b7988e1c032a9a4eca26"}
Sep 08 14:17:00.266057 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.266008    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g" event={"ID":"6005a281-88ef-4c26-b69a-fd8d5381fa72","Type":"ContainerStarted","Data":"8cb8aacd93ef163cdd757195553d33c453ac222b76656667d07dfab279dbff77"}
Sep 08 14:17:00.266057 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.266037    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g" event={"ID":"6005a281-88ef-4c26-b69a-fd8d5381fa72","Type":"ContainerStarted","Data":"e46125c4742a897f59537d505a7a36fdc85066ad0bc606ec97c4e10cbafc6e5c"}
Sep 08 14:17:00.266133 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.266064    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g" event={"ID":"6005a281-88ef-4c26-b69a-fd8d5381fa72","Type":"ContainerStarted","Data":"f23c1ef81b891b65a5538329a2da12d114211b7bb040f6d126c7b70679c5c507"}
Sep 08 14:17:00.266133 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.266091    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g" event={"ID":"6005a281-88ef-4c26-b69a-fd8d5381fa72","Type":"ContainerStarted","Data":"5bee2c971cf8a75c75d210d2e37c995e6968d5185fe8fb1ae8ff799f95867a4b"}
Sep 08 14:17:00.266133 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.266119    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g" event={"ID":"6005a281-88ef-4c26-b69a-fd8d5381fa72","Type":"ContainerStarted","Data":"06ad39889363d479a005a4ef1c494489448cbcfae1390bc1e0a4dc46564dd559"}
Sep 08 14:17:00.267283 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.267265    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m9hl9" event={"ID":"c3a63a23-7b6f-4bc2-a0a4-1e3056f019f0","Type":"ContainerStarted","Data":"b3e94e7d487b35b25ae59593dd68539a83af59b1bffae58d35ca763efd24351c"}
Sep 08 14:17:00.268609 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.268590    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal" event={"ID":"8b6dddcb8c682c982b23c18df04e5a1a","Type":"ContainerStarted","Data":"9ddc8fce81ed40851e7610dda35bfc9aabc891bfbf0eba77af96e347a9ba5d0a"}
Sep 08 14:17:00.269906 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.269884    2564 generic.go:356] "Generic (PLEG): container finished" podID="ee7d50ebd78415dd81a944a4e21070c2" containerID="0509d62e6a05bf1311899b7f9d0d91a0c12647caa22ac974f0336be261a2a8b6" exitCode=0
Sep 08 14:17:00.269976 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.269945    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal" event={"ID":"ee7d50ebd78415dd81a944a4e21070c2","Type":"ContainerDied","Data":"0509d62e6a05bf1311899b7f9d0d91a0c12647caa22ac974f0336be261a2a8b6"}
Sep 08 14:17:00.271176 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.271156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9dfbq" event={"ID":"7a84aaf4-f043-431c-8168-0185682c8629","Type":"ContainerStarted","Data":"7e15fe96b8ab8897fa1621ff5b09256467d430caa19150118894b03c5186f456"}
Sep 08 14:17:00.293934 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.293880    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2m9dd" podStartSLOduration=11.047787593 podStartE2EDuration="21.293861978s" totalImagesPullingTime="10.246074385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:00.293485893 +0000 UTC m=+21.689435328" watchObservedRunningTime="2026-09-08 14:17:00.293861978 +0000 UTC m=+21.689811414"
Sep 08 14:17:00.307519 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.307365    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-123.ec2.internal" podStartSLOduration=20.307347997 podStartE2EDuration="20.307347997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:00.307322233 +0000 UTC m=+21.703271666" watchObservedRunningTime="2026-09-08 14:17:00.307347997 +0000 UTC m=+21.703297430"
Sep 08 14:17:00.325190 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.324795    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m9hl9" podStartSLOduration=3.781165255 podStartE2EDuration="21.324776995s" totalImagesPullingTime="17.54361174s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:00.324166455 +0000 UTC m=+21.720115888" watchObservedRunningTime="2026-09-08 14:17:00.324776995 +0000 UTC m=+21.720726429"
Sep 08 14:17:00.340063 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.340025    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9dfbq" podStartSLOduration=3.441143158 podStartE2EDuration="21.34001047s" totalImagesPullingTime="17.898867312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:00.339738746 +0000 UTC m=+21.735688179" watchObservedRunningTime="2026-09-08 14:17:00.34001047 +0000 UTC m=+21.735959901"
Sep 08 14:17:00.382211 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.382156    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pw4zx" podStartSLOduration=3.46522033 podStartE2EDuration="21.382134911s" totalImagesPullingTime="17.916914581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:00.381602617 +0000 UTC m=+21.777552052" watchObservedRunningTime="2026-09-08 14:17:00.382134911 +0000 UTC m=+21.778084343"
Sep 08 14:17:00.400571 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.400514    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5mbnm" podStartSLOduration=3.295564071 podStartE2EDuration="21.400473374s" totalImagesPullingTime="18.104909303s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:00.39971112 +0000 UTC m=+21.795660551" watchObservedRunningTime="2026-09-08 14:17:00.400473374 +0000 UTC m=+21.796422806"
Sep 08 14:17:00.725317 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.725297    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 14:17:00.975090 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.974944    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T14:17:00.725312879Z","UUID":"ed3cb11c-d77f-411d-bd43-6230c43cbf25","Handler":null,"Name":"","Endpoint":""}
Sep 08 14:17:00.977417 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.977393    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 14:17:00.977550 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:00.977427    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 14:17:01.179672 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:01.179629    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:17:01.179930 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:01.179766    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:17:01.275334 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:01.275248    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal" event={"ID":"ee7d50ebd78415dd81a944a4e21070c2","Type":"ContainerStarted","Data":"63cdf69fc0828ee7f965b25f89ed95fe6d1f1d04248d856f1285de6deec65f05"}
Sep 08 14:17:01.276907 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:01.276880    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-g98xx" event={"ID":"d82c9c8d-bc21-43cf-99f4-1be094f66a89","Type":"ContainerStarted","Data":"c31badb5fd37ce4e0211f8c3568add6c71698c40c5d090e84e6eb479164452fd"}
Sep 08 14:17:01.279009 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:01.278986    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc" event={"ID":"42661186-579d-4652-ad16-764ddae21302","Type":"ContainerStarted","Data":"983586dfffeecf3d8ebd3f3efe31d3520f7d281cd98c086e967ba04774903e44"}
Sep 08 14:17:01.292403 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:01.292357    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-123.ec2.internal" podStartSLOduration=21.292338678 podStartE2EDuration="21.292338678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:01.291932846 +0000 UTC m=+22.687882277" watchObservedRunningTime="2026-09-08 14:17:01.292338678 +0000 UTC m=+22.688288110"
Sep 08 14:17:01.306254 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:01.306210    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-g98xx" podStartSLOduration=12.040988551 podStartE2EDuration="22.306188585s" totalImagesPullingTime="10.265200034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:01.306061157 +0000 UTC m=+22.702010601" watchObservedRunningTime="2026-09-08 14:17:01.306188585 +0000 UTC m=+22.702138020"
Sep 08 14:17:02.180527 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:02.180428    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:17:02.180527 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:02.180443    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:17:02.180864 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:02.180561    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:17:02.180864 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:02.180626    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:17:02.284366 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:02.284329    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc" event={"ID":"42661186-579d-4652-ad16-764ddae21302","Type":"ContainerStarted","Data":"46c3424838a560ebfeba88c2f92565e4c69d618c2814cf029174b04e4573a18b"}
Sep 08 14:17:02.288525 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:02.288472    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g" event={"ID":"6005a281-88ef-4c26-b69a-fd8d5381fa72","Type":"ContainerStarted","Data":"80665368c1b10491f3f856c63c5b9ddd7c76012e1b4afd9732d8ab7ef6960ba5"}
Sep 08 14:17:02.902888 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:02.902690    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pw4zx"
Sep 08 14:17:02.903327 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:02.903299    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pw4zx"
Sep 08 14:17:02.919033 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:02.918979    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-87jcc" podStartSLOduration=4.279544935 podStartE2EDuration="23.9189595s" totalImagesPullingTime="19.639414565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:16:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:02.302622686 +0000 UTC m=+23.698572119" watchObservedRunningTime="2026-09-08 14:17:02.9189595 +0000 UTC m=+24.314908933"
Sep 08 14:17:03.179988 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:03.179904    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:17:03.180158 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:03.180058    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:17:04.180198 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:04.180159    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:17:04.180668 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:04.180159    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:17:04.180668 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:04.180291    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:17:04.180668 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:04.180362    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:17:05.180214 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:05.180179    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:17:05.180644 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:05.180324    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:17:05.188165 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:05.188140    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pw4zx"
Sep 08 14:17:05.188315 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:05.188241    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 14:17:05.188716 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:05.188692    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pw4zx"
Sep 08 14:17:06.180719 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:06.180482    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:17:06.181162 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:06.180482    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:17:06.181162 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:06.180774    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:17:06.181162 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:06.180832    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:17:06.300022 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:06.299993    2564 generic.go:356] "Generic (PLEG): container finished" podID="75982462-3b1d-40d0-bf77-f59fd69ac4cf" containerID="dde0e1f3b079ca96d52c93b34214f049c802736e8046ce44bdaf5cac3059ab73" exitCode=0
Sep 08 14:17:06.300226 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:06.300074    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8jwt" event={"ID":"75982462-3b1d-40d0-bf77-f59fd69ac4cf","Type":"ContainerDied","Data":"dde0e1f3b079ca96d52c93b34214f049c802736e8046ce44bdaf5cac3059ab73"}
Sep 08 14:17:06.303966 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:06.303943    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g" event={"ID":"6005a281-88ef-4c26-b69a-fd8d5381fa72","Type":"ContainerStarted","Data":"406d27393f3d5531cf8ef34f255ae9dcac4751a95cb2328d146fdcddaa28091c"}
Sep 08 14:17:06.304274 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:06.304257    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:17:06.319116 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:06.319092    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:17:06.346441 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:06.346395    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g" podStartSLOduration=9.410489255 podStartE2EDuration="27.346381104s" totalImagesPullingTime="17.935891849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:06.346368059 +0000 UTC m=+27.742317492" watchObservedRunningTime="2026-09-08 14:17:06.346381104 +0000 UTC m=+27.742330535"
Sep 08 14:17:07.179721 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:07.179693    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:17:07.179913 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:07.179818    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:17:07.306712 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:07.306687    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 14:17:07.307332 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:07.307139    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:17:07.324914 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:07.324887    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:17:07.399731 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:07.399545    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k6dcv"]
Sep 08 14:17:07.399731 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:07.399724    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:17:07.400431 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:07.399859    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:17:07.400431 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:07.400126    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x8tbj"]
Sep 08 14:17:07.400431 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:07.400223    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:17:07.400431 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:07.400327    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:17:07.400782 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:07.400762    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-26mk9"]
Sep 08 14:17:07.400866 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:07.400855    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:17:07.400951 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:07.400934    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:17:08.313634 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:08.313602    2564 generic.go:356] "Generic (PLEG): container finished" podID="75982462-3b1d-40d0-bf77-f59fd69ac4cf" containerID="49a2329a73223eb13208c04315fe4392caaab15ff6959d81b32d1aa8c6bb498c" exitCode=0
Sep 08 14:17:08.314058 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:08.313706    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8jwt" event={"ID":"75982462-3b1d-40d0-bf77-f59fd69ac4cf","Type":"ContainerDied","Data":"49a2329a73223eb13208c04315fe4392caaab15ff6959d81b32d1aa8c6bb498c"}
Sep 08 14:17:08.314058 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:08.313740    2564 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 08 14:17:08.995487 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:08.995199    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:17:09.180474 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:09.180441    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:17:09.180650 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:09.180555    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:17:09.180704 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:09.180654    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:17:09.180779 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:09.180760    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:17:09.180827 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:09.180814    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:17:09.180904 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:09.180889    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:17:10.320407 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:10.320330    2564 generic.go:356] "Generic (PLEG): container finished" podID="75982462-3b1d-40d0-bf77-f59fd69ac4cf" containerID="39343bd4015230d08bd8400c3a1753fb96ec32042f46dea5216fad16ea3460a5" exitCode=0
Sep 08 14:17:10.320812 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:10.320408    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8jwt" event={"ID":"75982462-3b1d-40d0-bf77-f59fd69ac4cf","Type":"ContainerDied","Data":"39343bd4015230d08bd8400c3a1753fb96ec32042f46dea5216fad16ea3460a5"}
Sep 08 14:17:10.331304 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:10.331269    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g" podUID="6005a281-88ef-4c26-b69a-fd8d5381fa72" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 08 14:17:11.179892 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.179854    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:17:11.180064 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.179854    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:17:11.180064 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:11.179967    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6dcv" podUID="3bc9c240-9b7e-45bf-99d5-849d87a774da"
Sep 08 14:17:11.180064 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.179860    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:17:11.180064 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:11.180044    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x8tbj" podUID="5f09cf98-dd58-4ed2-a064-4d078539840b"
Sep 08 14:17:11.180218 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:11.180127    2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26mk9" podUID="0ea34c19-9fd2-45ab-a64d-f6d4052bcae7"
Sep 08 14:17:11.760281 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.760255    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9dfbq_7a84aaf4-f043-431c-8168-0185682c8629/dns-node-resolver/0.log"
Sep 08 14:17:11.880749 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.880721    2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-123.ec2.internal" event="NodeReady"
Sep 08 14:17:11.880892 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.880841    2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 14:17:11.922387 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.922357    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l4xrf"]
Sep 08 14:17:11.924655 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.924634    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:11.925352 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.925332    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vxmhm"]
Sep 08 14:17:11.927154 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.927131    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 14:17:11.927154 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.927150    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 14:17:11.927297 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.927208    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rlxm6\""
Sep 08 14:17:11.927635 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.927621    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vxmhm"
Sep 08 14:17:11.929876 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.929858    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 14:17:11.930080 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.930064    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j8jbf\""
Sep 08 14:17:11.930138 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.930089    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 14:17:11.930356 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.930337    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 14:17:11.934925 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.934900    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l4xrf"]
Sep 08 14:17:11.937063 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.936990    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vxmhm"]
Sep 08 14:17:11.945621 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.945600    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ps4kz"]
Sep 08 14:17:11.948551 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.948536    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:11.951460 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.951214    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2wblk\""
Sep 08 14:17:11.951460 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.951230    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 14:17:11.951460 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.951342    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 14:17:11.951460 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.951372    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 14:17:11.951460 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.951402    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 14:17:11.958936 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:11.958915    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ps4kz"]
Sep 08 14:17:12.065866 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.065786    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcfgh\" (UniqueName: \"kubernetes.io/projected/ccc79fe4-b61c-4a96-a306-f371aa83d1d7-kube-api-access-vcfgh\") pod \"ingress-canary-vxmhm\" (UID: \"ccc79fe4-b61c-4a96-a306-f371aa83d1d7\") " pod="openshift-ingress-canary/ingress-canary-vxmhm"
Sep 08 14:17:12.065866 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.065818    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/14da3a92-34a6-44df-8b9f-0ee434f57b63-data-volume\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.065866 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.065844    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.066130 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.065885    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdhmt\" (UniqueName: \"kubernetes.io/projected/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-api-access-pdhmt\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.066130 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.065956    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51679112-0b12-469e-9d04-a6c495691a27-config-volume\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:12.066130 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.065993    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:12.066130 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.066018    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51679112-0b12-469e-9d04-a6c495691a27-tmp-dir\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:12.066130 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.066041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.066130 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.066091    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lff5p\" (UniqueName: \"kubernetes.io/projected/51679112-0b12-469e-9d04-a6c495691a27-kube-api-access-lff5p\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:12.066130 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.066125    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/14da3a92-34a6-44df-8b9f-0ee434f57b63-crio-socket\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.066363 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.066158    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccc79fe4-b61c-4a96-a306-f371aa83d1d7-cert\") pod \"ingress-canary-vxmhm\" (UID: \"ccc79fe4-b61c-4a96-a306-f371aa83d1d7\") " pod="openshift-ingress-canary/ingress-canary-vxmhm"
Sep 08 14:17:12.166894 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.166854    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51679112-0b12-469e-9d04-a6c495691a27-config-volume\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:12.166894 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.166892    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:12.167149 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.166910    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51679112-0b12-469e-9d04-a6c495691a27-tmp-dir\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:12.167149 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.166926    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.167149 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.166968    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lff5p\" (UniqueName: \"kubernetes.io/projected/51679112-0b12-469e-9d04-a6c495691a27-kube-api-access-lff5p\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:12.167149 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.166998    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/14da3a92-34a6-44df-8b9f-0ee434f57b63-crio-socket\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.167149 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.167018    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:17:12.167149 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.167030    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccc79fe4-b61c-4a96-a306-f371aa83d1d7-cert\") pod \"ingress-canary-vxmhm\" (UID: \"ccc79fe4-b61c-4a96-a306-f371aa83d1d7\") " pod="openshift-ingress-canary/ingress-canary-vxmhm"
Sep 08 14:17:12.167149 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.167040    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:17:12.167149 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.167057    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcfgh\" (UniqueName: \"kubernetes.io/projected/ccc79fe4-b61c-4a96-a306-f371aa83d1d7-kube-api-access-vcfgh\") pod \"ingress-canary-vxmhm\" (UID: \"ccc79fe4-b61c-4a96-a306-f371aa83d1d7\") " pod="openshift-ingress-canary/ingress-canary-vxmhm"
Sep 08 14:17:12.167149 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.167085    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/14da3a92-34a6-44df-8b9f-0ee434f57b63-data-volume\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.167149 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.167100    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls podName:51679112-0b12-469e-9d04-a6c495691a27 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:12.667077701 +0000 UTC m=+34.063027128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls") pod "dns-default-l4xrf" (UID: "51679112-0b12-469e-9d04-a6c495691a27") : secret "dns-default-metrics-tls" not found
Sep 08 14:17:12.167640 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.167216    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls podName:14da3a92-34a6-44df-8b9f-0ee434f57b63 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:12.667203569 +0000 UTC m=+34.063152984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ps4kz" (UID: "14da3a92-34a6-44df-8b9f-0ee434f57b63") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:17:12.167640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.167236    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/14da3a92-34a6-44df-8b9f-0ee434f57b63-crio-socket\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.167640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.167246    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.167640 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.167292    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:17:12.167640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.167310    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdhmt\" (UniqueName: \"kubernetes.io/projected/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-api-access-pdhmt\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.167640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.167339    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51679112-0b12-469e-9d04-a6c495691a27-tmp-dir\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:12.167640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.167363    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/14da3a92-34a6-44df-8b9f-0ee434f57b63-data-volume\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.167640 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.167387    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm podName:14da3a92-34a6-44df-8b9f-0ee434f57b63 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:12.667369325 +0000 UTC m=+34.063318747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ps4kz" (UID: "14da3a92-34a6-44df-8b9f-0ee434f57b63") : configmap "kube-rbac-proxy" not found
Sep 08 14:17:12.167640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.167575    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51679112-0b12-469e-9d04-a6c495691a27-config-volume\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:12.171210 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.171191    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ccc79fe4-b61c-4a96-a306-f371aa83d1d7-cert\") pod \"ingress-canary-vxmhm\" (UID: \"ccc79fe4-b61c-4a96-a306-f371aa83d1d7\") " pod="openshift-ingress-canary/ingress-canary-vxmhm"
Sep 08 14:17:12.176005 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.175978    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lff5p\" (UniqueName: \"kubernetes.io/projected/51679112-0b12-469e-9d04-a6c495691a27-kube-api-access-lff5p\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:12.176091 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.176034    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdhmt\" (UniqueName: \"kubernetes.io/projected/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-api-access-pdhmt\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.176273 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.176256    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcfgh\" (UniqueName: \"kubernetes.io/projected/ccc79fe4-b61c-4a96-a306-f371aa83d1d7-kube-api-access-vcfgh\") pod \"ingress-canary-vxmhm\" (UID: \"ccc79fe4-b61c-4a96-a306-f371aa83d1d7\") " pod="openshift-ingress-canary/ingress-canary-vxmhm"
Sep 08 14:17:12.241581 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.241547    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vxmhm"
Sep 08 14:17:12.528882 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.528808    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vxmhm"]
Sep 08 14:17:12.532558 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:17:12.532534    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc79fe4_b61c_4a96_a306_f371aa83d1d7.slice/crio-9990a62e05d5f762f31237acfd8a7bdc4b95b01fdcf6812488c1bebbbfc2ab0d WatchSource:0}: Error finding container 9990a62e05d5f762f31237acfd8a7bdc4b95b01fdcf6812488c1bebbbfc2ab0d: Status 404 returned error can't find the container with id 9990a62e05d5f762f31237acfd8a7bdc4b95b01fdcf6812488c1bebbbfc2ab0d
Sep 08 14:17:12.672404 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.672186    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:12.672597 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.672431    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.672597 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.672459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:17:12.672597 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.672353    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:17:12.672597 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.672534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:12.672597 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.672578    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls podName:51679112-0b12-469e-9d04-a6c495691a27 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:13.6725507 +0000 UTC m=+35.068500124 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls") pod "dns-default-l4xrf" (UID: "51679112-0b12-469e-9d04-a6c495691a27") : secret "dns-default-metrics-tls" not found
Sep 08 14:17:12.672832 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.672611    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:17:12.672832 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.672580    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:17:12.672832 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.672667    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm podName:14da3a92-34a6-44df-8b9f-0ee434f57b63 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:13.67265289 +0000 UTC m=+35.068602316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ps4kz" (UID: "14da3a92-34a6-44df-8b9f-0ee434f57b63") : configmap "kube-rbac-proxy" not found
Sep 08 14:17:12.672832 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.672665    2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 14:17:12.672832 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.672700    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret podName:3bc9c240-9b7e-45bf-99d5-849d87a774da nodeName:}" failed. No retries permitted until 2026-09-08 14:17:44.672690858 +0000 UTC m=+66.068640268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret") pod "global-pull-secret-syncer-k6dcv" (UID: "3bc9c240-9b7e-45bf-99d5-849d87a774da") : object "kube-system"/"original-pull-secret" not registered
Sep 08 14:17:12.672832 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.672717    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls podName:14da3a92-34a6-44df-8b9f-0ee434f57b63 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:13.672708045 +0000 UTC m=+35.068657461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ps4kz" (UID: "14da3a92-34a6-44df-8b9f-0ee434f57b63") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:17:12.746690 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.746656    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2m9dd_cde9e505-47fa-40ac-872c-cbd86b1fcf6e/node-ca/0.log"
Sep 08 14:17:12.774004 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.773970    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs\") pod \"network-metrics-daemon-x8tbj\" (UID: \"5f09cf98-dd58-4ed2-a064-4d078539840b\") " pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:17:12.774427 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.774116    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:17:12.774427 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.774186    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs podName:5f09cf98-dd58-4ed2-a064-4d078539840b nodeName:}" failed. No retries permitted until 2026-09-08 14:17:44.774169037 +0000 UTC m=+66.170118469 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs") pod "network-metrics-daemon-x8tbj" (UID: "5f09cf98-dd58-4ed2-a064-4d078539840b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 14:17:12.874819 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:12.874728    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnz2\" (UniqueName: \"kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2\") pod \"network-check-target-26mk9\" (UID: \"0ea34c19-9fd2-45ab-a64d-f6d4052bcae7\") " pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:17:12.874957 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.874902    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 14:17:12.874957 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.874921    2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 14:17:12.874957 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.874931    2564 projected.go:196] Error preparing data for projected volume kube-api-access-7gnz2 for pod openshift-network-diagnostics/network-check-target-26mk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:17:12.875083 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:12.875004    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2 podName:0ea34c19-9fd2-45ab-a64d-f6d4052bcae7 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:44.874985349 +0000 UTC m=+66.270934759 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7gnz2" (UniqueName: "kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2") pod "network-check-target-26mk9" (UID: "0ea34c19-9fd2-45ab-a64d-f6d4052bcae7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 14:17:13.165052 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.164978    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-75d99c484-krf29"]
Sep 08 14:17:13.168389 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.168357    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-krf29"
Sep 08 14:17:13.172128 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.172105    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 08 14:17:13.172429 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.172405    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 08 14:17:13.173299 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.173281    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-hl2x4\""
Sep 08 14:17:13.173461 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.173441    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 08 14:17:13.173548 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.173513    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 08 14:17:13.183168 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.179806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:17:13.183168 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.180319    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:17:13.183168 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.180390    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:17:13.183168 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.183085    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zbnn7\""
Sep 08 14:17:13.183537 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.183307    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 14:17:13.183642 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.183619    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 14:17:13.183695 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.183683    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 14:17:13.183987 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.183969    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 14:17:13.184358 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.184335    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vvt7d\""
Sep 08 14:17:13.187758 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.187729    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-krf29"]
Sep 08 14:17:13.278737 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.278706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35c9ea97-cd6d-4f7e-ba4b-228fd7889d58-signing-key\") pod \"service-ca-75d99c484-krf29\" (UID: \"35c9ea97-cd6d-4f7e-ba4b-228fd7889d58\") " pod="openshift-service-ca/service-ca-75d99c484-krf29"
Sep 08 14:17:13.278918 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.278895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhxq4\" (UniqueName: \"kubernetes.io/projected/35c9ea97-cd6d-4f7e-ba4b-228fd7889d58-kube-api-access-jhxq4\") pod \"service-ca-75d99c484-krf29\" (UID: \"35c9ea97-cd6d-4f7e-ba4b-228fd7889d58\") " pod="openshift-service-ca/service-ca-75d99c484-krf29"
Sep 08 14:17:13.278978 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.278940    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35c9ea97-cd6d-4f7e-ba4b-228fd7889d58-signing-cabundle\") pod \"service-ca-75d99c484-krf29\" (UID: \"35c9ea97-cd6d-4f7e-ba4b-228fd7889d58\") " pod="openshift-service-ca/service-ca-75d99c484-krf29"
Sep 08 14:17:13.331155 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.331111    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vxmhm" event={"ID":"ccc79fe4-b61c-4a96-a306-f371aa83d1d7","Type":"ContainerStarted","Data":"9990a62e05d5f762f31237acfd8a7bdc4b95b01fdcf6812488c1bebbbfc2ab0d"}
Sep 08 14:17:13.379817 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.379766    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhxq4\" (UniqueName: \"kubernetes.io/projected/35c9ea97-cd6d-4f7e-ba4b-228fd7889d58-kube-api-access-jhxq4\") pod \"service-ca-75d99c484-krf29\" (UID: \"35c9ea97-cd6d-4f7e-ba4b-228fd7889d58\") " pod="openshift-service-ca/service-ca-75d99c484-krf29"
Sep 08 14:17:13.379997 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.379835    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35c9ea97-cd6d-4f7e-ba4b-228fd7889d58-signing-cabundle\") pod \"service-ca-75d99c484-krf29\" (UID: \"35c9ea97-cd6d-4f7e-ba4b-228fd7889d58\") " pod="openshift-service-ca/service-ca-75d99c484-krf29"
Sep 08 14:17:13.379997 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.379895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35c9ea97-cd6d-4f7e-ba4b-228fd7889d58-signing-key\") pod \"service-ca-75d99c484-krf29\" (UID: \"35c9ea97-cd6d-4f7e-ba4b-228fd7889d58\") " pod="openshift-service-ca/service-ca-75d99c484-krf29"
Sep 08 14:17:13.380646 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.380622    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/35c9ea97-cd6d-4f7e-ba4b-228fd7889d58-signing-cabundle\") pod \"service-ca-75d99c484-krf29\" (UID: \"35c9ea97-cd6d-4f7e-ba4b-228fd7889d58\") " pod="openshift-service-ca/service-ca-75d99c484-krf29"
Sep 08 14:17:13.383527 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.383484    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/35c9ea97-cd6d-4f7e-ba4b-228fd7889d58-signing-key\") pod \"service-ca-75d99c484-krf29\" (UID: \"35c9ea97-cd6d-4f7e-ba4b-228fd7889d58\") " pod="openshift-service-ca/service-ca-75d99c484-krf29"
Sep 08 14:17:13.389551 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.389473    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhxq4\" (UniqueName: \"kubernetes.io/projected/35c9ea97-cd6d-4f7e-ba4b-228fd7889d58-kube-api-access-jhxq4\") pod \"service-ca-75d99c484-krf29\" (UID: \"35c9ea97-cd6d-4f7e-ba4b-228fd7889d58\") " pod="openshift-service-ca/service-ca-75d99c484-krf29"
Sep 08 14:17:13.492741 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.492444    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-75d99c484-krf29"
Sep 08 14:17:13.682640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.682604    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:13.682640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.682651    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:13.682880 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.682728    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:13.682880 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:13.682773    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:17:13.682880 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:13.682797    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:17:13.682880 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:13.682816    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:17:13.682880 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:13.682855    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls podName:51679112-0b12-469e-9d04-a6c495691a27 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:15.682834752 +0000 UTC m=+37.078784165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls") pod "dns-default-l4xrf" (UID: "51679112-0b12-469e-9d04-a6c495691a27") : secret "dns-default-metrics-tls" not found
Sep 08 14:17:13.682880 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:13.682873    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm podName:14da3a92-34a6-44df-8b9f-0ee434f57b63 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:15.682864662 +0000 UTC m=+37.078814073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ps4kz" (UID: "14da3a92-34a6-44df-8b9f-0ee434f57b63") : configmap "kube-rbac-proxy" not found
Sep 08 14:17:13.683092 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:13.682891    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls podName:14da3a92-34a6-44df-8b9f-0ee434f57b63 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:15.682882868 +0000 UTC m=+37.078832278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ps4kz" (UID: "14da3a92-34a6-44df-8b9f-0ee434f57b63") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:17:13.774725 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:13.773907    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-75d99c484-krf29"]
Sep 08 14:17:13.780944 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:17:13.780910    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35c9ea97_cd6d_4f7e_ba4b_228fd7889d58.slice/crio-9943ce525bc41e2df925dfb4c34ffbe9b664354b6f512c842e041df8748425f9 WatchSource:0}: Error finding container 9943ce525bc41e2df925dfb4c34ffbe9b664354b6f512c842e041df8748425f9: Status 404 returned error can't find the container with id 9943ce525bc41e2df925dfb4c34ffbe9b664354b6f512c842e041df8748425f9
Sep 08 14:17:14.334740 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:14.334702    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-krf29" event={"ID":"35c9ea97-cd6d-4f7e-ba4b-228fd7889d58","Type":"ContainerStarted","Data":"9943ce525bc41e2df925dfb4c34ffbe9b664354b6f512c842e041df8748425f9"}
Sep 08 14:17:15.697673 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:15.697633    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:15.698244 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:15.697790    2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 14:17:15.698244 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:15.697844    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:15.698244 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:15.697865    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm podName:14da3a92-34a6-44df-8b9f-0ee434f57b63 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:19.697846879 +0000 UTC m=+41.093796313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ps4kz" (UID: "14da3a92-34a6-44df-8b9f-0ee434f57b63") : configmap "kube-rbac-proxy" not found
Sep 08 14:17:15.698244 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:15.697905    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:15.698244 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:15.697942    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:17:15.698244 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:15.697987    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls podName:51679112-0b12-469e-9d04-a6c495691a27 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:19.697972163 +0000 UTC m=+41.093921573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls") pod "dns-default-l4xrf" (UID: "51679112-0b12-469e-9d04-a6c495691a27") : secret "dns-default-metrics-tls" not found
Sep 08 14:17:15.698244 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:15.698029    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:17:15.698244 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:15.698074    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls podName:14da3a92-34a6-44df-8b9f-0ee434f57b63 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:19.698063125 +0000 UTC m=+41.094012535 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ps4kz" (UID: "14da3a92-34a6-44df-8b9f-0ee434f57b63") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:17:18.347700 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:18.347666    2564 generic.go:356] "Generic (PLEG): container finished" podID="75982462-3b1d-40d0-bf77-f59fd69ac4cf" containerID="501899da5385b2953e301fe8811abd5406c69e6332e2dce8e6f29e8be425170c" exitCode=0
Sep 08 14:17:18.348289 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:18.347756    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8jwt" event={"ID":"75982462-3b1d-40d0-bf77-f59fd69ac4cf","Type":"ContainerDied","Data":"501899da5385b2953e301fe8811abd5406c69e6332e2dce8e6f29e8be425170c"}
Sep 08 14:17:18.349315 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:18.349289    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vxmhm" event={"ID":"ccc79fe4-b61c-4a96-a306-f371aa83d1d7","Type":"ContainerStarted","Data":"a8301125ef397ecee9509ecda76e7dfe177d67451dd67b6b692e54d99db075fc"}
Sep 08 14:17:18.350907 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:18.350885    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-75d99c484-krf29" event={"ID":"35c9ea97-cd6d-4f7e-ba4b-228fd7889d58","Type":"ContainerStarted","Data":"e578ee55e2d525b1b6bfd9ce87e4a1943424e1ece46ea6651f796157a1b2e599"}
Sep 08 14:17:18.390773 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:18.390664    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vxmhm" podStartSLOduration=2.044143371 podStartE2EDuration="7.39064337s" totalImagesPullingTime="5.346499999s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:18.390578657 +0000 UTC m=+39.786528093" watchObservedRunningTime="2026-09-08 14:17:18.39064337 +0000 UTC m=+39.786592804"
Sep 08 14:17:18.406396 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:18.406338    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-75d99c484-krf29" podStartSLOduration=1.303553631 podStartE2EDuration="5.406315676s" totalImagesPullingTime="4.102762045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:17:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:18.405878259 +0000 UTC m=+39.801827693" watchObservedRunningTime="2026-09-08 14:17:18.406315676 +0000 UTC m=+39.802265111"
Sep 08 14:17:19.357204 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:19.357170    2564 generic.go:356] "Generic (PLEG): container finished" podID="75982462-3b1d-40d0-bf77-f59fd69ac4cf" containerID="cafa05082f3997a10dfeac06a0210d4f782742b796782e04d0b37134a9ed2cd2" exitCode=0
Sep 08 14:17:19.357700 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:19.357306    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8jwt" event={"ID":"75982462-3b1d-40d0-bf77-f59fd69ac4cf","Type":"ContainerDied","Data":"cafa05082f3997a10dfeac06a0210d4f782742b796782e04d0b37134a9ed2cd2"}
Sep 08 14:17:19.732939 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:19.732853    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:19.732939 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:19.732895    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:19.733172 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:19.732967    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:19.733172 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:19.733015    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 14:17:19.733172 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:19.733083    2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 14:17:19.733291 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:19.733090    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls podName:51679112-0b12-469e-9d04-a6c495691a27 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:27.73307211 +0000 UTC m=+49.129021533 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls") pod "dns-default-l4xrf" (UID: "51679112-0b12-469e-9d04-a6c495691a27") : secret "dns-default-metrics-tls" not found
Sep 08 14:17:19.733291 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:17:19.733217    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls podName:14da3a92-34a6-44df-8b9f-0ee434f57b63 nodeName:}" failed. No retries permitted until 2026-09-08 14:17:27.733197663 +0000 UTC m=+49.129147088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ps4kz" (UID: "14da3a92-34a6-44df-8b9f-0ee434f57b63") : secret "insights-runtime-extractor-tls" not found
Sep 08 14:17:19.733606 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:19.733588    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/14da3a92-34a6-44df-8b9f-0ee434f57b63-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:20.362825 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:20.362794    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s8jwt" event={"ID":"75982462-3b1d-40d0-bf77-f59fd69ac4cf","Type":"ContainerStarted","Data":"1078ad8f4ddee15bf3b2254804dce16e8b3a880444108eeca61127bacf3fae49"}
Sep 08 14:17:20.384630 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:20.384583    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s8jwt" podStartSLOduration=8.336478804 podStartE2EDuration="41.384568262s" totalImagesPullingTime="33.048089458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:16:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:20.383734233 +0000 UTC m=+41.779683665" watchObservedRunningTime="2026-09-08 14:17:20.384568262 +0000 UTC m=+41.780517691"
Sep 08 14:17:27.795644 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:27.795600    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:27.796073 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:27.795644    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:27.798222 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:27.798197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/14da3a92-34a6-44df-8b9f-0ee434f57b63-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ps4kz\" (UID: \"14da3a92-34a6-44df-8b9f-0ee434f57b63\") " pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:27.798339 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:27.798259    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51679112-0b12-469e-9d04-a6c495691a27-metrics-tls\") pod \"dns-default-l4xrf\" (UID: \"51679112-0b12-469e-9d04-a6c495691a27\") " pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:27.835914 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:27.835871    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:27.858069 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:27.858043    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ps4kz"
Sep 08 14:17:28.136200 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:28.136170    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l4xrf"]
Sep 08 14:17:28.139544 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:17:28.139518    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51679112_0b12_469e_9d04_a6c495691a27.slice/crio-62bdd3ccb44dc94cdc8e5802764519a136ad134e0da21fd715a0e81c6bfea4f1 WatchSource:0}: Error finding container 62bdd3ccb44dc94cdc8e5802764519a136ad134e0da21fd715a0e81c6bfea4f1: Status 404 returned error can't find the container with id 62bdd3ccb44dc94cdc8e5802764519a136ad134e0da21fd715a0e81c6bfea4f1
Sep 08 14:17:28.175441 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:28.175400    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ps4kz"]
Sep 08 14:17:28.178899 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:17:28.178867    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14da3a92_34a6_44df_8b9f_0ee434f57b63.slice/crio-3660ea5209a6a6473bf6a7759050618e5aafdac65d6d2f1f898b55784bcd36a8 WatchSource:0}: Error finding container 3660ea5209a6a6473bf6a7759050618e5aafdac65d6d2f1f898b55784bcd36a8: Status 404 returned error can't find the container with id 3660ea5209a6a6473bf6a7759050618e5aafdac65d6d2f1f898b55784bcd36a8
Sep 08 14:17:28.384427 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:28.384377    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l4xrf" event={"ID":"51679112-0b12-469e-9d04-a6c495691a27","Type":"ContainerStarted","Data":"62bdd3ccb44dc94cdc8e5802764519a136ad134e0da21fd715a0e81c6bfea4f1"}
Sep 08 14:17:28.385894 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:28.385870    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ps4kz" event={"ID":"14da3a92-34a6-44df-8b9f-0ee434f57b63","Type":"ContainerStarted","Data":"af830a5328bf8d9bc18a7e5ff31a91e83e8462e1fb3988e44a9fc5892a69ba58"}
Sep 08 14:17:28.386006 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:28.385918    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ps4kz" event={"ID":"14da3a92-34a6-44df-8b9f-0ee434f57b63","Type":"ContainerStarted","Data":"3660ea5209a6a6473bf6a7759050618e5aafdac65d6d2f1f898b55784bcd36a8"}
Sep 08 14:17:30.395822 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:30.395771    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ps4kz" event={"ID":"14da3a92-34a6-44df-8b9f-0ee434f57b63","Type":"ContainerStarted","Data":"44e4f405e0f78a1d37b75c9046f6a5e70be1f005679a338db81155c9527ce3ec"}
Sep 08 14:17:31.401367 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:31.401331    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ps4kz" event={"ID":"14da3a92-34a6-44df-8b9f-0ee434f57b63","Type":"ContainerStarted","Data":"d18f6db29cb4b5bbb122098f5699a4835b413c80332bc56d3f1b420672cc9a79"}
Sep 08 14:17:31.402940 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:31.402916    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l4xrf" event={"ID":"51679112-0b12-469e-9d04-a6c495691a27","Type":"ContainerStarted","Data":"00a9d7d98a7e3cefd57b9a6d35cdff3e1052e0ca5876a8c05521cfeda2712a57"}
Sep 08 14:17:31.403078 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:31.402955    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l4xrf" event={"ID":"51679112-0b12-469e-9d04-a6c495691a27","Type":"ContainerStarted","Data":"ef81b72711555b468a54c6822a4a07249f5dbf567c2a6bb3548a8e57b1f8547c"}
Sep 08 14:17:31.403078 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:31.403062    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:31.421571 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:31.421534    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ps4kz" podStartSLOduration=17.794796571 podStartE2EDuration="20.421521161s" totalImagesPullingTime="2.62672459s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:17:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:31.42095092 +0000 UTC m=+52.816900345" watchObservedRunningTime="2026-09-08 14:17:31.421521161 +0000 UTC m=+52.817470592"
Sep 08 14:17:32.997326 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:32.997249    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l4xrf" podStartSLOduration=19.102573638 podStartE2EDuration="21.997225858s" totalImagesPullingTime="2.89465222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:31.438142509 +0000 UTC m=+52.834091942" watchObservedRunningTime="2026-09-08 14:17:32.997225858 +0000 UTC m=+54.393175291"
Sep 08 14:17:32.997902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:32.997883    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf"]
Sep 08 14:17:32.999605 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:32.999586    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-zxrxw"]
Sep 08 14:17:32.999746 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:32.999727    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf"
Sep 08 14:17:33.001529 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.001508    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-zxrxw"
Sep 08 14:17:33.001617 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.001550    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"]
Sep 08 14:17:33.002975 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.002958    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 14:17:33.003050 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.002970    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 14:17:33.003050 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.003017    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-4wtcz\""
Sep 08 14:17:33.003412 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.003394    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 08 14:17:33.003412 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.003405    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.003412 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.003397    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 14:17:33.003999 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.003981    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-tc52d\""
Sep 08 14:17:33.004066 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.003981    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 14:17:33.004106 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.003982    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 14:17:33.007024 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.007003    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 08 14:17:33.007255 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.007239    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 08 14:17:33.007351 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.007332    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 08 14:17:33.007417 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.007334    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 08 14:17:33.010338 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.010319    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf"]
Sep 08 14:17:33.020826 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.020804    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-zxrxw"]
Sep 08 14:17:33.024704 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.024686    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"]
Sep 08 14:17:33.032015 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.031992    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1767f34-28dc-47f2-ab0a-207e43a760ce-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf\" (UID: \"c1767f34-28dc-47f2-ab0a-207e43a760ce\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf"
Sep 08 14:17:33.032104 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.032020    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c395323e-dffa-47b2-8ac8-5dfa660a0604-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.032104 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.032051    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c395323e-dffa-47b2-8ac8-5dfa660a0604-ca\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.032104 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.032074    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8njdq\" (UniqueName: \"kubernetes.io/projected/c395323e-dffa-47b2-8ac8-5dfa660a0604-kube-api-access-8njdq\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.032211 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.032138    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6qnb\" (UniqueName: \"kubernetes.io/projected/c1767f34-28dc-47f2-ab0a-207e43a760ce-kube-api-access-c6qnb\") pod \"managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf\" (UID: \"c1767f34-28dc-47f2-ab0a-207e43a760ce\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf"
Sep 08 14:17:33.032211 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.032169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c395323e-dffa-47b2-8ac8-5dfa660a0604-hub\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.032211 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.032187    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c395323e-dffa-47b2-8ac8-5dfa660a0604-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.032301 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.032259    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpn9m\" (UniqueName: \"kubernetes.io/projected/6f1fed1f-529e-45d0-a1e8-c8205629fb51-kube-api-access-xpn9m\") pod \"downloads-85d98c998f-zxrxw\" (UID: \"6f1fed1f-529e-45d0-a1e8-c8205629fb51\") " pod="openshift-console/downloads-85d98c998f-zxrxw"
Sep 08 14:17:33.032301 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.032287    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c395323e-dffa-47b2-8ac8-5dfa660a0604-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.133273 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.133242    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c395323e-dffa-47b2-8ac8-5dfa660a0604-hub\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.133273 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.133276    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c395323e-dffa-47b2-8ac8-5dfa660a0604-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.133463 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.133404    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpn9m\" (UniqueName: \"kubernetes.io/projected/6f1fed1f-529e-45d0-a1e8-c8205629fb51-kube-api-access-xpn9m\") pod \"downloads-85d98c998f-zxrxw\" (UID: \"6f1fed1f-529e-45d0-a1e8-c8205629fb51\") " pod="openshift-console/downloads-85d98c998f-zxrxw"
Sep 08 14:17:33.133463 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.133441    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c395323e-dffa-47b2-8ac8-5dfa660a0604-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.133674 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.133472    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1767f34-28dc-47f2-ab0a-207e43a760ce-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf\" (UID: \"c1767f34-28dc-47f2-ab0a-207e43a760ce\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf"
Sep 08 14:17:33.133674 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.133518    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c395323e-dffa-47b2-8ac8-5dfa660a0604-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.133674 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.133573    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c395323e-dffa-47b2-8ac8-5dfa660a0604-ca\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.133674 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.133597    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8njdq\" (UniqueName: \"kubernetes.io/projected/c395323e-dffa-47b2-8ac8-5dfa660a0604-kube-api-access-8njdq\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.133674 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.133646    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6qnb\" (UniqueName: \"kubernetes.io/projected/c1767f34-28dc-47f2-ab0a-207e43a760ce-kube-api-access-c6qnb\") pod \"managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf\" (UID: \"c1767f34-28dc-47f2-ab0a-207e43a760ce\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf"
Sep 08 14:17:33.134068 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.134045    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/c395323e-dffa-47b2-8ac8-5dfa660a0604-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.135904 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.135882    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/c395323e-dffa-47b2-8ac8-5dfa660a0604-hub\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.136005 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.135987    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/c395323e-dffa-47b2-8ac8-5dfa660a0604-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.136066 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.136044    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c1767f34-28dc-47f2-ab0a-207e43a760ce-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf\" (UID: \"c1767f34-28dc-47f2-ab0a-207e43a760ce\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf"
Sep 08 14:17:33.136170 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.136156    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/c395323e-dffa-47b2-8ac8-5dfa660a0604-ca\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.136220 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.136196    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c395323e-dffa-47b2-8ac8-5dfa660a0604-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.150374 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.150350    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6qnb\" (UniqueName: \"kubernetes.io/projected/c1767f34-28dc-47f2-ab0a-207e43a760ce-kube-api-access-c6qnb\") pod \"managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf\" (UID: \"c1767f34-28dc-47f2-ab0a-207e43a760ce\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf"
Sep 08 14:17:33.150601 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.150578    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpn9m\" (UniqueName: \"kubernetes.io/projected/6f1fed1f-529e-45d0-a1e8-c8205629fb51-kube-api-access-xpn9m\") pod \"downloads-85d98c998f-zxrxw\" (UID: \"6f1fed1f-529e-45d0-a1e8-c8205629fb51\") " pod="openshift-console/downloads-85d98c998f-zxrxw"
Sep 08 14:17:33.150674 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.150658    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8njdq\" (UniqueName: \"kubernetes.io/projected/c395323e-dffa-47b2-8ac8-5dfa660a0604-kube-api-access-8njdq\") pod \"cluster-proxy-proxy-agent-6cb659489c-mhgpg\" (UID: \"c395323e-dffa-47b2-8ac8-5dfa660a0604\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.318242 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.318164    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf"
Sep 08 14:17:33.325566 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.325546    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-zxrxw"
Sep 08 14:17:33.330288 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.330268    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"
Sep 08 14:17:33.594921 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.594891    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf"]
Sep 08 14:17:33.597779 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.597753    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-zxrxw"]
Sep 08 14:17:33.597977 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:17:33.597930    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1767f34_28dc_47f2_ab0a_207e43a760ce.slice/crio-9bd6cfa6ac48b19d69e19234ee5fa769684b099761d2c4a390d7add7e78c8a0e WatchSource:0}: Error finding container 9bd6cfa6ac48b19d69e19234ee5fa769684b099761d2c4a390d7add7e78c8a0e: Status 404 returned error can't find the container with id 9bd6cfa6ac48b19d69e19234ee5fa769684b099761d2c4a390d7add7e78c8a0e
Sep 08 14:17:33.600938 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:17:33.600919    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1fed1f_529e_45d0_a1e8_c8205629fb51.slice/crio-b009b6d4c198d71715fdeffe709ad1923d37de3f5c841b84a61f441cdf2eb4e8 WatchSource:0}: Error finding container b009b6d4c198d71715fdeffe709ad1923d37de3f5c841b84a61f441cdf2eb4e8: Status 404 returned error can't find the container with id b009b6d4c198d71715fdeffe709ad1923d37de3f5c841b84a61f441cdf2eb4e8
Sep 08 14:17:33.611465 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:33.611442    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg"]
Sep 08 14:17:33.613713 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:17:33.613689    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc395323e_dffa_47b2_8ac8_5dfa660a0604.slice/crio-45edef8734c55fc55495f25bd35bf094f59eb0fe1fe5b5d144efd0c3b96975f4 WatchSource:0}: Error finding container 45edef8734c55fc55495f25bd35bf094f59eb0fe1fe5b5d144efd0c3b96975f4: Status 404 returned error can't find the container with id 45edef8734c55fc55495f25bd35bf094f59eb0fe1fe5b5d144efd0c3b96975f4
Sep 08 14:17:34.414794 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:34.414756    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-zxrxw" event={"ID":"6f1fed1f-529e-45d0-a1e8-c8205629fb51","Type":"ContainerStarted","Data":"b009b6d4c198d71715fdeffe709ad1923d37de3f5c841b84a61f441cdf2eb4e8"}
Sep 08 14:17:34.415881 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:34.415853    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf" event={"ID":"c1767f34-28dc-47f2-ab0a-207e43a760ce","Type":"ContainerStarted","Data":"9bd6cfa6ac48b19d69e19234ee5fa769684b099761d2c4a390d7add7e78c8a0e"}
Sep 08 14:17:34.416854 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:34.416829    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg" event={"ID":"c395323e-dffa-47b2-8ac8-5dfa660a0604","Type":"ContainerStarted","Data":"45edef8734c55fc55495f25bd35bf094f59eb0fe1fe5b5d144efd0c3b96975f4"}
Sep 08 14:17:38.434553 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:38.434490    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf" event={"ID":"c1767f34-28dc-47f2-ab0a-207e43a760ce","Type":"ContainerStarted","Data":"6ed16b2ff282f5a80d4b509876a9b4e8211f9fc54d623bc0d2e2849fb7265f17"}
Sep 08 14:17:38.436975 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:38.436951    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg" event={"ID":"c395323e-dffa-47b2-8ac8-5dfa660a0604","Type":"ContainerStarted","Data":"4830cd236c13096bf848b002786d20e0a5775ccf023e1a82ae7f8e9641102a6e"}
Sep 08 14:17:38.437075 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:38.436990    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg" event={"ID":"c395323e-dffa-47b2-8ac8-5dfa660a0604","Type":"ContainerStarted","Data":"ec404bf7d4ad7619da22bd3fd1e1c1c34633f88f4290cc4b06a2b463c5706c89"}
Sep 08 14:17:38.452332 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:38.452290    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6f64cd8d98-dx6jf" podStartSLOduration=1.826870665 podStartE2EDuration="6.452259304s" totalImagesPullingTime="4.625388639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:38.451228381 +0000 UTC m=+59.847177813" watchObservedRunningTime="2026-09-08 14:17:38.452259304 +0000 UTC m=+59.848208743"
Sep 08 14:17:39.443365 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:39.443318    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg" event={"ID":"c395323e-dffa-47b2-8ac8-5dfa660a0604","Type":"ContainerStarted","Data":"c742c606782176ac7d31c9faf551fca1003e01cdfc1492a1ab8918e4beac3b66"}
Sep 08 14:17:39.466273 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:39.466220    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cb659489c-mhgpg" podStartSLOduration=2.846010829 podStartE2EDuration="7.466205721s" totalImagesPullingTime="4.620194892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:39.464639129 +0000 UTC m=+60.860588563" watchObservedRunningTime="2026-09-08 14:17:39.466205721 +0000 UTC m=+60.862155153"
Sep 08 14:17:40.331793 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:40.331763    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lw56g"
Sep 08 14:17:41.408642 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:41.408613    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l4xrf"
Sep 08 14:17:44.730539 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:44.730478    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:17:44.733392 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:44.733368    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 14:17:44.743735 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:44.743708    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3bc9c240-9b7e-45bf-99d5-849d87a774da-original-pull-secret\") pod \"global-pull-secret-syncer-k6dcv\" (UID: \"3bc9c240-9b7e-45bf-99d5-849d87a774da\") " pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:17:44.831108 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:44.831074    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs\") pod \"network-metrics-daemon-x8tbj\" (UID: \"5f09cf98-dd58-4ed2-a064-4d078539840b\") " pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:17:44.833933 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:44.833904    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 14:17:44.844936 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:44.844911    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f09cf98-dd58-4ed2-a064-4d078539840b-metrics-certs\") pod \"network-metrics-daemon-x8tbj\" (UID: \"5f09cf98-dd58-4ed2-a064-4d078539840b\") " pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:17:44.931605 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:44.931564    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnz2\" (UniqueName: \"kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2\") pod \"network-check-target-26mk9\" (UID: \"0ea34c19-9fd2-45ab-a64d-f6d4052bcae7\") " pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:17:44.934612 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:44.934587    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 14:17:44.945178 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:44.945148    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 14:17:44.955984 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:44.955960    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gnz2\" (UniqueName: \"kubernetes.io/projected/0ea34c19-9fd2-45ab-a64d-f6d4052bcae7-kube-api-access-7gnz2\") pod \"network-check-target-26mk9\" (UID: \"0ea34c19-9fd2-45ab-a64d-f6d4052bcae7\") " pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:17:45.003310 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:45.003242    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zbnn7\""
Sep 08 14:17:45.009203 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:45.009180    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6dcv"
Sep 08 14:17:45.011053 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:45.011025    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x8tbj"
Sep 08 14:17:45.016819 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:45.016801    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vvt7d\""
Sep 08 14:17:45.024974 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:45.024954    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:17:50.976407 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:50.976373    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"]
Sep 08 14:17:51.008567 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.008520    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v58zr"]
Sep 08 14:17:51.008771 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.008623    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.011309 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.011282    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 08 14:17:51.012880 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.012683    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xcw6v\""
Sep 08 14:17:51.012880 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.012758    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 08 14:17:51.013220 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.013100    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 14:17:51.013220 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.013206    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 14:17:51.013626 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.013608    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 08 14:17:51.013696 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.013647    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 14:17:51.024478 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.024455    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"]
Sep 08 14:17:51.024619 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.024601    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.027285 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.027264    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 14:17:51.027395 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.027345    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w6g7w\""
Sep 08 14:17:51.027395 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.027367    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 14:17:51.027600 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.027581    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 14:17:51.078187 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.077976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c7e300c-86d8-44da-8399-5eae1802b0a6-sys\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.078187 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/540dece3-d553-4f99-afe6-7d635b393418-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.078187 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078058    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-wtmp\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.078187 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078086    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/540dece3-d553-4f99-afe6-7d635b393418-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.078187 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/540dece3-d553-4f99-afe6-7d635b393418-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.078187 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078134    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c7e300c-86d8-44da-8399-5eae1802b0a6-metrics-client-ca\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.078187 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078157    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c7e300c-86d8-44da-8399-5eae1802b0a6-root\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.078187 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078192    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/540dece3-d553-4f99-afe6-7d635b393418-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.078755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-textfile\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.078755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078256    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/540dece3-d553-4f99-afe6-7d635b393418-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.078755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078305    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.078755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078331    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-tls\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.078755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078360    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jllm\" (UniqueName: \"kubernetes.io/projected/540dece3-d553-4f99-afe6-7d635b393418-kube-api-access-2jllm\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.078755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078385    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgcmp\" (UniqueName: \"kubernetes.io/projected/2c7e300c-86d8-44da-8399-5eae1802b0a6-kube-api-access-sgcmp\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.078755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.078411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.179011 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.178974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jllm\" (UniqueName: \"kubernetes.io/projected/540dece3-d553-4f99-afe6-7d635b393418-kube-api-access-2jllm\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.179195 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgcmp\" (UniqueName: \"kubernetes.io/projected/2c7e300c-86d8-44da-8399-5eae1802b0a6-kube-api-access-sgcmp\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.179262 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179225    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.179322 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c7e300c-86d8-44da-8399-5eae1802b0a6-sys\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.179322 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179311    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/540dece3-d553-4f99-afe6-7d635b393418-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.179426 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179384    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c7e300c-86d8-44da-8399-5eae1802b0a6-sys\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.179479 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179432    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-wtmp\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.179570 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179473    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/540dece3-d553-4f99-afe6-7d635b393418-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.179570 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179524    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/540dece3-d553-4f99-afe6-7d635b393418-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.179570 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179551    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c7e300c-86d8-44da-8399-5eae1802b0a6-metrics-client-ca\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179577    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c7e300c-86d8-44da-8399-5eae1802b0a6-root\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/540dece3-d553-4f99-afe6-7d635b393418-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179630    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-wtmp\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-textfile\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179693    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/540dece3-d553-4f99-afe6-7d635b393418-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179733    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-tls\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179942    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c7e300c-86d8-44da-8399-5eae1802b0a6-root\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.179993    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/540dece3-d553-4f99-afe6-7d635b393418-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.180156    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/540dece3-d553-4f99-afe6-7d635b393418-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.180224    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c7e300c-86d8-44da-8399-5eae1802b0a6-metrics-client-ca\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.180412    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-textfile\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.180828    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-accelerators-collector-config\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.180925    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/540dece3-d553-4f99-afe6-7d635b393418-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.182582    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.182902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.182712    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c7e300c-86d8-44da-8399-5eae1802b0a6-node-exporter-tls\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.183686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.183118    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/540dece3-d553-4f99-afe6-7d635b393418-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.185015 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.184891    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/540dece3-d553-4f99-afe6-7d635b393418-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.195193 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.193884    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jllm\" (UniqueName: \"kubernetes.io/projected/540dece3-d553-4f99-afe6-7d635b393418-kube-api-access-2jllm\") pod \"kube-state-metrics-74cb57df7-dg22n\" (UID: \"540dece3-d553-4f99-afe6-7d635b393418\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.195193 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.195137    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgcmp\" (UniqueName: \"kubernetes.io/projected/2c7e300c-86d8-44da-8399-5eae1802b0a6-kube-api-access-sgcmp\") pod \"node-exporter-v58zr\" (UID: \"2c7e300c-86d8-44da-8399-5eae1802b0a6\") " pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:51.320341 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.320266    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"
Sep 08 14:17:51.335429 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:51.335401    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v58zr"
Sep 08 14:17:52.054577 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:52.054479    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x8tbj"]
Sep 08 14:17:52.057603 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:17:52.057558    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f09cf98_dd58_4ed2_a064_4d078539840b.slice/crio-4705b761a07048e5aa9b2b467e67e129070e61cdec376fa6698b47eb65977f45 WatchSource:0}: Error finding container 4705b761a07048e5aa9b2b467e67e129070e61cdec376fa6698b47eb65977f45: Status 404 returned error can't find the container with id 4705b761a07048e5aa9b2b467e67e129070e61cdec376fa6698b47eb65977f45
Sep 08 14:17:52.058569 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:52.058365    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-dg22n"]
Sep 08 14:17:52.062331 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:17:52.062311    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540dece3_d553_4f99_afe6_7d635b393418.slice/crio-014c70b836db179e5e8c6c634e13ca6e278eced4894d60638a9d297d7fcdc5e7 WatchSource:0}: Error finding container 014c70b836db179e5e8c6c634e13ca6e278eced4894d60638a9d297d7fcdc5e7: Status 404 returned error can't find the container with id 014c70b836db179e5e8c6c634e13ca6e278eced4894d60638a9d297d7fcdc5e7
Sep 08 14:17:52.068891 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:52.068867    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k6dcv"]
Sep 08 14:17:52.071853 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:17:52.071810    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc9c240_9b7e_45bf_99d5_849d87a774da.slice/crio-c46cc25be740900d57dd7738993b62a089aee09f62fe0b38e8a118abfc824786 WatchSource:0}: Error finding container c46cc25be740900d57dd7738993b62a089aee09f62fe0b38e8a118abfc824786: Status 404 returned error can't find the container with id c46cc25be740900d57dd7738993b62a089aee09f62fe0b38e8a118abfc824786
Sep 08 14:17:52.072017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:52.071995    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-26mk9"]
Sep 08 14:17:52.075217 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:17:52.075155    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea34c19_9fd2_45ab_a64d_f6d4052bcae7.slice/crio-2b7eced3152258dca275092bddedca8a4c6734105f734ece696a491b918e12dc WatchSource:0}: Error finding container 2b7eced3152258dca275092bddedca8a4c6734105f734ece696a491b918e12dc: Status 404 returned error can't find the container with id 2b7eced3152258dca275092bddedca8a4c6734105f734ece696a491b918e12dc
Sep 08 14:17:52.501014 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:52.500899    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v58zr" event={"ID":"2c7e300c-86d8-44da-8399-5eae1802b0a6","Type":"ContainerStarted","Data":"11debe51192db2bf145237ce36274df74f8d0280fbcd64dc21eda9db12e87ce5"}
Sep 08 14:17:52.504045 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:52.504010    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k6dcv" event={"ID":"3bc9c240-9b7e-45bf-99d5-849d87a774da","Type":"ContainerStarted","Data":"c46cc25be740900d57dd7738993b62a089aee09f62fe0b38e8a118abfc824786"}
Sep 08 14:17:52.506558 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:52.506487    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-zxrxw" event={"ID":"6f1fed1f-529e-45d0-a1e8-c8205629fb51","Type":"ContainerStarted","Data":"94505d1ada3a8bd8308cd45dec469015998ae7648fe4eb8857b2a93feb7ae5d3"}
Sep 08 14:17:52.506898 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:52.506744    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-zxrxw"
Sep 08 14:17:52.509333 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:52.509285    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-26mk9" event={"ID":"0ea34c19-9fd2-45ab-a64d-f6d4052bcae7","Type":"ContainerStarted","Data":"2b7eced3152258dca275092bddedca8a4c6734105f734ece696a491b918e12dc"}
Sep 08 14:17:52.510802 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:52.510775    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x8tbj" event={"ID":"5f09cf98-dd58-4ed2-a064-4d078539840b","Type":"ContainerStarted","Data":"4705b761a07048e5aa9b2b467e67e129070e61cdec376fa6698b47eb65977f45"}
Sep 08 14:17:52.512575 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:52.512409    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n" event={"ID":"540dece3-d553-4f99-afe6-7d635b393418","Type":"ContainerStarted","Data":"014c70b836db179e5e8c6c634e13ca6e278eced4894d60638a9d297d7fcdc5e7"}
Sep 08 14:17:52.522364 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:52.522340    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-zxrxw"
Sep 08 14:17:52.525061 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:52.525011    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-zxrxw" podStartSLOduration=2.162234446 podStartE2EDuration="20.524993836s" totalImagesPullingTime="18.36275939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:17:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:17:52.524372042 +0000 UTC m=+73.920321515" watchObservedRunningTime="2026-09-08 14:17:52.524993836 +0000 UTC m=+73.920943249"
Sep 08 14:17:59.552206 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:59.551481    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v58zr" event={"ID":"2c7e300c-86d8-44da-8399-5eae1802b0a6","Type":"ContainerStarted","Data":"be246d8f498da3bdc718c48e8a578f5510114977442fbc304362aa51d1c4a813"}
Sep 08 14:17:59.555213 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:17:59.554702    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n" event={"ID":"540dece3-d553-4f99-afe6-7d635b393418","Type":"ContainerStarted","Data":"a58b0bab38233e6da1b3d472484b2ffeeda7e2767345de933c606c5252465422"}
Sep 08 14:18:00.562999 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:00.562966    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x8tbj" event={"ID":"5f09cf98-dd58-4ed2-a064-4d078539840b","Type":"ContainerStarted","Data":"b630c093f72500fdf94e3edf3324f4f82e4295629facf1499dfbd18bdb2afac2"}
Sep 08 14:18:00.563576 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:00.563026    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x8tbj" event={"ID":"5f09cf98-dd58-4ed2-a064-4d078539840b","Type":"ContainerStarted","Data":"dc4af86030c1a36846ae4a0cf332fd9c6635867f3b90c7f1f0fc2c4223d3af44"}
Sep 08 14:18:00.566567 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:00.566530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n" event={"ID":"540dece3-d553-4f99-afe6-7d635b393418","Type":"ContainerStarted","Data":"9d1816ca97df3727edbd23c262037a1d8896ec57fff68c6624f0c82c6b0b75d7"}
Sep 08 14:18:00.566686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:00.566601    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n" event={"ID":"540dece3-d553-4f99-afe6-7d635b393418","Type":"ContainerStarted","Data":"5d01e7a0155cd35610932447cf769df589d0543b4e0b66dfaed5f5f134860d14"}
Sep 08 14:18:00.568302 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:00.568280    2564 generic.go:356] "Generic (PLEG): container finished" podID="2c7e300c-86d8-44da-8399-5eae1802b0a6" containerID="be246d8f498da3bdc718c48e8a578f5510114977442fbc304362aa51d1c4a813" exitCode=0
Sep 08 14:18:00.568407 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:00.568346    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v58zr" event={"ID":"2c7e300c-86d8-44da-8399-5eae1802b0a6","Type":"ContainerDied","Data":"be246d8f498da3bdc718c48e8a578f5510114977442fbc304362aa51d1c4a813"}
Sep 08 14:18:00.570198 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:00.570165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k6dcv" event={"ID":"3bc9c240-9b7e-45bf-99d5-849d87a774da","Type":"ContainerStarted","Data":"b6ca8f31e605112fd09fd55e5114ea9bee6e4ecda11b85da2ded176e9390ecdc"}
Sep 08 14:18:00.571952 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:00.571928    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-26mk9" event={"ID":"0ea34c19-9fd2-45ab-a64d-f6d4052bcae7","Type":"ContainerStarted","Data":"6a2b07747196fbc0406bc85e412730c67392279542c51c5abba920d6ed54d50f"}
Sep 08 14:18:00.572062 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:00.572012    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:18:00.584168 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:00.584113    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x8tbj" podStartSLOduration=74.269974792 podStartE2EDuration="1m21.584095731s" totalImagesPullingTime="7.314120939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:18:00.583719651 +0000 UTC m=+81.979669085" watchObservedRunningTime="2026-09-08 14:18:00.584095731 +0000 UTC m=+81.980045164"
Sep 08 14:18:00.599185 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:00.599135    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k6dcv" podStartSLOduration=74.285575564 podStartE2EDuration="1m21.599114914s" totalImagesPullingTime="7.31353935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:18:00.597799209 +0000 UTC m=+81.993748642" watchObservedRunningTime="2026-09-08 14:18:00.599114914 +0000 UTC m=+81.995064347"
Sep 08 14:18:00.628888 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:00.628836    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-26mk9" podStartSLOduration=74.331586273 podStartE2EDuration="1m21.628820426s" totalImagesPullingTime="7.297234153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:18:00.628657224 +0000 UTC m=+82.024606658" watchObservedRunningTime="2026-09-08 14:18:00.628820426 +0000 UTC m=+82.024769859"
Sep 08 14:18:00.646363 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:00.646310    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-dg22n" podStartSLOduration=3.397904154 podStartE2EDuration="10.646296887s" totalImagesPullingTime="7.248392733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:18:00.645931624 +0000 UTC m=+82.041881056" watchObservedRunningTime="2026-09-08 14:18:00.646296887 +0000 UTC m=+82.042246322"
Sep 08 14:18:01.577547 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:01.577383    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v58zr" event={"ID":"2c7e300c-86d8-44da-8399-5eae1802b0a6","Type":"ContainerStarted","Data":"ff31030403bffc0e6c01533acea26de2f940742d7f4a1941ee7790bfcf06e35c"}
Sep 08 14:18:01.577547 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:01.577455    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v58zr" event={"ID":"2c7e300c-86d8-44da-8399-5eae1802b0a6","Type":"ContainerStarted","Data":"8d826393b128ab3551f4221b6c36a09020758d6d018446c4585e50f802e7bf41"}
Sep 08 14:18:31.580084 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:31.580049    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-26mk9"
Sep 08 14:18:31.602145 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:31.602087    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v58zr" podStartSLOduration=33.834144247 podStartE2EDuration="41.602069964s" totalImagesPullingTime="7.585703191s" totalInitContainerRuntime="182.222526ms" isStatefulPod=true podCreationTimestamp="2026-09-08 14:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:18:01.600913672 +0000 UTC m=+82.996863105" watchObservedRunningTime="2026-09-08 14:18:31.602069964 +0000 UTC m=+112.998019395"
Sep 08 14:18:35.637317 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:18:35.637291    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vxmhm_ccc79fe4-b61c-4a96-a306-f371aa83d1d7/serve-healthcheck-canary/0.log"
Sep 08 14:21:32.684055 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:32.684020    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz"]
Sep 08 14:21:32.685850 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:32.685833    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz"
Sep 08 14:21:32.688331 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:32.688306    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-czpwk\""
Sep 08 14:21:32.688331 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:32.688321    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 08 14:21:32.688552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:32.688343    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 08 14:21:32.706116 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:32.706092    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz"]
Sep 08 14:21:32.712765 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:32.712740    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mwht\" (UniqueName: \"kubernetes.io/projected/afd01ff5-2169-4339-8b4c-8c99f6e0ada2-kube-api-access-9mwht\") pod \"cert-manager-operator-controller-manager-55c444bf86-vf4rz\" (UID: \"afd01ff5-2169-4339-8b4c-8c99f6e0ada2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz"
Sep 08 14:21:32.712863 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:32.712789    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afd01ff5-2169-4339-8b4c-8c99f6e0ada2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vf4rz\" (UID: \"afd01ff5-2169-4339-8b4c-8c99f6e0ada2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz"
Sep 08 14:21:32.814232 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:32.814194    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mwht\" (UniqueName: \"kubernetes.io/projected/afd01ff5-2169-4339-8b4c-8c99f6e0ada2-kube-api-access-9mwht\") pod \"cert-manager-operator-controller-manager-55c444bf86-vf4rz\" (UID: \"afd01ff5-2169-4339-8b4c-8c99f6e0ada2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz"
Sep 08 14:21:32.814232 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:32.814237    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afd01ff5-2169-4339-8b4c-8c99f6e0ada2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vf4rz\" (UID: \"afd01ff5-2169-4339-8b4c-8c99f6e0ada2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz"
Sep 08 14:21:32.814606 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:32.814590    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/afd01ff5-2169-4339-8b4c-8c99f6e0ada2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vf4rz\" (UID: \"afd01ff5-2169-4339-8b4c-8c99f6e0ada2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz"
Sep 08 14:21:32.826932 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:32.826908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mwht\" (UniqueName: \"kubernetes.io/projected/afd01ff5-2169-4339-8b4c-8c99f6e0ada2-kube-api-access-9mwht\") pod \"cert-manager-operator-controller-manager-55c444bf86-vf4rz\" (UID: \"afd01ff5-2169-4339-8b4c-8c99f6e0ada2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz"
Sep 08 14:21:32.995036 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:32.994951    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz"
Sep 08 14:21:33.272377 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:33.272288    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz"]
Sep 08 14:21:33.275196 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:21:33.275165    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafd01ff5_2169_4339_8b4c_8c99f6e0ada2.slice/crio-309edef2ae2d4d69ecdbb4d9860568f21265a66068bab1d140dd9ee6b3c4b4a5 WatchSource:0}: Error finding container 309edef2ae2d4d69ecdbb4d9860568f21265a66068bab1d140dd9ee6b3c4b4a5: Status 404 returned error can't find the container with id 309edef2ae2d4d69ecdbb4d9860568f21265a66068bab1d140dd9ee6b3c4b4a5
Sep 08 14:21:34.279939 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:34.279901    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz" event={"ID":"afd01ff5-2169-4339-8b4c-8c99f6e0ada2","Type":"ContainerStarted","Data":"309edef2ae2d4d69ecdbb4d9860568f21265a66068bab1d140dd9ee6b3c4b4a5"}
Sep 08 14:21:36.289675 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:36.289608    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz" event={"ID":"afd01ff5-2169-4339-8b4c-8c99f6e0ada2","Type":"ContainerStarted","Data":"14cc56e2f003f9dd0426e47ac6f441e43fe9865c38040ed94925992fd82c5013"}
Sep 08 14:21:36.334181 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:36.334122    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vf4rz" podStartSLOduration=1.865463105 podStartE2EDuration="4.334103332s" totalImagesPullingTime="2.468640227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:21:36.332443479 +0000 UTC m=+297.728392912" watchObservedRunningTime="2026-09-08 14:21:36.334103332 +0000 UTC m=+297.730052766"
Sep 08 14:21:38.939202 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:38.939173    2564 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 14:21:42.947891 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:42.947847    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb"]
Sep 08 14:21:42.949937 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:42.949920    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb"
Sep 08 14:21:42.953420 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:42.953389    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-j87cp\""
Sep 08 14:21:42.954374 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:42.954353    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 14:21:42.954467 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:42.954389    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 14:21:42.963424 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:42.963399    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb"]
Sep 08 14:21:43.090000 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:43.089967    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06103f78-f446-456d-a326-fe469d8754d1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5hwkb\" (UID: \"06103f78-f446-456d-a326-fe469d8754d1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb"
Sep 08 14:21:43.090191 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:43.090019    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fdsl\" (UniqueName: \"kubernetes.io/projected/06103f78-f446-456d-a326-fe469d8754d1-kube-api-access-9fdsl\") pod \"cert-manager-cainjector-559cdd8c87-5hwkb\" (UID: \"06103f78-f446-456d-a326-fe469d8754d1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb"
Sep 08 14:21:43.190954 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:43.190924    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fdsl\" (UniqueName: \"kubernetes.io/projected/06103f78-f446-456d-a326-fe469d8754d1-kube-api-access-9fdsl\") pod \"cert-manager-cainjector-559cdd8c87-5hwkb\" (UID: \"06103f78-f446-456d-a326-fe469d8754d1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb"
Sep 08 14:21:43.191104 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:43.190974    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06103f78-f446-456d-a326-fe469d8754d1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5hwkb\" (UID: \"06103f78-f446-456d-a326-fe469d8754d1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb"
Sep 08 14:21:43.200054 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:43.199988    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06103f78-f446-456d-a326-fe469d8754d1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-5hwkb\" (UID: \"06103f78-f446-456d-a326-fe469d8754d1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb"
Sep 08 14:21:43.200054 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:43.200036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fdsl\" (UniqueName: \"kubernetes.io/projected/06103f78-f446-456d-a326-fe469d8754d1-kube-api-access-9fdsl\") pod \"cert-manager-cainjector-559cdd8c87-5hwkb\" (UID: \"06103f78-f446-456d-a326-fe469d8754d1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb"
Sep 08 14:21:43.259099 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:43.259066    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb"
Sep 08 14:21:43.527122 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:43.527033    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb"]
Sep 08 14:21:43.531629 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:21:43.531605    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06103f78_f446_456d_a326_fe469d8754d1.slice/crio-d623c8db79d94c485ad1f6602a523e46aea4220723bb0ed1484b1348a6d50374 WatchSource:0}: Error finding container d623c8db79d94c485ad1f6602a523e46aea4220723bb0ed1484b1348a6d50374: Status 404 returned error can't find the container with id d623c8db79d94c485ad1f6602a523e46aea4220723bb0ed1484b1348a6d50374
Sep 08 14:21:43.533864 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:43.533846    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:21:44.320185 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:44.320134    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb" event={"ID":"06103f78-f446-456d-a326-fe469d8754d1","Type":"ContainerStarted","Data":"d623c8db79d94c485ad1f6602a523e46aea4220723bb0ed1484b1348a6d50374"}
Sep 08 14:21:46.331791 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:21:46.331754    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb" event={"ID":"06103f78-f446-456d-a326-fe469d8754d1","Type":"ContainerStarted","Data":"8a7e6f52ec01242e2a61237ef9a3977c7218ddae8f4b8f9f93af4e411558876c"}
Sep 08 14:22:12.827674 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.827611    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-5hwkb" podStartSLOduration=28.45627396 podStartE2EDuration="30.827592402s" totalImagesPullingTime="2.371318442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:21:46.348528825 +0000 UTC m=+307.744478261" watchObservedRunningTime="2026-09-08 14:22:12.827592402 +0000 UTC m=+334.223541834"
Sep 08 14:22:12.828676 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.828653    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"]
Sep 08 14:22:12.830700 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.830682    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:12.833404 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.833384    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 14:22:12.833880 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.833860    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 14:22:12.834129 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.834106    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-js9cr\""
Sep 08 14:22:12.834206 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.834148    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 14:22:12.834479 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.834454    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 14:22:12.853903 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.853876    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"]
Sep 08 14:22:12.905399 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.905373    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac18e514-5015-4d1d-9117-a11a4de0468f-webhook-cert\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:12.905557 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.905408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac18e514-5015-4d1d-9117-a11a4de0468f-manifests\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:12.905557 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.905441    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk49g\" (UniqueName: \"kubernetes.io/projected/ac18e514-5015-4d1d-9117-a11a4de0468f-kube-api-access-xk49g\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:12.905557 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.905484    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac18e514-5015-4d1d-9117-a11a4de0468f-tmp\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:12.905557 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:12.905534    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac18e514-5015-4d1d-9117-a11a4de0468f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:13.006211 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:13.006171    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac18e514-5015-4d1d-9117-a11a4de0468f-webhook-cert\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:13.006211 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:13.006211    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac18e514-5015-4d1d-9117-a11a4de0468f-manifests\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:13.006450 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:13.006240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk49g\" (UniqueName: \"kubernetes.io/projected/ac18e514-5015-4d1d-9117-a11a4de0468f-kube-api-access-xk49g\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:13.006450 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:13.006269    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac18e514-5015-4d1d-9117-a11a4de0468f-tmp\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:13.006450 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:13.006291    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac18e514-5015-4d1d-9117-a11a4de0468f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:13.006632 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:13.006599    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ac18e514-5015-4d1d-9117-a11a4de0468f-manifests\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:13.008723 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:13.008697    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ac18e514-5015-4d1d-9117-a11a4de0468f-tmp\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:13.008879 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:13.008863    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ac18e514-5015-4d1d-9117-a11a4de0468f-webhook-cert\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:13.008940 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:13.008923    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ac18e514-5015-4d1d-9117-a11a4de0468f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:13.019179 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:13.019155    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk49g\" (UniqueName: \"kubernetes.io/projected/ac18e514-5015-4d1d-9117-a11a4de0468f-kube-api-access-xk49g\") pod \"opendatahub-operator-controller-manager-566d57d45b-pgp4c\" (UID: \"ac18e514-5015-4d1d-9117-a11a4de0468f\") " pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:13.141584 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:13.141475    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:13.421312 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:13.421229    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"]
Sep 08 14:22:13.424643 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:22:13.424615    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac18e514_5015_4d1d_9117_a11a4de0468f.slice/crio-6ca0421186de2170996dd793a74bf6926fd0f1aabcc22009b7a23793f87018a8 WatchSource:0}: Error finding container 6ca0421186de2170996dd793a74bf6926fd0f1aabcc22009b7a23793f87018a8: Status 404 returned error can't find the container with id 6ca0421186de2170996dd793a74bf6926fd0f1aabcc22009b7a23793f87018a8
Sep 08 14:22:14.429893 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:14.429855    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c" event={"ID":"ac18e514-5015-4d1d-9117-a11a4de0468f","Type":"ContainerStarted","Data":"6ca0421186de2170996dd793a74bf6926fd0f1aabcc22009b7a23793f87018a8"}
Sep 08 14:22:18.447646 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:18.447609    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c" event={"ID":"ac18e514-5015-4d1d-9117-a11a4de0468f","Type":"ContainerStarted","Data":"ef2d42318ba2beac23fef023edfdf4b340de7059d93832be3c5fb0e4af4658d6"}
Sep 08 14:22:19.452364 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:19.452329    2564 generic.go:356] "Generic (PLEG): container finished" podID="ac18e514-5015-4d1d-9117-a11a4de0468f" containerID="ef2d42318ba2beac23fef023edfdf4b340de7059d93832be3c5fb0e4af4658d6" exitCode=0
Sep 08 14:22:19.452771 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:19.452409    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c" event={"ID":"ac18e514-5015-4d1d-9117-a11a4de0468f","Type":"ContainerDied","Data":"ef2d42318ba2beac23fef023edfdf4b340de7059d93832be3c5fb0e4af4658d6"}
Sep 08 14:22:20.458412 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:20.458374    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c" event={"ID":"ac18e514-5015-4d1d-9117-a11a4de0468f","Type":"ContainerStarted","Data":"3f5be37d823e16bc9f0ba1548d4235decf4693f94f44cb24e7b2c9b744ef9b5d"}
Sep 08 14:22:20.458894 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:20.458492    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:20.486166 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:20.486120    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c" podStartSLOduration=2.765463288 podStartE2EDuration="8.486106077s" totalImagesPullingTime="4.643501917s" totalInitContainerRuntime="1.077140872s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:22:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:22:20.483126577 +0000 UTC m=+341.879076009" watchObservedRunningTime="2026-09-08 14:22:20.486106077 +0000 UTC m=+341.882055508"
Sep 08 14:22:31.464450 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:31.464370    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-566d57d45b-pgp4c"
Sep 08 14:22:33.605253 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.605214    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"]
Sep 08 14:22:33.607109 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.607093    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"
Sep 08 14:22:33.609276 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.609257    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 14:22:33.609566 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.609551    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 08 14:22:33.610736 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.610718    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 14:22:33.611023 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.611002    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-v5rm7\""
Sep 08 14:22:33.611139 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.611019    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 14:22:33.621328 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.621305    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"]
Sep 08 14:22:33.659480 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.659453    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26d1effb-2a37-4a73-b70c-3cbcfc826864-tmp\") pod \"kube-auth-proxy-5df94dbdbc-xs89k\" (UID: \"26d1effb-2a37-4a73-b70c-3cbcfc826864\") " pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"
Sep 08 14:22:33.659606 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.659484    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26d1effb-2a37-4a73-b70c-3cbcfc826864-tls-certs\") pod \"kube-auth-proxy-5df94dbdbc-xs89k\" (UID: \"26d1effb-2a37-4a73-b70c-3cbcfc826864\") " pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"
Sep 08 14:22:33.659606 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.659526    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwzxq\" (UniqueName: \"kubernetes.io/projected/26d1effb-2a37-4a73-b70c-3cbcfc826864-kube-api-access-jwzxq\") pod \"kube-auth-proxy-5df94dbdbc-xs89k\" (UID: \"26d1effb-2a37-4a73-b70c-3cbcfc826864\") " pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"
Sep 08 14:22:33.760805 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.760760    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26d1effb-2a37-4a73-b70c-3cbcfc826864-tmp\") pod \"kube-auth-proxy-5df94dbdbc-xs89k\" (UID: \"26d1effb-2a37-4a73-b70c-3cbcfc826864\") " pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"
Sep 08 14:22:33.760805 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.760813    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26d1effb-2a37-4a73-b70c-3cbcfc826864-tls-certs\") pod \"kube-auth-proxy-5df94dbdbc-xs89k\" (UID: \"26d1effb-2a37-4a73-b70c-3cbcfc826864\") " pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"
Sep 08 14:22:33.760973 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.760859    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzxq\" (UniqueName: \"kubernetes.io/projected/26d1effb-2a37-4a73-b70c-3cbcfc826864-kube-api-access-jwzxq\") pod \"kube-auth-proxy-5df94dbdbc-xs89k\" (UID: \"26d1effb-2a37-4a73-b70c-3cbcfc826864\") " pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"
Sep 08 14:22:33.761008 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:22:33.760988    2564 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 08 14:22:33.761064 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:22:33.761053    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26d1effb-2a37-4a73-b70c-3cbcfc826864-tls-certs podName:26d1effb-2a37-4a73-b70c-3cbcfc826864 nodeName:}" failed. No retries permitted until 2026-09-08 14:22:34.26103687 +0000 UTC m=+355.656986285 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/26d1effb-2a37-4a73-b70c-3cbcfc826864-tls-certs") pod "kube-auth-proxy-5df94dbdbc-xs89k" (UID: "26d1effb-2a37-4a73-b70c-3cbcfc826864") : secret "kube-auth-proxy-tls" not found
Sep 08 14:22:33.767759 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.767736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26d1effb-2a37-4a73-b70c-3cbcfc826864-tmp\") pod \"kube-auth-proxy-5df94dbdbc-xs89k\" (UID: \"26d1effb-2a37-4a73-b70c-3cbcfc826864\") " pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"
Sep 08 14:22:33.770099 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:33.770062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwzxq\" (UniqueName: \"kubernetes.io/projected/26d1effb-2a37-4a73-b70c-3cbcfc826864-kube-api-access-jwzxq\") pod \"kube-auth-proxy-5df94dbdbc-xs89k\" (UID: \"26d1effb-2a37-4a73-b70c-3cbcfc826864\") " pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"
Sep 08 14:22:34.263666 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:34.263630    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26d1effb-2a37-4a73-b70c-3cbcfc826864-tls-certs\") pod \"kube-auth-proxy-5df94dbdbc-xs89k\" (UID: \"26d1effb-2a37-4a73-b70c-3cbcfc826864\") " pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"
Sep 08 14:22:34.266049 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:34.266013    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/26d1effb-2a37-4a73-b70c-3cbcfc826864-tls-certs\") pod \"kube-auth-proxy-5df94dbdbc-xs89k\" (UID: \"26d1effb-2a37-4a73-b70c-3cbcfc826864\") " pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"
Sep 08 14:22:34.517344 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:34.517267    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"
Sep 08 14:22:34.785769 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:34.785627    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k"]
Sep 08 14:22:34.788433 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:22:34.788407    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d1effb_2a37_4a73_b70c_3cbcfc826864.slice/crio-6465e934ec79b8e2aeae608720f7beddcdce69a4b375359c820cf8cd546d2e36 WatchSource:0}: Error finding container 6465e934ec79b8e2aeae608720f7beddcdce69a4b375359c820cf8cd546d2e36: Status 404 returned error can't find the container with id 6465e934ec79b8e2aeae608720f7beddcdce69a4b375359c820cf8cd546d2e36
Sep 08 14:22:35.517649 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:35.517604    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k" event={"ID":"26d1effb-2a37-4a73-b70c-3cbcfc826864","Type":"ContainerStarted","Data":"6465e934ec79b8e2aeae608720f7beddcdce69a4b375359c820cf8cd546d2e36"}
Sep 08 14:22:38.532576 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:38.532542    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k" event={"ID":"26d1effb-2a37-4a73-b70c-3cbcfc826864","Type":"ContainerStarted","Data":"4e2a0b9110b8a30672146c9a3b2e34c6b78c03a0efa56e7f2eda5e16cfaff857"}
Sep 08 14:22:38.549408 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:38.549365    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5df94dbdbc-xs89k" podStartSLOduration=2.718361782 podStartE2EDuration="5.549350474s" totalImagesPullingTime="2.830988692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:22:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:22:38.547556399 +0000 UTC m=+359.943505834" watchObservedRunningTime="2026-09-08 14:22:38.549350474 +0000 UTC m=+359.945299906"
Sep 08 14:22:39.029276 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.029245    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"]
Sep 08 14:22:39.032246 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.032225    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.035003 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.034982    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 14:22:39.035129 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.035065    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-g9qpt\""
Sep 08 14:22:39.049312 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.049287    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"]
Sep 08 14:22:39.097611 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.097581    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.097710 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.097646    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.097710 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.097671    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e0a4612-6772-4b07-b432-3a90c05cba9e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.097784 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.097706    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.097784 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.097734    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.097784 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.097757    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e0a4612-6772-4b07-b432-3a90c05cba9e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.097876 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.097798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e0a4612-6772-4b07-b432-3a90c05cba9e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.097876 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.097827    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmrzk\" (UniqueName: \"kubernetes.io/projected/2e0a4612-6772-4b07-b432-3a90c05cba9e-kube-api-access-hmrzk\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.097876 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.097863    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.198188 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.198161    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.198341 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.198201    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.198341 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.198217    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e0a4612-6772-4b07-b432-3a90c05cba9e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.198341 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.198325    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.198520 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.198351    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.198520 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.198378    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e0a4612-6772-4b07-b432-3a90c05cba9e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.198638 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.198550    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e0a4612-6772-4b07-b432-3a90c05cba9e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.198638 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.198599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmrzk\" (UniqueName: \"kubernetes.io/projected/2e0a4612-6772-4b07-b432-3a90c05cba9e-kube-api-access-hmrzk\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.198745 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.198634    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.198745 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.198636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.198745 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.198716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.198846 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.198750    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.198897 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.198885    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.199377 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.199353    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e0a4612-6772-4b07-b432-3a90c05cba9e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.200225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.200203    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e0a4612-6772-4b07-b432-3a90c05cba9e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.200658 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.200639    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e0a4612-6772-4b07-b432-3a90c05cba9e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.218744 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.218716    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmrzk\" (UniqueName: \"kubernetes.io/projected/2e0a4612-6772-4b07-b432-3a90c05cba9e-kube-api-access-hmrzk\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.218905 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.218888    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e0a4612-6772-4b07-b432-3a90c05cba9e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx\" (UID: \"2e0a4612-6772-4b07-b432-3a90c05cba9e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.342807 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.342772    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:39.616322 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:39.616299    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"]
Sep 08 14:22:39.618713 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:22:39.618684    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e0a4612_6772_4b07_b432_3a90c05cba9e.slice/crio-5d1d4f2f97d2faea3490c1d6d1587f63fd6032d32787b2f283a1843090ca2f5a WatchSource:0}: Error finding container 5d1d4f2f97d2faea3490c1d6d1587f63fd6032d32787b2f283a1843090ca2f5a: Status 404 returned error can't find the container with id 5d1d4f2f97d2faea3490c1d6d1587f63fd6032d32787b2f283a1843090ca2f5a
Sep 08 14:22:40.541509 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:40.541465    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx" event={"ID":"2e0a4612-6772-4b07-b432-3a90c05cba9e","Type":"ContainerStarted","Data":"5d1d4f2f97d2faea3490c1d6d1587f63fd6032d32787b2f283a1843090ca2f5a"}
Sep 08 14:22:44.002220 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.002177    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:22:44.002647 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.002257    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:22:44.002647 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.002289    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:22:44.561205 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.561156    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx" event={"ID":"2e0a4612-6772-4b07-b432-3a90c05cba9e","Type":"ContainerStarted","Data":"b5d3b5e84aff133c8a71694b57a4f3d7fe1b22ff31cb8eaca87ee1d717d1beac"}
Sep 08 14:22:44.585031 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.584971    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx" podStartSLOduration=1.203664984 podStartE2EDuration="5.584946544s" totalImagesPullingTime="4.38128156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:22:44.582754469 +0000 UTC m=+365.978703903" watchObservedRunningTime="2026-09-08 14:22:44.584946544 +0000 UTC m=+365.980895977"
Sep 08 14:22:44.818079 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.818005    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xcpv7"]
Sep 08 14:22:44.821523 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.821252    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7"
Sep 08 14:22:44.824952 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.824924    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 08 14:22:44.833752 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.833727    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xcpv7"]
Sep 08 14:22:44.839300 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.839276    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ad85707-bf17-4598-96d6-9f8e3a2c1576-tls-certs\") pod \"model-serving-api-54d89bd5fc-xcpv7\" (UID: \"1ad85707-bf17-4598-96d6-9f8e3a2c1576\") " pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7"
Sep 08 14:22:44.839400 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.839349    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-775vw\" (UniqueName: \"kubernetes.io/projected/1ad85707-bf17-4598-96d6-9f8e3a2c1576-kube-api-access-775vw\") pod \"model-serving-api-54d89bd5fc-xcpv7\" (UID: \"1ad85707-bf17-4598-96d6-9f8e3a2c1576\") " pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7"
Sep 08 14:22:44.939848 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.939819    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-775vw\" (UniqueName: \"kubernetes.io/projected/1ad85707-bf17-4598-96d6-9f8e3a2c1576-kube-api-access-775vw\") pod \"model-serving-api-54d89bd5fc-xcpv7\" (UID: \"1ad85707-bf17-4598-96d6-9f8e3a2c1576\") " pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7"
Sep 08 14:22:44.940015 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.939877    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ad85707-bf17-4598-96d6-9f8e3a2c1576-tls-certs\") pod \"model-serving-api-54d89bd5fc-xcpv7\" (UID: \"1ad85707-bf17-4598-96d6-9f8e3a2c1576\") " pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7"
Sep 08 14:22:44.940015 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:22:44.939974    2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 08 14:22:44.940125 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:22:44.940036    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ad85707-bf17-4598-96d6-9f8e3a2c1576-tls-certs podName:1ad85707-bf17-4598-96d6-9f8e3a2c1576 nodeName:}" failed. No retries permitted until 2026-09-08 14:22:45.440021225 +0000 UTC m=+366.835970635 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1ad85707-bf17-4598-96d6-9f8e3a2c1576-tls-certs") pod "model-serving-api-54d89bd5fc-xcpv7" (UID: "1ad85707-bf17-4598-96d6-9f8e3a2c1576") : secret "model-serving-api-tls" not found
Sep 08 14:22:44.949174 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:44.949150    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-775vw\" (UniqueName: \"kubernetes.io/projected/1ad85707-bf17-4598-96d6-9f8e3a2c1576-kube-api-access-775vw\") pod \"model-serving-api-54d89bd5fc-xcpv7\" (UID: \"1ad85707-bf17-4598-96d6-9f8e3a2c1576\") " pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7"
Sep 08 14:22:45.343873 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:45.343839    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:45.348248 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:45.348225    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:45.444467 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:45.444440    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ad85707-bf17-4598-96d6-9f8e3a2c1576-tls-certs\") pod \"model-serving-api-54d89bd5fc-xcpv7\" (UID: \"1ad85707-bf17-4598-96d6-9f8e3a2c1576\") " pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7"
Sep 08 14:22:45.446724 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:45.446705    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ad85707-bf17-4598-96d6-9f8e3a2c1576-tls-certs\") pod \"model-serving-api-54d89bd5fc-xcpv7\" (UID: \"1ad85707-bf17-4598-96d6-9f8e3a2c1576\") " pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7"
Sep 08 14:22:45.565332 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:45.565301    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:45.566177 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:45.566157    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx"
Sep 08 14:22:45.737118 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:45.737022    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7"
Sep 08 14:22:46.004698 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:46.004673    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xcpv7"]
Sep 08 14:22:46.007101 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:22:46.007076    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad85707_bf17_4598_96d6_9f8e3a2c1576.slice/crio-44a5bbfff69f94956cf63d05731af77902a7ed04ced40117637ef520a420d4b7 WatchSource:0}: Error finding container 44a5bbfff69f94956cf63d05731af77902a7ed04ced40117637ef520a420d4b7: Status 404 returned error can't find the container with id 44a5bbfff69f94956cf63d05731af77902a7ed04ced40117637ef520a420d4b7
Sep 08 14:22:46.570079 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:46.570046    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7" event={"ID":"1ad85707-bf17-4598-96d6-9f8e3a2c1576","Type":"ContainerStarted","Data":"44a5bbfff69f94956cf63d05731af77902a7ed04ced40117637ef520a420d4b7"}
Sep 08 14:22:49.584284 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:49.584245    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7" event={"ID":"1ad85707-bf17-4598-96d6-9f8e3a2c1576","Type":"ContainerStarted","Data":"3581bda01845d73805ab2d57c0fb6e6e62b90e7540dd3399bcba2acc0f271869"}
Sep 08 14:22:49.584791 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:49.584381    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7"
Sep 08 14:22:49.602719 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:49.602674    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7" podStartSLOduration=2.858927242 podStartE2EDuration="5.602656536s" totalImagesPullingTime="2.743729294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:22:49.601210061 +0000 UTC m=+370.997159495" watchObservedRunningTime="2026-09-08 14:22:49.602656536 +0000 UTC m=+370.998605967"
Sep 08 14:22:51.652226 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.652192    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"]
Sep 08 14:22:51.655757 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.655734    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.658448 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.658422    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 14:22:51.658649 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.658614    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5p5vb\""
Sep 08 14:22:51.658744 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.658726    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 14:22:51.658802 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.658722    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 14:22:51.672128 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.672106    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"]
Sep 08 14:22:51.689578 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.689550    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r4xz\" (UniqueName: \"kubernetes.io/projected/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-kube-api-access-4r4xz\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.689691 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.689591    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.689691 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.689615    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.689691 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.689651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.689788 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.689691    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.689788 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.689758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.689853 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.689797    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.790670 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.790630    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.790670 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.790667    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.790867 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.790714    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r4xz\" (UniqueName: \"kubernetes.io/projected/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-kube-api-access-4r4xz\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.790867 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.790749    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.790867 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.790778    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.790867 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.790814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.791064 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.790876    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.791676 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.791646    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.792924 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.792893    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.793079 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.793061    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.793145 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.793062    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.793195 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.793172    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.799864 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.799831    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.799945 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.799869    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r4xz\" (UniqueName: \"kubernetes.io/projected/7d9e9a8c-061a-4cd1-b3d1-e90f075b067d-kube-api-access-4r4xz\") pod \"istiod-openshift-gateway-5677ccb49b-l7j76\" (UID: \"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:51.965397 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:51.965302    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:52.239916 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:52.239823    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"]
Sep 08 14:22:52.243150 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:22:52.243119    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d9e9a8c_061a_4cd1_b3d1_e90f075b067d.slice/crio-769792df1231dcfc6bc0e79e274594a807facc03ee2fd38bffb1ad3cd590777f WatchSource:0}: Error finding container 769792df1231dcfc6bc0e79e274594a807facc03ee2fd38bffb1ad3cd590777f: Status 404 returned error can't find the container with id 769792df1231dcfc6bc0e79e274594a807facc03ee2fd38bffb1ad3cd590777f
Sep 08 14:22:52.599409 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:52.599366    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76" event={"ID":"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d","Type":"ContainerStarted","Data":"769792df1231dcfc6bc0e79e274594a807facc03ee2fd38bffb1ad3cd590777f"}
Sep 08 14:22:53.812538 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.812237    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-84k42"]
Sep 08 14:22:53.821196 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.820167    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84k42"
Sep 08 14:22:53.833409 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.833010    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dt9bj\""
Sep 08 14:22:53.833409 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.833254    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 08 14:22:53.835054 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.834411    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"]
Sep 08 14:22:53.854623 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.854596    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-84k42"]
Sep 08 14:22:53.854758 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.854642    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"]
Sep 08 14:22:53.854758 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.854688    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"
Sep 08 14:22:53.858126 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.858092    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-xh6mt\""
Sep 08 14:22:53.858595 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.858570    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 08 14:22:53.910607 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.910577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj62b\" (UniqueName: \"kubernetes.io/projected/22957d06-be22-4a7b-89a4-f0448e8102d4-kube-api-access-qj62b\") pod \"llmisvc-controller-manager-777c6bd7d5-wqgfx\" (UID: \"22957d06-be22-4a7b-89a4-f0448e8102d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"
Sep 08 14:22:53.910607 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.910610    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22957d06-be22-4a7b-89a4-f0448e8102d4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wqgfx\" (UID: \"22957d06-be22-4a7b-89a4-f0448e8102d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"
Sep 08 14:22:53.910817 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.910636    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgt6k\" (UniqueName: \"kubernetes.io/projected/7bdbba57-15eb-478f-bd56-fd854e369f41-kube-api-access-tgt6k\") pod \"kserve-controller-manager-d6f4b65b8-84k42\" (UID: \"7bdbba57-15eb-478f-bd56-fd854e369f41\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-84k42"
Sep 08 14:22:53.910817 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:53.910729    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bdbba57-15eb-478f-bd56-fd854e369f41-cert\") pod \"kserve-controller-manager-d6f4b65b8-84k42\" (UID: \"7bdbba57-15eb-478f-bd56-fd854e369f41\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-84k42"
Sep 08 14:22:54.012050 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:54.012011    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj62b\" (UniqueName: \"kubernetes.io/projected/22957d06-be22-4a7b-89a4-f0448e8102d4-kube-api-access-qj62b\") pod \"llmisvc-controller-manager-777c6bd7d5-wqgfx\" (UID: \"22957d06-be22-4a7b-89a4-f0448e8102d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"
Sep 08 14:22:54.012233 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:54.012064    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22957d06-be22-4a7b-89a4-f0448e8102d4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wqgfx\" (UID: \"22957d06-be22-4a7b-89a4-f0448e8102d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"
Sep 08 14:22:54.012233 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:54.012089    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgt6k\" (UniqueName: \"kubernetes.io/projected/7bdbba57-15eb-478f-bd56-fd854e369f41-kube-api-access-tgt6k\") pod \"kserve-controller-manager-d6f4b65b8-84k42\" (UID: \"7bdbba57-15eb-478f-bd56-fd854e369f41\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-84k42"
Sep 08 14:22:54.012233 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:54.012133    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bdbba57-15eb-478f-bd56-fd854e369f41-cert\") pod \"kserve-controller-manager-d6f4b65b8-84k42\" (UID: \"7bdbba57-15eb-478f-bd56-fd854e369f41\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-84k42"
Sep 08 14:22:54.012383 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:22:54.012327    2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 08 14:22:54.012438 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:22:54.012397    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22957d06-be22-4a7b-89a4-f0448e8102d4-cert podName:22957d06-be22-4a7b-89a4-f0448e8102d4 nodeName:}" failed. No retries permitted until 2026-09-08 14:22:54.512377064 +0000 UTC m=+375.908326490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/22957d06-be22-4a7b-89a4-f0448e8102d4-cert") pod "llmisvc-controller-manager-777c6bd7d5-wqgfx" (UID: "22957d06-be22-4a7b-89a4-f0448e8102d4") : secret "llmisvc-webhook-server-cert" not found
Sep 08 14:22:54.015061 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:54.015038    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bdbba57-15eb-478f-bd56-fd854e369f41-cert\") pod \"kserve-controller-manager-d6f4b65b8-84k42\" (UID: \"7bdbba57-15eb-478f-bd56-fd854e369f41\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-84k42"
Sep 08 14:22:54.026562 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:54.026531    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj62b\" (UniqueName: \"kubernetes.io/projected/22957d06-be22-4a7b-89a4-f0448e8102d4-kube-api-access-qj62b\") pod \"llmisvc-controller-manager-777c6bd7d5-wqgfx\" (UID: \"22957d06-be22-4a7b-89a4-f0448e8102d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"
Sep 08 14:22:54.027420 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:54.027393    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgt6k\" (UniqueName: \"kubernetes.io/projected/7bdbba57-15eb-478f-bd56-fd854e369f41-kube-api-access-tgt6k\") pod \"kserve-controller-manager-d6f4b65b8-84k42\" (UID: \"7bdbba57-15eb-478f-bd56-fd854e369f41\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-84k42"
Sep 08 14:22:54.154060 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:54.154024    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84k42"
Sep 08 14:22:54.518248 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:54.518164    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22957d06-be22-4a7b-89a4-f0448e8102d4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wqgfx\" (UID: \"22957d06-be22-4a7b-89a4-f0448e8102d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"
Sep 08 14:22:54.518401 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:22:54.518279    2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 08 14:22:54.518401 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:22:54.518347    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22957d06-be22-4a7b-89a4-f0448e8102d4-cert podName:22957d06-be22-4a7b-89a4-f0448e8102d4 nodeName:}" failed. No retries permitted until 2026-09-08 14:22:55.518331464 +0000 UTC m=+376.914280873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/22957d06-be22-4a7b-89a4-f0448e8102d4-cert") pod "llmisvc-controller-manager-777c6bd7d5-wqgfx" (UID: "22957d06-be22-4a7b-89a4-f0448e8102d4") : secret "llmisvc-webhook-server-cert" not found
Sep 08 14:22:54.695030 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:54.694999    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:22:54.695110 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:54.695073    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:22:54.899379 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:54.899347    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-84k42"]
Sep 08 14:22:54.902171 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:22:54.902146    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bdbba57_15eb_478f_bd56_fd854e369f41.slice/crio-7690c0e0f2ffb0d543dd01c9b02e274a15d04f0b2e912e6d7bc6977e9f97f4e5 WatchSource:0}: Error finding container 7690c0e0f2ffb0d543dd01c9b02e274a15d04f0b2e912e6d7bc6977e9f97f4e5: Status 404 returned error can't find the container with id 7690c0e0f2ffb0d543dd01c9b02e274a15d04f0b2e912e6d7bc6977e9f97f4e5
Sep 08 14:22:55.528440 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:55.528399    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22957d06-be22-4a7b-89a4-f0448e8102d4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wqgfx\" (UID: \"22957d06-be22-4a7b-89a4-f0448e8102d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"
Sep 08 14:22:55.531186 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:55.531157    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/22957d06-be22-4a7b-89a4-f0448e8102d4-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wqgfx\" (UID: \"22957d06-be22-4a7b-89a4-f0448e8102d4\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"
Sep 08 14:22:55.618984 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:55.618947    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76" event={"ID":"7d9e9a8c-061a-4cd1-b3d1-e90f075b067d","Type":"ContainerStarted","Data":"0bf2cc57139fb18948546e1f0ad8805e3e733c64651d301f1b3ed8be7f2e3c07"}
Sep 08 14:22:55.619376 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:55.619169    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:55.621148 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:55.621097    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84k42" event={"ID":"7bdbba57-15eb-478f-bd56-fd854e369f41","Type":"ContainerStarted","Data":"7690c0e0f2ffb0d543dd01c9b02e274a15d04f0b2e912e6d7bc6977e9f97f4e5"}
Sep 08 14:22:55.621313 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:55.621241    2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-l7j76 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:22:55.621313 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:55.621295    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76" podUID="7d9e9a8c-061a-4cd1-b3d1-e90f075b067d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:22:55.646192 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:55.646129    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76" podStartSLOduration=2.196670293 podStartE2EDuration="4.64610842s" totalImagesPullingTime="2.449438127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:22:55.645694433 +0000 UTC m=+377.041643866" watchObservedRunningTime="2026-09-08 14:22:55.64610842 +0000 UTC m=+377.042057852"
Sep 08 14:22:55.666980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:55.666951    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"
Sep 08 14:22:55.945393 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:55.945363    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"]
Sep 08 14:22:55.948182 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:22:55.948151    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod22957d06_be22_4a7b_89a4_f0448e8102d4.slice/crio-76f1cb4fad1dbafe168b2f56f759535bf302c17ec19130f1a4966d963caa6780 WatchSource:0}: Error finding container 76f1cb4fad1dbafe168b2f56f759535bf302c17ec19130f1a4966d963caa6780: Status 404 returned error can't find the container with id 76f1cb4fad1dbafe168b2f56f759535bf302c17ec19130f1a4966d963caa6780
Sep 08 14:22:56.628036 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:56.627998    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx" event={"ID":"22957d06-be22-4a7b-89a4-f0448e8102d4","Type":"ContainerStarted","Data":"76f1cb4fad1dbafe168b2f56f759535bf302c17ec19130f1a4966d963caa6780"}
Sep 08 14:22:56.628950 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:56.628927    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-l7j76"
Sep 08 14:22:57.633863 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:57.633828    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84k42" event={"ID":"7bdbba57-15eb-478f-bd56-fd854e369f41","Type":"ContainerStarted","Data":"3edd0a7368dd0e86b51cf1994ed67ed15f615bb3f166b31d48f734cc28e239ec"}
Sep 08 14:22:57.651112 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:57.651069    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84k42" podStartSLOduration=2.024588235 podStartE2EDuration="4.651053505s" totalImagesPullingTime="2.62646527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:22:57.649988603 +0000 UTC m=+379.045938035" watchObservedRunningTime="2026-09-08 14:22:57.651053505 +0000 UTC m=+379.047002936"
Sep 08 14:22:58.639813 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:58.639780    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84k42"
Sep 08 14:22:59.645646 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:59.645610    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx" event={"ID":"22957d06-be22-4a7b-89a4-f0448e8102d4","Type":"ContainerStarted","Data":"039eb23dc53781c4ce91deff9a78216d4b69fdda2550b40e35f119f499e4fb9c"}
Sep 08 14:22:59.646075 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:59.645745    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"
Sep 08 14:22:59.665306 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:22:59.665242    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx" podStartSLOduration=3.66295953 podStartE2EDuration="6.665227151s" totalImagesPullingTime="3.002267621s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:22:59.663798627 +0000 UTC m=+381.059748063" watchObservedRunningTime="2026-09-08 14:22:59.665227151 +0000 UTC m=+381.061176583"
Sep 08 14:23:00.592198 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:23:00.592169    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-xcpv7"
Sep 08 14:23:29.651150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:23:29.651119    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-84k42"
Sep 08 14:23:30.652151 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:23:30.652121    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wqgfx"
Sep 08 14:24:09.780264 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:09.780186    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"]
Sep 08 14:24:09.783474 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:09.783453    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:09.786635 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:09.786617    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 14:24:09.787784 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:09.787761    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 14:24:09.787896 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:09.787782    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-ghzq8\""
Sep 08 14:24:09.798292 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:09.798271    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"]
Sep 08 14:24:09.879704 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:09.879679    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzqct\" (UniqueName: \"kubernetes.io/projected/67023641-681e-4eb7-b5cf-80bd432bbdf7-kube-api-access-lzqct\") pod \"limitador-operator-controller-manager-6c549b6d85-5kstl\" (UID: \"67023641-681e-4eb7-b5cf-80bd432bbdf7\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:09.980771 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:09.980745    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzqct\" (UniqueName: \"kubernetes.io/projected/67023641-681e-4eb7-b5cf-80bd432bbdf7-kube-api-access-lzqct\") pod \"limitador-operator-controller-manager-6c549b6d85-5kstl\" (UID: \"67023641-681e-4eb7-b5cf-80bd432bbdf7\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:09.990847 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:09.990825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzqct\" (UniqueName: \"kubernetes.io/projected/67023641-681e-4eb7-b5cf-80bd432bbdf7-kube-api-access-lzqct\") pod \"limitador-operator-controller-manager-6c549b6d85-5kstl\" (UID: \"67023641-681e-4eb7-b5cf-80bd432bbdf7\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:10.093534 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:10.093514    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:10.365191 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:10.365167    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"]
Sep 08 14:24:10.367752 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:24:10.367722    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67023641_681e_4eb7_b5cf_80bd432bbdf7.slice/crio-a93aac7b419a10c25c987d12ec73aa6f4c661d21ea9eee83af91ebc1461d9aff WatchSource:0}: Error finding container a93aac7b419a10c25c987d12ec73aa6f4c661d21ea9eee83af91ebc1461d9aff: Status 404 returned error can't find the container with id a93aac7b419a10c25c987d12ec73aa6f4c661d21ea9eee83af91ebc1461d9aff
Sep 08 14:24:10.934732 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:10.934699    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl" event={"ID":"67023641-681e-4eb7-b5cf-80bd432bbdf7","Type":"ContainerStarted","Data":"a93aac7b419a10c25c987d12ec73aa6f4c661d21ea9eee83af91ebc1461d9aff"}
Sep 08 14:24:12.946416 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:12.946386    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl" event={"ID":"67023641-681e-4eb7-b5cf-80bd432bbdf7","Type":"ContainerStarted","Data":"dc4cb805d626c274712078ddacf0ed71598471ecafb2403a05a6e25d0dc47cde"}
Sep 08 14:24:12.946855 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:12.946509    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:12.963289 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:12.963244    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl" podStartSLOduration=1.535079375 podStartE2EDuration="3.963228592s" totalImagesPullingTime="2.428149217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:24:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:24:12.962040736 +0000 UTC m=+454.357990168" watchObservedRunningTime="2026-09-08 14:24:12.963228592 +0000 UTC m=+454.359178025"
Sep 08 14:24:23.708309 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.708271    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"]
Sep 08 14:24:23.708770 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.708508    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl" podUID="67023641-681e-4eb7-b5cf-80bd432bbdf7" containerName="manager" containerID="cri-o://dc4cb805d626c274712078ddacf0ed71598471ecafb2403a05a6e25d0dc47cde" gracePeriod=2
Sep 08 14:24:23.710481 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.710449    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:23.722170 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.722134    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"]
Sep 08 14:24:23.732352 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:24:23.732315    2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"67023641-681e-4eb7-b5cf-80bd432bbdf7\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-6c549b6d85-5kstl\": pods \"limitador-operator-controller-manager-6c549b6d85-5kstl\" not found" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:23.734378 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:24:23.734345    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-5kstl\" is forbidden: User \"system:node:ip-10-0-131-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-123.ec2.internal' and this object" podUID="67023641-681e-4eb7-b5cf-80bd432bbdf7" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:23.735137 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.735115    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5z768"]
Sep 08 14:24:23.735406 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.735395    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67023641-681e-4eb7-b5cf-80bd432bbdf7" containerName="manager"
Sep 08 14:24:23.735442 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.735408    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="67023641-681e-4eb7-b5cf-80bd432bbdf7" containerName="manager"
Sep 08 14:24:23.735486 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.735464    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="67023641-681e-4eb7-b5cf-80bd432bbdf7" containerName="manager"
Sep 08 14:24:23.738280 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.738266    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5z768"
Sep 08 14:24:23.740715 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:24:23.740664    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-5kstl\" is forbidden: User \"system:node:ip-10-0-131-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-123.ec2.internal' and this object" podUID="67023641-681e-4eb7-b5cf-80bd432bbdf7" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:23.752277 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.752246    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5z768"]
Sep 08 14:24:23.788285 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.788254    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5j2c\" (UniqueName: \"kubernetes.io/projected/872e6740-57ef-4473-b9eb-59a1daec48ea-kube-api-access-m5j2c\") pod \"limitador-operator-controller-manager-6c549b6d85-5z768\" (UID: \"872e6740-57ef-4473-b9eb-59a1daec48ea\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5z768"
Sep 08 14:24:23.889001 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.888969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5j2c\" (UniqueName: \"kubernetes.io/projected/872e6740-57ef-4473-b9eb-59a1daec48ea-kube-api-access-m5j2c\") pod \"limitador-operator-controller-manager-6c549b6d85-5z768\" (UID: \"872e6740-57ef-4473-b9eb-59a1daec48ea\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5z768"
Sep 08 14:24:23.898629 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.898598    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5j2c\" (UniqueName: \"kubernetes.io/projected/872e6740-57ef-4473-b9eb-59a1daec48ea-kube-api-access-m5j2c\") pod \"limitador-operator-controller-manager-6c549b6d85-5z768\" (UID: \"872e6740-57ef-4473-b9eb-59a1daec48ea\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5z768"
Sep 08 14:24:23.951778 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.951754    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:23.953979 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:24:23.953949    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-5kstl\" is forbidden: User \"system:node:ip-10-0-131-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-123.ec2.internal' and this object" podUID="67023641-681e-4eb7-b5cf-80bd432bbdf7" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:23.993718 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.993647    2564 generic.go:356] "Generic (PLEG): container finished" podID="67023641-681e-4eb7-b5cf-80bd432bbdf7" containerID="dc4cb805d626c274712078ddacf0ed71598471ecafb2403a05a6e25d0dc47cde" exitCode=0
Sep 08 14:24:23.993718 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.993698    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:23.993718 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:23.993714    2564 scope.go:117] "RemoveContainer" containerID="dc4cb805d626c274712078ddacf0ed71598471ecafb2403a05a6e25d0dc47cde"
Sep 08 14:24:23.996221 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:24:23.996198    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-5kstl\" is forbidden: User \"system:node:ip-10-0-131-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-123.ec2.internal' and this object" podUID="67023641-681e-4eb7-b5cf-80bd432bbdf7" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:24.001485 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:24.001466    2564 scope.go:117] "RemoveContainer" containerID="dc4cb805d626c274712078ddacf0ed71598471ecafb2403a05a6e25d0dc47cde"
Sep 08 14:24:24.001766 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:24:24.001747    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc4cb805d626c274712078ddacf0ed71598471ecafb2403a05a6e25d0dc47cde\": container with ID starting with dc4cb805d626c274712078ddacf0ed71598471ecafb2403a05a6e25d0dc47cde not found: ID does not exist" containerID="dc4cb805d626c274712078ddacf0ed71598471ecafb2403a05a6e25d0dc47cde"
Sep 08 14:24:24.001819 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:24.001773    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc4cb805d626c274712078ddacf0ed71598471ecafb2403a05a6e25d0dc47cde"} err="failed to get container status \"dc4cb805d626c274712078ddacf0ed71598471ecafb2403a05a6e25d0dc47cde\": rpc error: code = NotFound desc = could not find container \"dc4cb805d626c274712078ddacf0ed71598471ecafb2403a05a6e25d0dc47cde\": container with ID starting with dc4cb805d626c274712078ddacf0ed71598471ecafb2403a05a6e25d0dc47cde not found: ID does not exist"
Sep 08 14:24:24.090075 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:24.090033    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzqct\" (UniqueName: \"kubernetes.io/projected/67023641-681e-4eb7-b5cf-80bd432bbdf7-kube-api-access-lzqct\") pod \"67023641-681e-4eb7-b5cf-80bd432bbdf7\" (UID: \"67023641-681e-4eb7-b5cf-80bd432bbdf7\") "
Sep 08 14:24:24.092217 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:24.092186    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67023641-681e-4eb7-b5cf-80bd432bbdf7-kube-api-access-lzqct" (OuterVolumeSpecName: "kube-api-access-lzqct") pod "67023641-681e-4eb7-b5cf-80bd432bbdf7" (UID: "67023641-681e-4eb7-b5cf-80bd432bbdf7"). InnerVolumeSpecName "kube-api-access-lzqct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:24:24.092345 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:24.092295    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5z768"
Sep 08 14:24:24.190982 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:24.190949    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzqct\" (UniqueName: \"kubernetes.io/projected/67023641-681e-4eb7-b5cf-80bd432bbdf7-kube-api-access-lzqct\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:24:24.304166 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:24:24.304135    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-5kstl\" is forbidden: User \"system:node:ip-10-0-131-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-123.ec2.internal' and this object" podUID="67023641-681e-4eb7-b5cf-80bd432bbdf7" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:24.361330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:24.361305    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5z768"]
Sep 08 14:24:24.363832 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:24:24.363804    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872e6740_57ef_4473_b9eb_59a1daec48ea.slice/crio-13e34778f315e712dbf72d8a2fe5d3fd5cf02c1a397f9d23463803cbb6694dbb WatchSource:0}: Error finding container 13e34778f315e712dbf72d8a2fe5d3fd5cf02c1a397f9d23463803cbb6694dbb: Status 404 returned error can't find the container with id 13e34778f315e712dbf72d8a2fe5d3fd5cf02c1a397f9d23463803cbb6694dbb
Sep 08 14:24:25.000471 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:25.000436    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5z768" event={"ID":"872e6740-57ef-4473-b9eb-59a1daec48ea","Type":"ContainerStarted","Data":"4eec1245031ba0542a89258cf8a886f87de2e5dbaacad15a7876d1f3d47609c0"}
Sep 08 14:24:25.000876 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:25.000524    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5z768" event={"ID":"872e6740-57ef-4473-b9eb-59a1daec48ea","Type":"ContainerStarted","Data":"13e34778f315e712dbf72d8a2fe5d3fd5cf02c1a397f9d23463803cbb6694dbb"}
Sep 08 14:24:25.000876 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:25.000579    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5z768"
Sep 08 14:24:25.002701 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:24:25.002679    2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-5kstl\" is forbidden: User \"system:node:ip-10-0-131-123.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-123.ec2.internal' and this object" podUID="67023641-681e-4eb7-b5cf-80bd432bbdf7" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5kstl"
Sep 08 14:24:25.022881 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:25.022832    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5z768" podStartSLOduration=2.022816079 podStartE2EDuration="2.022816079s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:24:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:24:25.021254521 +0000 UTC m=+466.417203953" watchObservedRunningTime="2026-09-08 14:24:25.022816079 +0000 UTC m=+466.418765512"
Sep 08 14:24:25.185662 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:25.185631    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67023641-681e-4eb7-b5cf-80bd432bbdf7" path="/var/lib/kubelet/pods/67023641-681e-4eb7-b5cf-80bd432bbdf7/volumes"
Sep 08 14:24:36.006812 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:36.006779    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-5z768"
Sep 08 14:24:37.004817 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:37.004788    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"]
Sep 08 14:24:37.007937 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:37.007915    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"
Sep 08 14:24:37.010818 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:37.010795    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-stv9z\""
Sep 08 14:24:37.019092 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:37.019068    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"]
Sep 08 14:24:37.094746 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:37.094712    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/995d8121-cfb3-4ab5-9d6b-1b53e665f2ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-srr9s\" (UID: \"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"
Sep 08 14:24:37.094746 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:37.094746    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj48g\" (UniqueName: \"kubernetes.io/projected/995d8121-cfb3-4ab5-9d6b-1b53e665f2ed-kube-api-access-gj48g\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-srr9s\" (UID: \"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"
Sep 08 14:24:37.195749 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:37.195719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/995d8121-cfb3-4ab5-9d6b-1b53e665f2ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-srr9s\" (UID: \"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"
Sep 08 14:24:37.195749 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:37.195750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj48g\" (UniqueName: \"kubernetes.io/projected/995d8121-cfb3-4ab5-9d6b-1b53e665f2ed-kube-api-access-gj48g\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-srr9s\" (UID: \"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"
Sep 08 14:24:37.196086 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:37.196067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/995d8121-cfb3-4ab5-9d6b-1b53e665f2ed-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-srr9s\" (UID: \"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"
Sep 08 14:24:37.204781 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:37.204760    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj48g\" (UniqueName: \"kubernetes.io/projected/995d8121-cfb3-4ab5-9d6b-1b53e665f2ed-kube-api-access-gj48g\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-srr9s\" (UID: \"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"
Sep 08 14:24:37.318581 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:37.318482    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"
Sep 08 14:24:37.602157 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:37.602136    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"]
Sep 08 14:24:37.603984 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:24:37.603954    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995d8121_cfb3_4ab5_9d6b_1b53e665f2ed.slice/crio-db29ffc32fb9adecbf6287e183946422aadfbe66fdf96c2af1c1a46e2bb15437 WatchSource:0}: Error finding container db29ffc32fb9adecbf6287e183946422aadfbe66fdf96c2af1c1a46e2bb15437: Status 404 returned error can't find the container with id db29ffc32fb9adecbf6287e183946422aadfbe66fdf96c2af1c1a46e2bb15437
Sep 08 14:24:38.057286 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:38.057204    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s" event={"ID":"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed","Type":"ContainerStarted","Data":"db29ffc32fb9adecbf6287e183946422aadfbe66fdf96c2af1c1a46e2bb15437"}
Sep 08 14:24:42.080202 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:42.080163    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s" event={"ID":"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed","Type":"ContainerStarted","Data":"a85b1c5afe49c1b059fa2c20c2102e0cc34e2c95df8b4eaeecfed7e5be6b1139"}
Sep 08 14:24:42.080634 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:42.080254    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"
Sep 08 14:24:42.101899 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:42.101833    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s" podStartSLOduration=2.4801120660000002 podStartE2EDuration="6.101817368s" totalImagesPullingTime="3.621705302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:24:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:24:42.099577371 +0000 UTC m=+483.495526804" watchObservedRunningTime="2026-09-08 14:24:42.101817368 +0000 UTC m=+483.497766799"
Sep 08 14:24:53.087625 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:24:53.087594    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"
Sep 08 14:27:09.152735 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.152662    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"]
Sep 08 14:27:09.155970 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.155950    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.159852 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.159831    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 08 14:27:09.159852 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.159847    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 14:27:09.160048 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.159847    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-68fbj\""
Sep 08 14:27:09.160048 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.159847    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 14:27:09.164769 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.164747    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"]
Sep 08 14:27:09.192520 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.192471    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkwdz\" (UniqueName: \"kubernetes.io/projected/d35e040b-2302-4f18-8244-edee480d6e82-kube-api-access-vkwdz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.192520 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.192518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d35e040b-2302-4f18-8244-edee480d6e82-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.192659 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.192593    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d35e040b-2302-4f18-8244-edee480d6e82-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.192659 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.192619    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d35e040b-2302-4f18-8244-edee480d6e82-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.192659 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.192635    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d35e040b-2302-4f18-8244-edee480d6e82-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.192659 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.192655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d35e040b-2302-4f18-8244-edee480d6e82-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.293852 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.293814    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d35e040b-2302-4f18-8244-edee480d6e82-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.294012 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.293872    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkwdz\" (UniqueName: \"kubernetes.io/projected/d35e040b-2302-4f18-8244-edee480d6e82-kube-api-access-vkwdz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.294012 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.293910    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d35e040b-2302-4f18-8244-edee480d6e82-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.294012 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.293996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d35e040b-2302-4f18-8244-edee480d6e82-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.294173 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.294022    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d35e040b-2302-4f18-8244-edee480d6e82-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.294173 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.294046    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d35e040b-2302-4f18-8244-edee480d6e82-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.294294 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.294243    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d35e040b-2302-4f18-8244-edee480d6e82-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.294383 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.294356    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d35e040b-2302-4f18-8244-edee480d6e82-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.294760 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.294736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d35e040b-2302-4f18-8244-edee480d6e82-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.296451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.296420    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d35e040b-2302-4f18-8244-edee480d6e82-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.297109 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.297086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d35e040b-2302-4f18-8244-edee480d6e82-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.303987 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.303963    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkwdz\" (UniqueName: \"kubernetes.io/projected/d35e040b-2302-4f18-8244-edee480d6e82-kube-api-access-vkwdz\") pod \"e2e-distinct-simulated-kserve-59975d69f9-zmfbl\" (UID: \"d35e040b-2302-4f18-8244-edee480d6e82\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.466911 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.466838    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:09.737342 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.737174    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"]
Sep 08 14:27:09.739837 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:27:09.739812    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35e040b_2302_4f18_8244_edee480d6e82.slice/crio-170d6408c97ccf8b999a96b49bc5bc1e7c8f583b026fe4fc9c3927bec6cae32b WatchSource:0}: Error finding container 170d6408c97ccf8b999a96b49bc5bc1e7c8f583b026fe4fc9c3927bec6cae32b: Status 404 returned error can't find the container with id 170d6408c97ccf8b999a96b49bc5bc1e7c8f583b026fe4fc9c3927bec6cae32b
Sep 08 14:27:09.745747 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:09.745717    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:27:10.718479 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:10.718275    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl" event={"ID":"d35e040b-2302-4f18-8244-edee480d6e82","Type":"ContainerStarted","Data":"170d6408c97ccf8b999a96b49bc5bc1e7c8f583b026fe4fc9c3927bec6cae32b"}
Sep 08 14:27:11.725673 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:11.725631    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl" event={"ID":"d35e040b-2302-4f18-8244-edee480d6e82","Type":"ContainerStarted","Data":"d283a3e55c7cffa81fd0d5b56d626d2ee5b8952bfa7f9ee6f013c9e44a568bac"}
Sep 08 14:27:11.742693 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:11.742647    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl" podStartSLOduration=1.769104843 podStartE2EDuration="2.742630415s" totalImagesPullingTime="973.525572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:27:11.741457583 +0000 UTC m=+633.137407016" watchObservedRunningTime="2026-09-08 14:27:11.742630415 +0000 UTC m=+633.138579845"
Sep 08 14:27:19.467072 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:19.467038    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:19.467441 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:19.467099    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:19.479135 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:19.479108    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:19.770038 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:19.769960    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-zmfbl"
Sep 08 14:27:54.249446 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.249411    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"]
Sep 08 14:27:54.253545 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.253524    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.255831 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.255812    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 08 14:27:54.262917 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.262891    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"]
Sep 08 14:27:54.360391 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.360356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/239c934e-9db5-46a3-9e5b-e5ec2e374394-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.360543 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.360417    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/239c934e-9db5-46a3-9e5b-e5ec2e374394-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.360543 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.360458    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/239c934e-9db5-46a3-9e5b-e5ec2e374394-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.360543 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.360518    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68bbd\" (UniqueName: \"kubernetes.io/projected/239c934e-9db5-46a3-9e5b-e5ec2e374394-kube-api-access-68bbd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.360543 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.360541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/239c934e-9db5-46a3-9e5b-e5ec2e374394-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.360683 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.360557    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/239c934e-9db5-46a3-9e5b-e5ec2e374394-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.460925 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.460899    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/239c934e-9db5-46a3-9e5b-e5ec2e374394-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.461067 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.460936    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/239c934e-9db5-46a3-9e5b-e5ec2e374394-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.461067 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.460972    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68bbd\" (UniqueName: \"kubernetes.io/projected/239c934e-9db5-46a3-9e5b-e5ec2e374394-kube-api-access-68bbd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.461067 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.460996    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/239c934e-9db5-46a3-9e5b-e5ec2e374394-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.461067 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.461013    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/239c934e-9db5-46a3-9e5b-e5ec2e374394-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.461067 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.461050    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/239c934e-9db5-46a3-9e5b-e5ec2e374394-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.461353 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.461331    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/239c934e-9db5-46a3-9e5b-e5ec2e374394-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.461389 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.461368    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/239c934e-9db5-46a3-9e5b-e5ec2e374394-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.461421 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.461404    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/239c934e-9db5-46a3-9e5b-e5ec2e374394-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.463216 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.463194    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/239c934e-9db5-46a3-9e5b-e5ec2e374394-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.463380 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.463361    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/239c934e-9db5-46a3-9e5b-e5ec2e374394-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.469653 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.469629    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68bbd\" (UniqueName: \"kubernetes.io/projected/239c934e-9db5-46a3-9e5b-e5ec2e374394-kube-api-access-68bbd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq\" (UID: \"239c934e-9db5-46a3-9e5b-e5ec2e374394\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.564755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.564689    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:27:54.835692 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.835668    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"]
Sep 08 14:27:54.837627 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:27:54.837602    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239c934e_9db5_46a3_9e5b_e5ec2e374394.slice/crio-51476ee24845f574fa36f9438a2d147ec3fac080f4df2a176c7352c012bdad07 WatchSource:0}: Error finding container 51476ee24845f574fa36f9438a2d147ec3fac080f4df2a176c7352c012bdad07: Status 404 returned error can't find the container with id 51476ee24845f574fa36f9438a2d147ec3fac080f4df2a176c7352c012bdad07
Sep 08 14:27:54.905989 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:54.905960    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq" event={"ID":"239c934e-9db5-46a3-9e5b-e5ec2e374394","Type":"ContainerStarted","Data":"51476ee24845f574fa36f9438a2d147ec3fac080f4df2a176c7352c012bdad07"}
Sep 08 14:27:55.913821 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:55.913783    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq" event={"ID":"239c934e-9db5-46a3-9e5b-e5ec2e374394","Type":"ContainerStarted","Data":"f200c34e0d60dda215addd47e807779aa98b302cfd5c192f9f06190fd8580334"}
Sep 08 14:27:55.933913 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:27:55.933852    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq" podStartSLOduration=1.7340049990000002 podStartE2EDuration="1.933836199s" totalImagesPullingTime="199.8312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:27:55.931432354 +0000 UTC m=+677.327381785" watchObservedRunningTime="2026-09-08 14:27:55.933836199 +0000 UTC m=+677.329785629"
Sep 08 14:28:04.565822 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:28:04.565791    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:28:04.566184 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:28:04.565840    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:28:04.577960 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:28:04.577940    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:28:04.963510 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:28:04.963471    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq"
Sep 08 14:29:59.117193 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.117159    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"]
Sep 08 14:29:59.120834 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.120808    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.123396 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.123374    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-75b8cd-openshift-default-dockercfg-n2wdn\""
Sep 08 14:29:59.131453 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.131432    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"]
Sep 08 14:29:59.250796 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.250756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxb2z\" (UniqueName: \"kubernetes.io/projected/ada11f62-4f21-4cd1-9d4d-79311cf25553-kube-api-access-gxb2z\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.250983 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.250824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-workload-socket\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.250983 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.250850    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ada11f62-4f21-4cd1-9d4d-79311cf25553-istiod-ca-cert\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.250983 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.250877    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-podinfo\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.250983 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.250897    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-envoy\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.251149 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.251015    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-data\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.251149 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.251044    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-credential-socket\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.251149 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.251075    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-token\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.251149 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.251113    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-workload-certs\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.352267 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.352232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-workload-socket\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.352267 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.352267    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ada11f62-4f21-4cd1-9d4d-79311cf25553-istiod-ca-cert\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.352551 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.352290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-podinfo\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.352551 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.352308    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-envoy\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.352551 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.352340    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-data\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.352551 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.352357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-credential-socket\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.352551 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.352382    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-token\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.352551 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.352422    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-workload-certs\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.352551 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.352459    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxb2z\" (UniqueName: \"kubernetes.io/projected/ada11f62-4f21-4cd1-9d4d-79311cf25553-kube-api-access-gxb2z\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.352890 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.352825    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-data\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.352890 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.352835    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-workload-certs\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.352999 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.352936    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-credential-socket\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.352999 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.352958    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-workload-socket\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.353143 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.353122    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ada11f62-4f21-4cd1-9d4d-79311cf25553-istiod-ca-cert\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.354774 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.354754    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-envoy\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.354965 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.354948    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-podinfo\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.360736 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.360720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-token\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.361142 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.361120    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxb2z\" (UniqueName: \"kubernetes.io/projected/ada11f62-4f21-4cd1-9d4d-79311cf25553-kube-api-access-gxb2z\") pod \"e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") " pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.432690 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.432626    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:29:59.704767 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.704690    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"]
Sep 08 14:29:59.708825 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:29:59.708798    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada11f62_4f21_4cd1_9d4d_79311cf25553.slice/crio-aa9ce1ed57ddccc5d593a186a9c58e7d2760f29f5063c141072a38078d6e5567 WatchSource:0}: Error finding container aa9ce1ed57ddccc5d593a186a9c58e7d2760f29f5063c141072a38078d6e5567: Status 404 returned error can't find the container with id aa9ce1ed57ddccc5d593a186a9c58e7d2760f29f5063c141072a38078d6e5567
Sep 08 14:29:59.711509 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.711456    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:29:59.711590 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.711563    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:29:59.711632 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:29:59.711592    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:00.138331 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:00.138300    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814630-5tg82"]
Sep 08 14:30:00.141604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:00.141586    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814630-5tg82"
Sep 08 14:30:00.143913 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:00.143891    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:30:00.148562 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:00.148541    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814630-5tg82"]
Sep 08 14:30:00.153710 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:00.153691    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814630-5tg82"
Sep 08 14:30:00.439035 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:00.438948    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814630-5tg82"]
Sep 08 14:30:00.442282 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:30:00.442256    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be8d86e_3065_4f55_a312_95ee029c8d42.slice/crio-46ef602df223ea0c86a6d4e23335e333cbf4fb65a17366060e848bf05af3b72b WatchSource:0}: Error finding container 46ef602df223ea0c86a6d4e23335e333cbf4fb65a17366060e848bf05af3b72b: Status 404 returned error can't find the container with id 46ef602df223ea0c86a6d4e23335e333cbf4fb65a17366060e848bf05af3b72b
Sep 08 14:30:00.443988 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:00.443952    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" event={"ID":"ada11f62-4f21-4cd1-9d4d-79311cf25553","Type":"ContainerStarted","Data":"ca6c5c6aa867026c877914a84dace2df3a8cb5561677df20b2b4631452664ae4"}
Sep 08 14:30:00.444087 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:00.444003    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" event={"ID":"ada11f62-4f21-4cd1-9d4d-79311cf25553","Type":"ContainerStarted","Data":"aa9ce1ed57ddccc5d593a186a9c58e7d2760f29f5063c141072a38078d6e5567"}
Sep 08 14:30:00.463979 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:00.463932    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" podStartSLOduration=1.463912531 podStartE2EDuration="1.463912531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:30:00.462904556 +0000 UTC m=+801.858853987" watchObservedRunningTime="2026-09-08 14:30:00.463912531 +0000 UTC m=+801.859861964"
Sep 08 14:30:01.433019 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:01.432935    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:30:01.439252 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:01.439226    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:30:01.450183 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:01.450147    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814630-5tg82" event={"ID":"6be8d86e-3065-4f55-a312-95ee029c8d42","Type":"ContainerStarted","Data":"46ef602df223ea0c86a6d4e23335e333cbf4fb65a17366060e848bf05af3b72b"}
Sep 08 14:30:01.450345 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:01.450325    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:30:01.451491 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:01.451465    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:30:03.461644 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:03.461607    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814630-5tg82" event={"ID":"6be8d86e-3065-4f55-a312-95ee029c8d42","Type":"ContainerStarted","Data":"25529945c02c0fe8e61868cb6657bee64d098377368514e0730d4be515912888"}
Sep 08 14:30:03.479778 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:03.479732    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814630-5tg82" podStartSLOduration=1.19827468 podStartE2EDuration="3.479716546s" totalImagesPullingTime="2.281441866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:30:03.478827188 +0000 UTC m=+804.874776621" watchObservedRunningTime="2026-09-08 14:30:03.479716546 +0000 UTC m=+804.875665977"
Sep 08 14:30:04.467803 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:04.467766    2564 generic.go:356] "Generic (PLEG): container finished" podID="6be8d86e-3065-4f55-a312-95ee029c8d42" containerID="25529945c02c0fe8e61868cb6657bee64d098377368514e0730d4be515912888" exitCode=0
Sep 08 14:30:04.468170 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:04.467858    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814630-5tg82" event={"ID":"6be8d86e-3065-4f55-a312-95ee029c8d42","Type":"ContainerDied","Data":"25529945c02c0fe8e61868cb6657bee64d098377368514e0730d4be515912888"}
Sep 08 14:30:05.596367 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:05.596338    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814630-5tg82"
Sep 08 14:30:06.477640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:06.477615    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814630-5tg82"
Sep 08 14:30:06.477799 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:06.477639    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814630-5tg82" event={"ID":"6be8d86e-3065-4f55-a312-95ee029c8d42","Type":"ContainerDied","Data":"46ef602df223ea0c86a6d4e23335e333cbf4fb65a17366060e848bf05af3b72b"}
Sep 08 14:30:06.477799 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:06.477679    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46ef602df223ea0c86a6d4e23335e333cbf4fb65a17366060e848bf05af3b72b"
Sep 08 14:30:07.669461 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.669427    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"]
Sep 08 14:30:07.680310 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.680283    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6be8d86e-3065-4f55-a312-95ee029c8d42" containerName="cleanup"
Sep 08 14:30:07.680552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.680469    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6be8d86e-3065-4f55-a312-95ee029c8d42" containerName="cleanup"
Sep 08 14:30:07.680783 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.680767    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6be8d86e-3065-4f55-a312-95ee029c8d42" containerName="cleanup"
Sep 08 14:30:07.685153 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.685134    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"]
Sep 08 14:30:07.685300 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.685273    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.687766 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.687747    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-32df8e95-openshift-default-dockercfg-xt72w\""
Sep 08 14:30:07.821401 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.821360    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-workload-certs\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.821401 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.821397    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-envoy\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.821618 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.821415    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlws5\" (UniqueName: \"kubernetes.io/projected/8a31bf36-55c5-4a27-8251-277ce648a0ad-kube-api-access-tlws5\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.821618 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.821527    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-data\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.821618 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.821570    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a31bf36-55c5-4a27-8251-277ce648a0ad-istiod-ca-cert\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.821713 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.821624    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-credential-socket\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.821713 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.821648    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-workload-socket\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.821713 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.821695    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-token\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.821793 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.821721    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-podinfo\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.922702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.922628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-workload-certs\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.922702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.922660    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-envoy\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.922702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.922681    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlws5\" (UniqueName: \"kubernetes.io/projected/8a31bf36-55c5-4a27-8251-277ce648a0ad-kube-api-access-tlws5\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.922948 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.922705    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-data\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.922948 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.922739    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a31bf36-55c5-4a27-8251-277ce648a0ad-istiod-ca-cert\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.922948 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.922757    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-credential-socket\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.922948 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.922778    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-workload-socket\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.922948 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.922815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-token\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.923201 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.922976    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-podinfo\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.923201 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.923128    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-workload-certs\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.923201 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.923182    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-credential-socket\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.923353 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.923233    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-workload-socket\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.923353 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.923267    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-data\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.923640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.923616    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a31bf36-55c5-4a27-8251-277ce648a0ad-istiod-ca-cert\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.924960 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.924937    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-envoy\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.925290 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.925272    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-podinfo\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.931556 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.931535    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-token\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.931872 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.931854    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlws5\" (UniqueName: \"kubernetes.io/projected/8a31bf36-55c5-4a27-8251-277ce648a0ad-kube-api-access-tlws5\") pod \"e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") " pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:07.996855 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:07.996829    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:08.273163 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:08.273046    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"]
Sep 08 14:30:08.275483 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:30:08.275450    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a31bf36_55c5_4a27_8251_277ce648a0ad.slice/crio-e370983aaccbdab933913b2278c99a74c7b3ea5a32c41b3b860b456a885561bd WatchSource:0}: Error finding container e370983aaccbdab933913b2278c99a74c7b3ea5a32c41b3b860b456a885561bd: Status 404 returned error can't find the container with id e370983aaccbdab933913b2278c99a74c7b3ea5a32c41b3b860b456a885561bd
Sep 08 14:30:08.277851 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:08.277821    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:08.277913 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:08.277904    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:08.277954 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:08.277934    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:08.487955 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:08.487912    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" event={"ID":"8a31bf36-55c5-4a27-8251-277ce648a0ad","Type":"ContainerStarted","Data":"1e21ac3aee6105beefc64bbb8a49f18a34928f03d6b16f7ae7cfeeb46f3263ab"}
Sep 08 14:30:08.488124 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:08.487976    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" event={"ID":"8a31bf36-55c5-4a27-8251-277ce648a0ad","Type":"ContainerStarted","Data":"e370983aaccbdab933913b2278c99a74c7b3ea5a32c41b3b860b456a885561bd"}
Sep 08 14:30:08.510765 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:08.510713    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" podStartSLOduration=1.5106951990000002 podStartE2EDuration="1.510695199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:30:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:30:08.510198736 +0000 UTC m=+809.906148192" watchObservedRunningTime="2026-09-08 14:30:08.510695199 +0000 UTC m=+809.906644627"
Sep 08 14:30:08.997542 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:08.997488    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:10.002353 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:10.002325    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:10.498882 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:10.498854    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:10.499869 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:10.499836    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:17.491661 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:17.491619    2564 patch_prober.go:28] interesting pod/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 14:30:17.492014 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:17.491687    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 14:30:18.068363 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.068329    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"]
Sep 08 14:30:18.071935 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.071916    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.074309 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.074291    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-ef197403-kserve-self-signed-certs\""
Sep 08 14:30:18.082077 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.082054    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"]
Sep 08 14:30:18.227438 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.227176    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-home\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.227438 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.227226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6ccj\" (UniqueName: \"kubernetes.io/projected/8d877ef3-3e73-4817-b311-03866013bef2-kube-api-access-w6ccj\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.227438 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.227325    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-dshm\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.227438 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.227350    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-model-cache\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.227438 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.227382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d877ef3-3e73-4817-b311-03866013bef2-tls-certs\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.227882 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.227481    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-tmp-dir\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.328235 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.328200    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-home\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.328235 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.328239    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ccj\" (UniqueName: \"kubernetes.io/projected/8d877ef3-3e73-4817-b311-03866013bef2-kube-api-access-w6ccj\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.328450 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.328333    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-dshm\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.328450 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.328357    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-model-cache\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.328450 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.328385    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d877ef3-3e73-4817-b311-03866013bef2-tls-certs\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.328450 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.328430    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-tmp-dir\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.328702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.328681    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-home\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.328769 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.328736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-tmp-dir\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.328895 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.328873    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-model-cache\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.330797 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.330769    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-dshm\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.331077 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.331056    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d877ef3-3e73-4817-b311-03866013bef2-tls-certs\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.337854 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.337823    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6ccj\" (UniqueName: \"kubernetes.io/projected/8d877ef3-3e73-4817-b311-03866013bef2-kube-api-access-w6ccj\") pod \"e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") " pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.382360 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.382337    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:18.679632 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:18.679608    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"]
Sep 08 14:30:18.682560 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:30:18.682536    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d877ef3_3e73_4817_b311_03866013bef2.slice/crio-6a41c0577607e51731a4f4e312fba7566520734002a2ec309806889d5ba9d099 WatchSource:0}: Error finding container 6a41c0577607e51731a4f4e312fba7566520734002a2ec309806889d5ba9d099: Status 404 returned error can't find the container with id 6a41c0577607e51731a4f4e312fba7566520734002a2ec309806889d5ba9d099
Sep 08 14:30:19.492688 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.492532    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"]
Sep 08 14:30:19.501321 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.501292    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.511800 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.508481    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-47d144-openshift-default-dockercfg-n4gjz\""
Sep 08 14:30:19.516131 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.516093    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"]
Sep 08 14:30:19.539854 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.539826    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-credential-socket\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.540004 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.539863    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jknv9\" (UniqueName: \"kubernetes.io/projected/b378114b-fa36-462c-b0a1-9f609e1899f6-kube-api-access-jknv9\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.540004 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.539895    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-envoy\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.540004 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.539912    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-podinfo\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.540159 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.540014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-workload-socket\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.540159 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.540053    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b378114b-fa36-462c-b0a1-9f609e1899f6-istiod-ca-cert\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.540262 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.540166    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-token\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.540262 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.540208    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-data\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.540324 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.540278    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-workload-certs\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.556280 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.556212    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz" event={"ID":"8d877ef3-3e73-4817-b311-03866013bef2","Type":"ContainerStarted","Data":"aadcdce120d1b6b6195ccc28cf0650a69355065e8319f31def8502042bea8ba0"}
Sep 08 14:30:19.556280 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.556262    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz" event={"ID":"8d877ef3-3e73-4817-b311-03866013bef2","Type":"ContainerStarted","Data":"6a41c0577607e51731a4f4e312fba7566520734002a2ec309806889d5ba9d099"}
Sep 08 14:30:19.558074 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.558055    2564 generic.go:356] "Generic (PLEG): container finished" podID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerID="ca6c5c6aa867026c877914a84dace2df3a8cb5561677df20b2b4631452664ae4" exitCode=0
Sep 08 14:30:19.558177 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.558128    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" event={"ID":"ada11f62-4f21-4cd1-9d4d-79311cf25553","Type":"ContainerDied","Data":"ca6c5c6aa867026c877914a84dace2df3a8cb5561677df20b2b4631452664ae4"}
Sep 08 14:30:19.558461 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.558445    2564 scope.go:117] "RemoveContainer" containerID="ca6c5c6aa867026c877914a84dace2df3a8cb5561677df20b2b4631452664ae4"
Sep 08 14:30:19.559598 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.559567    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:19.559696 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.559632    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:19.559696 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.559662    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:19.606518 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.605307    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz" podStartSLOduration=1.6052847479999999 podStartE2EDuration="1.605284748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:30:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:30:19.574492207 +0000 UTC m=+820.970441640" watchObservedRunningTime="2026-09-08 14:30:19.605284748 +0000 UTC m=+821.001234181"
Sep 08 14:30:19.641372 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.641221    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-envoy\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.641563 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.641290    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-podinfo\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.641739 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.641565    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-workload-socket\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.641739 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.641601    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b378114b-fa36-462c-b0a1-9f609e1899f6-istiod-ca-cert\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.641739 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.641691    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-token\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.641739 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.641724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-data\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.641958 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.641801    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-workload-certs\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.641958 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.641846    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-credential-socket\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.641958 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.641872    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jknv9\" (UniqueName: \"kubernetes.io/projected/b378114b-fa36-462c-b0a1-9f609e1899f6-kube-api-access-jknv9\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.643104 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.642719    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b378114b-fa36-462c-b0a1-9f609e1899f6-istiod-ca-cert\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.643104 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.643054    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-data\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.643104 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.643053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-workload-certs\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.643315 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.643157    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-credential-socket\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.643415 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.643385    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-workload-socket\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.644576 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.644519    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-envoy\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.645760 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.645736    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-podinfo\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.652861 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.652839    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-token\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.652996 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.652945    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jknv9\" (UniqueName: \"kubernetes.io/projected/b378114b-fa36-462c-b0a1-9f609e1899f6-kube-api-access-jknv9\") pod \"e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") " pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:19.823291 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:19.822989    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:20.102780 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:20.100617    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"]
Sep 08 14:30:20.114788 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:30:20.110675    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb378114b_fa36_462c_b0a1_9f609e1899f6.slice/crio-e9617e288cf145b9c9bf01d9d78c84d48429333fba06d0aaaded15d641042ed6 WatchSource:0}: Error finding container e9617e288cf145b9c9bf01d9d78c84d48429333fba06d0aaaded15d641042ed6: Status 404 returned error can't find the container with id e9617e288cf145b9c9bf01d9d78c84d48429333fba06d0aaaded15d641042ed6
Sep 08 14:30:20.114788 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:20.112915    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:20.114788 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:20.112994    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:20.114788 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:20.113036    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:20.564836 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:20.564741    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" event={"ID":"ada11f62-4f21-4cd1-9d4d-79311cf25553","Type":"ContainerStarted","Data":"5110363202e669f293a54ecd246e5da72eb59cfaffe0393984e6ec6c09bd784a"}
Sep 08 14:30:20.566845 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:20.566825    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" event={"ID":"b378114b-fa36-462c-b0a1-9f609e1899f6","Type":"ContainerStarted","Data":"9d345db8ba57a7bef8518927324540d3898eb91654ddb1b5bf47174876b3398c"}
Sep 08 14:30:20.566919 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:20.566864    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" event={"ID":"b378114b-fa36-462c-b0a1-9f609e1899f6","Type":"ContainerStarted","Data":"e9617e288cf145b9c9bf01d9d78c84d48429333fba06d0aaaded15d641042ed6"}
Sep 08 14:30:20.615330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:20.615114    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" podStartSLOduration=1.615092438 podStartE2EDuration="1.615092438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:30:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:30:20.611783717 +0000 UTC m=+822.007733177" watchObservedRunningTime="2026-09-08 14:30:20.615092438 +0000 UTC m=+822.011041868"
Sep 08 14:30:20.824810 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:20.824720    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:21.433478 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:21.433345    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:30:21.434144 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:21.434114    2564 patch_prober.go:28] interesting pod/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 08 14:30:21.434334 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:21.434306    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 08 14:30:21.836242 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:21.836202    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:22.433571 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:22.433528    2564 patch_prober.go:28] interesting pod/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 08 14:30:22.433792 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:22.433597    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 08 14:30:22.576532 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:22.576488    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:22.577558 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:22.577524    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:23.433450 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:23.433406    2564 patch_prober.go:28] interesting pod/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 08 14:30:23.433856 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:23.433468    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 08 14:30:24.434051 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:24.434018    2564 patch_prober.go:28] interesting pod/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 08 14:30:24.434548 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:24.434072    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 08 14:30:25.433701 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:25.433664    2564 patch_prober.go:28] interesting pod/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 08 14:30:25.433867 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:25.433722    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 08 14:30:26.049064 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:26.048224    2564 patch_prober.go:28] interesting pod/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": read tcp 10.134.0.2:43262->10.134.0.30:15021: read: connection reset by peer" start-of-body=
Sep 08 14:30:26.049064 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:26.048300    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": read tcp 10.134.0.2:43262->10.134.0.30:15021: read: connection reset by peer"
Sep 08 14:30:26.436863 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:26.436838    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:30:26.437133 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:26.437106    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:30:26.437778 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:26.437761    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:30:26.598817 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:26.598791    2564 generic.go:356] "Generic (PLEG): container finished" podID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerID="1e21ac3aee6105beefc64bbb8a49f18a34928f03d6b16f7ae7cfeeb46f3263ab" exitCode=0
Sep 08 14:30:26.598978 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:26.598873    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" event={"ID":"8a31bf36-55c5-4a27-8251-277ce648a0ad","Type":"ContainerDied","Data":"1e21ac3aee6105beefc64bbb8a49f18a34928f03d6b16f7ae7cfeeb46f3263ab"}
Sep 08 14:30:26.599429 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:26.599411    2564 scope.go:117] "RemoveContainer" containerID="1e21ac3aee6105beefc64bbb8a49f18a34928f03d6b16f7ae7cfeeb46f3263ab"
Sep 08 14:30:26.600587 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:26.600553    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:26.600679 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:26.600640    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:26.600716 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:26.600687    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:27.609396 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:27.609351    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" event={"ID":"8a31bf36-55c5-4a27-8251-277ce648a0ad","Type":"ContainerStarted","Data":"8978f8d046f03c3fcbd5d49f07395afe093594992276745294a20e5ce24aa1ba"}
Sep 08 14:30:27.997421 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:27.997275    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:27.997743 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:27.997717    2564 patch_prober.go:28] interesting pod/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 08 14:30:27.997921 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:27.997896    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 08 14:30:28.037268 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.037234    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"]
Sep 08 14:30:28.041625 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.041597    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.045774 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.044600    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"]
Sep 08 14:30:28.045774 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.045095    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-2a2de3-openshift-default-dockercfg-wghx2\""
Sep 08 14:30:28.135066 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.135012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-workload-socket\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.135265 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.135115    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-istio-envoy\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.135265 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.135170    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-workload-certs\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.135265 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.135196    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7865121e-40c0-4632-ad14-53b1b87af64d-istio-token\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.135410 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.135286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-credential-socket\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.135410 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.135317    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7865121e-40c0-4632-ad14-53b1b87af64d-istio-podinfo\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.135410 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.135345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-istio-data\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.135410 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.135374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7865121e-40c0-4632-ad14-53b1b87af64d-istiod-ca-cert\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.135561 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.135414    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcrzn\" (UniqueName: \"kubernetes.io/projected/7865121e-40c0-4632-ad14-53b1b87af64d-kube-api-access-gcrzn\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.236655 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.236611    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7865121e-40c0-4632-ad14-53b1b87af64d-istiod-ca-cert\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.236843 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.236679    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcrzn\" (UniqueName: \"kubernetes.io/projected/7865121e-40c0-4632-ad14-53b1b87af64d-kube-api-access-gcrzn\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.236843 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.236712    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-workload-socket\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.236843 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.236767    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-istio-envoy\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.236843 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.236822    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-workload-certs\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.237046 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.236845    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7865121e-40c0-4632-ad14-53b1b87af64d-istio-token\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.237046 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.236916    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-credential-socket\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.237046 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.236969    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7865121e-40c0-4632-ad14-53b1b87af64d-istio-podinfo\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.237046 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.237024    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-istio-data\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.237257 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.237228    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7865121e-40c0-4632-ad14-53b1b87af64d-istiod-ca-cert\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.237412 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.237394    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-istio-data\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.237412 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.237408    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-workload-certs\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.238007 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.237985    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-workload-socket\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.238007 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.238002    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-credential-socket\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.239785 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.239477    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-istio-envoy\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.240533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.240334    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7865121e-40c0-4632-ad14-53b1b87af64d-istio-podinfo\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.248945 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.248895    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcrzn\" (UniqueName: \"kubernetes.io/projected/7865121e-40c0-4632-ad14-53b1b87af64d-kube-api-access-gcrzn\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.249473 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.249452    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7865121e-40c0-4632-ad14-53b1b87af64d-istio-token\") pod \"e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") " pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.357158 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.357124    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:28.382944 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.382916    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:28.383041 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.382972    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:28.432521 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.432186    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:28.638853 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.638795    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:30:28.686297 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.686138    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"]
Sep 08 14:30:28.688960 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:30:28.688926    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7865121e_40c0_4632_ad14_53b1b87af64d.slice/crio-2ab7ea7ec9be7cf0d117c9f4fa76a2d1c5ec54683ecbe9e64addd6a2282a9aec WatchSource:0}: Error finding container 2ab7ea7ec9be7cf0d117c9f4fa76a2d1c5ec54683ecbe9e64addd6a2282a9aec: Status 404 returned error can't find the container with id 2ab7ea7ec9be7cf0d117c9f4fa76a2d1c5ec54683ecbe9e64addd6a2282a9aec
Sep 08 14:30:28.690823 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.690789    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:28.690966 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.690949    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:28.691081 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.691066    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:28.998027 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.997512    2564 patch_prober.go:28] interesting pod/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 08 14:30:28.998027 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:28.997578    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 08 14:30:29.638150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:29.638045    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" event={"ID":"7865121e-40c0-4632-ad14-53b1b87af64d","Type":"ContainerStarted","Data":"ab02f0d6d1e53f3c843125cac3cde7039c48c6bb74f9cd332e7bc5c85695c38f"}
Sep 08 14:30:29.638150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:29.638103    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" event={"ID":"7865121e-40c0-4632-ad14-53b1b87af64d","Type":"ContainerStarted","Data":"2ab7ea7ec9be7cf0d117c9f4fa76a2d1c5ec54683ecbe9e64addd6a2282a9aec"}
Sep 08 14:30:29.657624 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:29.657564    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" podStartSLOduration=1.6575360529999998 podStartE2EDuration="1.657536053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:30:29.656603751 +0000 UTC m=+831.052553182" watchObservedRunningTime="2026-09-08 14:30:29.657536053 +0000 UTC m=+831.053485479"
Sep 08 14:30:29.998185 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:29.998092    2564 patch_prober.go:28] interesting pod/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 08 14:30:29.998185 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:29.998167    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 08 14:30:30.357803 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:30.357772    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:30.362787 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:30.362764    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:30.645253 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:30.645171    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:30.647693 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:30.647666    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:30.998185 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:30.998098    2564 patch_prober.go:28] interesting pod/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 08 14:30:30.998773 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:30.998739    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 08 14:30:31.998130 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:31.998096    2564 patch_prober.go:28] interesting pod/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused" start-of-body=
Sep 08 14:30:31.998398 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:31.998372    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.30:15021/healthz/ready\": dial tcp 10.134.0.30:15021: connect: connection refused"
Sep 08 14:30:33.241219 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:33.241189    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:33.242208 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:33.242179    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:33.243177 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:33.243156    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:37.678519 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:37.678457    2564 patch_prober.go:28] interesting pod/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": read tcp 10.134.0.2:55508->10.134.0.32:15021: read: connection reset by peer" start-of-body=
Sep 08 14:30:37.678890 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:37.678544    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": read tcp 10.134.0.2:55508->10.134.0.32:15021: read: connection reset by peer"
Sep 08 14:30:38.696179 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:38.696139    2564 generic.go:356] "Generic (PLEG): container finished" podID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerID="9d345db8ba57a7bef8518927324540d3898eb91654ddb1b5bf47174876b3398c" exitCode=0
Sep 08 14:30:38.696644 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:38.696222    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" event={"ID":"b378114b-fa36-462c-b0a1-9f609e1899f6","Type":"ContainerDied","Data":"9d345db8ba57a7bef8518927324540d3898eb91654ddb1b5bf47174876b3398c"}
Sep 08 14:30:38.696710 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:38.696686    2564 scope.go:117] "RemoveContainer" containerID="9d345db8ba57a7bef8518927324540d3898eb91654ddb1b5bf47174876b3398c"
Sep 08 14:30:38.697862 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:38.697832    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:38.697947 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:38.697904    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:38.697947 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:38.697940    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:39.706944 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:39.706900    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" event={"ID":"b378114b-fa36-462c-b0a1-9f609e1899f6","Type":"ContainerStarted","Data":"835146c0e51baf013fa6b67c6ccecb2ed948121c1401993f1f49d7076add76fb"}
Sep 08 14:30:39.824097 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:39.824050    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:39.824433 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:39.824397    2564 patch_prober.go:28] interesting pod/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 14:30:39.824569 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:39.824453    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 14:30:40.556081 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:40.556055    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s"]
Sep 08 14:30:40.558835 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:40.558813    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s"
Sep 08 14:30:40.561257 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:40.561134    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:30:40.561411 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:40.561390    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:30:40.569218 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:40.569194    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s"]
Sep 08 14:30:40.660458 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:40.660420    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58ad4bd2-1807-4b5e-822e-6daddc97cd3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s\" (UID: \"58ad4bd2-1807-4b5e-822e-6daddc97cd3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s"
Sep 08 14:30:40.761356 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:40.761314    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58ad4bd2-1807-4b5e-822e-6daddc97cd3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s\" (UID: \"58ad4bd2-1807-4b5e-822e-6daddc97cd3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s"
Sep 08 14:30:40.762222 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:40.762200    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58ad4bd2-1807-4b5e-822e-6daddc97cd3d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s\" (UID: \"58ad4bd2-1807-4b5e-822e-6daddc97cd3d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s"
Sep 08 14:30:40.824760 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:40.824690    2564 patch_prober.go:28] interesting pod/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 14:30:40.824760 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:40.824738    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 14:30:40.871687 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:40.871660    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s"
Sep 08 14:30:41.172310 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:41.170342    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s"]
Sep 08 14:30:41.723823 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:41.723780    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s" event={"ID":"58ad4bd2-1807-4b5e-822e-6daddc97cd3d","Type":"ContainerStarted","Data":"ea746a0e831d40385479e0e4a87f36db3ed698608d71e6bbfa901021c68d09b2"}
Sep 08 14:30:41.724042 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:41.723851    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s" event={"ID":"58ad4bd2-1807-4b5e-822e-6daddc97cd3d","Type":"ContainerStarted","Data":"97b38bf20ad51afe2601816bc7e1533c72e64e3d11ecf013832afaecc1392af1"}
Sep 08 14:30:41.741681 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:41.741605    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s" podStartSLOduration=1.741571513 podStartE2EDuration="1.741571513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:30:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:30:41.740403975 +0000 UTC m=+843.136353408" watchObservedRunningTime="2026-09-08 14:30:41.741571513 +0000 UTC m=+843.137520944"
Sep 08 14:30:41.824760 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:41.824654    2564 patch_prober.go:28] interesting pod/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 14:30:41.824760 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:41.824729    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 14:30:42.732619 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:42.732588    2564 generic.go:356] "Generic (PLEG): container finished" podID="58ad4bd2-1807-4b5e-822e-6daddc97cd3d" containerID="ea746a0e831d40385479e0e4a87f36db3ed698608d71e6bbfa901021c68d09b2" exitCode=0
Sep 08 14:30:42.732864 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:42.732768    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s" event={"ID":"58ad4bd2-1807-4b5e-822e-6daddc97cd3d","Type":"ContainerDied","Data":"ea746a0e831d40385479e0e4a87f36db3ed698608d71e6bbfa901021c68d09b2"}
Sep 08 14:30:42.825133 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:42.825096    2564 patch_prober.go:28] interesting pod/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 14:30:42.825676 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:42.825648    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 14:30:43.825311 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:43.824868    2564 patch_prober.go:28] interesting pod/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 14:30:43.825311 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:43.824930    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 14:30:43.965730 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:43.965610    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s"
Sep 08 14:30:44.093277 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:44.093252    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58ad4bd2-1807-4b5e-822e-6daddc97cd3d-maas-api-service-ca\") pod \"58ad4bd2-1807-4b5e-822e-6daddc97cd3d\" (UID: \"58ad4bd2-1807-4b5e-822e-6daddc97cd3d\") "
Sep 08 14:30:44.093790 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:44.093760    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58ad4bd2-1807-4b5e-822e-6daddc97cd3d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "58ad4bd2-1807-4b5e-822e-6daddc97cd3d" (UID: "58ad4bd2-1807-4b5e-822e-6daddc97cd3d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:30:44.194334 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:44.194303    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58ad4bd2-1807-4b5e-822e-6daddc97cd3d-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:30:44.749460 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:44.749430    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s" event={"ID":"58ad4bd2-1807-4b5e-822e-6daddc97cd3d","Type":"ContainerDied","Data":"97b38bf20ad51afe2601816bc7e1533c72e64e3d11ecf013832afaecc1392af1"}
Sep 08 14:30:44.749674 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:44.749582    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97b38bf20ad51afe2601816bc7e1533c72e64e3d11ecf013832afaecc1392af1"
Sep 08 14:30:44.749674 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:44.749446    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s"
Sep 08 14:30:44.824897 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:44.824860    2564 patch_prober.go:28] interesting pod/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 14:30:44.825154 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:44.825124    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 14:30:45.827716 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:45.827683    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:45.828096 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:45.827957    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:45.828552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:45.828537    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:30:49.776118 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:49.776027    2564 generic.go:356] "Generic (PLEG): container finished" podID="7865121e-40c0-4632-ad14-53b1b87af64d" containerID="ab02f0d6d1e53f3c843125cac3cde7039c48c6bb74f9cd332e7bc5c85695c38f" exitCode=0
Sep 08 14:30:49.776118 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:49.776083    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" event={"ID":"7865121e-40c0-4632-ad14-53b1b87af64d","Type":"ContainerDied","Data":"ab02f0d6d1e53f3c843125cac3cde7039c48c6bb74f9cd332e7bc5c85695c38f"}
Sep 08 14:30:49.776560 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:49.776432    2564 scope.go:117] "RemoveContainer" containerID="ab02f0d6d1e53f3c843125cac3cde7039c48c6bb74f9cd332e7bc5c85695c38f"
Sep 08 14:30:49.777568 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:49.777536    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:49.777641 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:49.777621    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:49.777679 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:49.777663    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:50.782772 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:50.782737    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" event={"ID":"7865121e-40c0-4632-ad14-53b1b87af64d","Type":"ContainerStarted","Data":"097e5182cb5c84e7204919f9876e925e859dc96e1f546be483473a61d128b2e2"}
Sep 08 14:30:51.357237 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:51.357207    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:51.357513 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:51.357473    2564 patch_prober.go:28] interesting pod/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 14:30:51.357576 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:51.357556    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 14:30:52.032192 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:52.032156    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s"]
Sep 08 14:30:52.036038 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:52.036012    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-32df8e95-ssn9s"]
Sep 08 14:30:52.176160 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:52.176126    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"]
Sep 08 14:30:52.176408 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:52.176369    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerName="istio-proxy" containerID="cri-o://8978f8d046f03c3fcbd5d49f07395afe093594992276745294a20e5ce24aa1ba" gracePeriod=30
Sep 08 14:30:52.357590 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:52.357557    2564 patch_prober.go:28] interesting pod/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 14:30:52.357761 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:52.357610    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 14:30:53.175315 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.175277    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"]
Sep 08 14:30:53.175856 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.175836    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58ad4bd2-1807-4b5e-822e-6daddc97cd3d" containerName="revoke-keys"
Sep 08 14:30:53.175929 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.175859    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="58ad4bd2-1807-4b5e-822e-6daddc97cd3d" containerName="revoke-keys"
Sep 08 14:30:53.176002 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.175987    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="58ad4bd2-1807-4b5e-822e-6daddc97cd3d" containerName="revoke-keys"
Sep 08 14:30:53.178055 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.178038    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.180593 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.180568    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-0416fe39-gw-openshift-default-dockercfg-tzsjz\""
Sep 08 14:30:53.189142 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.189118    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58ad4bd2-1807-4b5e-822e-6daddc97cd3d" path="/var/lib/kubelet/pods/58ad4bd2-1807-4b5e-822e-6daddc97cd3d/volumes"
Sep 08 14:30:53.191285 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.191261    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"]
Sep 08 14:30:53.290626 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.289718    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-credential-socket\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.290626 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.289810    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-workload-socket\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.290626 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.289837    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-envoy\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.290626 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.289872    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-workload-certs\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.290626 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.289920    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-data\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.290626 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.289941    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-podinfo\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.290626 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.289969    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psb4h\" (UniqueName: \"kubernetes.io/projected/9f9bc194-70da-4dbb-bf94-788ff2efc078-kube-api-access-psb4h\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.290626 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.290013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f9bc194-70da-4dbb-bf94-788ff2efc078-istiod-ca-cert\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.290626 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.290079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-token\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.357668 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.357633    2564 patch_prober.go:28] interesting pod/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 14:30:53.357819 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.357698    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 14:30:53.391084 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391058    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f9bc194-70da-4dbb-bf94-788ff2efc078-istiod-ca-cert\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.391215 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-token\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.391215 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391128    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-credential-socket\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.391215 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391187    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-workload-socket\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.391215 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391211    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-envoy\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.391424 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391240    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-workload-certs\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.391424 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391282    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-data\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.391424 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391305    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-podinfo\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.391424 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391329    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psb4h\" (UniqueName: \"kubernetes.io/projected/9f9bc194-70da-4dbb-bf94-788ff2efc078-kube-api-access-psb4h\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.391680 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391658    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-workload-socket\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.391745 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391718    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-data\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.391917 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391894    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f9bc194-70da-4dbb-bf94-788ff2efc078-istiod-ca-cert\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.392001 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391933    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-workload-certs\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.392001 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.391983    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-credential-socket\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.393910 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.393878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-podinfo\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.395028 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.394989    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-envoy\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.402985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.402953    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-token\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.403124 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.403102    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psb4h\" (UniqueName: \"kubernetes.io/projected/9f9bc194-70da-4dbb-bf94-788ff2efc078-kube-api-access-psb4h\") pod \"e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") " pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.491473 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.491384    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:53.797270 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.797176    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"]
Sep 08 14:30:53.818367 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:30:53.816618    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f9bc194_70da_4dbb_bf94_788ff2efc078.slice/crio-1102ad887d92c0d17e32802003d4e805d4a0181b28ba78e811ea2abbc6a91f74 WatchSource:0}: Error finding container 1102ad887d92c0d17e32802003d4e805d4a0181b28ba78e811ea2abbc6a91f74: Status 404 returned error can't find the container with id 1102ad887d92c0d17e32802003d4e805d4a0181b28ba78e811ea2abbc6a91f74
Sep 08 14:30:53.818615 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.818575    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:53.818704 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.818668    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:53.818761 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:53.818710    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:30:54.358009 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:54.357975    2564 patch_prober.go:28] interesting pod/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 14:30:54.358378 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:54.358034    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 14:30:54.826278 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:54.826246    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" event={"ID":"9f9bc194-70da-4dbb-bf94-788ff2efc078","Type":"ContainerStarted","Data":"63283ba3b82394911b63eaaa926396b838ef90c65c4280c975fdcd2eb0be8f8d"}
Sep 08 14:30:54.826440 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:54.826329    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" event={"ID":"9f9bc194-70da-4dbb-bf94-788ff2efc078","Type":"ContainerStarted","Data":"1102ad887d92c0d17e32802003d4e805d4a0181b28ba78e811ea2abbc6a91f74"}
Sep 08 14:30:54.847611 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:54.847559    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" podStartSLOduration=1.847542155 podStartE2EDuration="1.847542155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:30:54.845190956 +0000 UTC m=+856.241140387" watchObservedRunningTime="2026-09-08 14:30:54.847542155 +0000 UTC m=+856.243491586"
Sep 08 14:30:55.358162 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:55.358127    2564 patch_prober.go:28] interesting pod/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 14:30:55.358547 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:55.358183    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 14:30:55.491681 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:55.491646    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:55.499777 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:55.499746    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:55.831088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:55.831060    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:55.832172 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:55.832151    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:30:56.361712 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:56.361678    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:56.362125 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:56.361989    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:56.362655 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:56.362638    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:30:57.441516 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.441443    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:57.537289 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537256    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-workload-certs\") pod \"8a31bf36-55c5-4a27-8251-277ce648a0ad\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") "
Sep 08 14:30:57.537456 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537294    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlws5\" (UniqueName: \"kubernetes.io/projected/8a31bf36-55c5-4a27-8251-277ce648a0ad-kube-api-access-tlws5\") pod \"8a31bf36-55c5-4a27-8251-277ce648a0ad\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") "
Sep 08 14:30:57.537456 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537372    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-data\") pod \"8a31bf36-55c5-4a27-8251-277ce648a0ad\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") "
Sep 08 14:30:57.537456 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537395    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a31bf36-55c5-4a27-8251-277ce648a0ad-istiod-ca-cert\") pod \"8a31bf36-55c5-4a27-8251-277ce648a0ad\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") "
Sep 08 14:30:57.537456 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537418    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-podinfo\") pod \"8a31bf36-55c5-4a27-8251-277ce648a0ad\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") "
Sep 08 14:30:57.537456 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537444    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-workload-socket\") pod \"8a31bf36-55c5-4a27-8251-277ce648a0ad\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") "
Sep 08 14:30:57.537745 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537490    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-credential-socket\") pod \"8a31bf36-55c5-4a27-8251-277ce648a0ad\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") "
Sep 08 14:30:57.537745 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537557    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-token\") pod \"8a31bf36-55c5-4a27-8251-277ce648a0ad\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") "
Sep 08 14:30:57.537745 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537605    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-envoy\") pod \"8a31bf36-55c5-4a27-8251-277ce648a0ad\" (UID: \"8a31bf36-55c5-4a27-8251-277ce648a0ad\") "
Sep 08 14:30:57.537745 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537635    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a31bf36-55c5-4a27-8251-277ce648a0ad" (UID: "8a31bf36-55c5-4a27-8251-277ce648a0ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:30:57.537745 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537649    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a31bf36-55c5-4a27-8251-277ce648a0ad" (UID: "8a31bf36-55c5-4a27-8251-277ce648a0ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:30:57.537991 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537774    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a31bf36-55c5-4a27-8251-277ce648a0ad" (UID: "8a31bf36-55c5-4a27-8251-277ce648a0ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:30:57.537991 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537788    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a31bf36-55c5-4a27-8251-277ce648a0ad" (UID: "8a31bf36-55c5-4a27-8251-277ce648a0ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:30:57.537991 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537973    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-workload-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:30:57.538150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.537996    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-data\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:30:57.538150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.538008    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-workload-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:30:57.538150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.538021    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-credential-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:30:57.538150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.538065    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a31bf36-55c5-4a27-8251-277ce648a0ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a31bf36-55c5-4a27-8251-277ce648a0ad" (UID: "8a31bf36-55c5-4a27-8251-277ce648a0ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:30:57.539786 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.539764    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a31bf36-55c5-4a27-8251-277ce648a0ad" (UID: "8a31bf36-55c5-4a27-8251-277ce648a0ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:30:57.539786 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.539773    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a31bf36-55c5-4a27-8251-277ce648a0ad" (UID: "8a31bf36-55c5-4a27-8251-277ce648a0ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:30:57.540029 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.540012    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a31bf36-55c5-4a27-8251-277ce648a0ad-kube-api-access-tlws5" (OuterVolumeSpecName: "kube-api-access-tlws5") pod "8a31bf36-55c5-4a27-8251-277ce648a0ad" (UID: "8a31bf36-55c5-4a27-8251-277ce648a0ad"). InnerVolumeSpecName "kube-api-access-tlws5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:30:57.540277 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.540253    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a31bf36-55c5-4a27-8251-277ce648a0ad" (UID: "8a31bf36-55c5-4a27-8251-277ce648a0ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:30:57.638611 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.638586    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-envoy\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:30:57.638611 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.638609    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlws5\" (UniqueName: \"kubernetes.io/projected/8a31bf36-55c5-4a27-8251-277ce648a0ad-kube-api-access-tlws5\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:30:57.638747 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.638618    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a31bf36-55c5-4a27-8251-277ce648a0ad-istiod-ca-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:30:57.638747 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.638627    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-podinfo\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:30:57.638747 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.638634    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a31bf36-55c5-4a27-8251-277ce648a0ad-istio-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:30:57.841232 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.841206    2564 generic.go:356] "Generic (PLEG): container finished" podID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerID="8978f8d046f03c3fcbd5d49f07395afe093594992276745294a20e5ce24aa1ba" exitCode=0
Sep 08 14:30:57.841390 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.841254    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"
Sep 08 14:30:57.841390 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.841286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" event={"ID":"8a31bf36-55c5-4a27-8251-277ce648a0ad","Type":"ContainerDied","Data":"8978f8d046f03c3fcbd5d49f07395afe093594992276745294a20e5ce24aa1ba"}
Sep 08 14:30:57.841390 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.841335    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77" event={"ID":"8a31bf36-55c5-4a27-8251-277ce648a0ad","Type":"ContainerDied","Data":"e370983aaccbdab933913b2278c99a74c7b3ea5a32c41b3b860b456a885561bd"}
Sep 08 14:30:57.841390 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.841357    2564 scope.go:117] "RemoveContainer" containerID="8978f8d046f03c3fcbd5d49f07395afe093594992276745294a20e5ce24aa1ba"
Sep 08 14:30:57.850678 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.850661    2564 scope.go:117] "RemoveContainer" containerID="1e21ac3aee6105beefc64bbb8a49f18a34928f03d6b16f7ae7cfeeb46f3263ab"
Sep 08 14:30:57.858080 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.858061    2564 scope.go:117] "RemoveContainer" containerID="8978f8d046f03c3fcbd5d49f07395afe093594992276745294a20e5ce24aa1ba"
Sep 08 14:30:57.858317 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:30:57.858298    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8978f8d046f03c3fcbd5d49f07395afe093594992276745294a20e5ce24aa1ba\": container with ID starting with 8978f8d046f03c3fcbd5d49f07395afe093594992276745294a20e5ce24aa1ba not found: ID does not exist" containerID="8978f8d046f03c3fcbd5d49f07395afe093594992276745294a20e5ce24aa1ba"
Sep 08 14:30:57.858408 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.858323    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8978f8d046f03c3fcbd5d49f07395afe093594992276745294a20e5ce24aa1ba"} err="failed to get container status \"8978f8d046f03c3fcbd5d49f07395afe093594992276745294a20e5ce24aa1ba\": rpc error: code = NotFound desc = could not find container \"8978f8d046f03c3fcbd5d49f07395afe093594992276745294a20e5ce24aa1ba\": container with ID starting with 8978f8d046f03c3fcbd5d49f07395afe093594992276745294a20e5ce24aa1ba not found: ID does not exist"
Sep 08 14:30:57.858408 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.858339    2564 scope.go:117] "RemoveContainer" containerID="1e21ac3aee6105beefc64bbb8a49f18a34928f03d6b16f7ae7cfeeb46f3263ab"
Sep 08 14:30:57.858580 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:30:57.858560    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e21ac3aee6105beefc64bbb8a49f18a34928f03d6b16f7ae7cfeeb46f3263ab\": container with ID starting with 1e21ac3aee6105beefc64bbb8a49f18a34928f03d6b16f7ae7cfeeb46f3263ab not found: ID does not exist" containerID="1e21ac3aee6105beefc64bbb8a49f18a34928f03d6b16f7ae7cfeeb46f3263ab"
Sep 08 14:30:57.858627 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.858586    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e21ac3aee6105beefc64bbb8a49f18a34928f03d6b16f7ae7cfeeb46f3263ab"} err="failed to get container status \"1e21ac3aee6105beefc64bbb8a49f18a34928f03d6b16f7ae7cfeeb46f3263ab\": rpc error: code = NotFound desc = could not find container \"1e21ac3aee6105beefc64bbb8a49f18a34928f03d6b16f7ae7cfeeb46f3263ab\": container with ID starting with 1e21ac3aee6105beefc64bbb8a49f18a34928f03d6b16f7ae7cfeeb46f3263ab not found: ID does not exist"
Sep 08 14:30:57.871578 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.871013    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"]
Sep 08 14:30:57.876684 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:57.876659    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-32df8e95-openshift-default-f98c684c6-bzc77"]
Sep 08 14:30:59.186229 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:30:59.186196    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" path="/var/lib/kubelet/pods/8a31bf36-55c5-4a27-8251-277ce648a0ad/volumes"
Sep 08 14:31:10.832628 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:10.832591    2564 patch_prober.go:28] interesting pod/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 14:31:10.832998 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:10.832658    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 14:31:10.907825 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:10.907756    2564 generic.go:356] "Generic (PLEG): container finished" podID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerID="63283ba3b82394911b63eaaa926396b838ef90c65c4280c975fdcd2eb0be8f8d" exitCode=0
Sep 08 14:31:10.907825 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:10.907807    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" event={"ID":"9f9bc194-70da-4dbb-bf94-788ff2efc078","Type":"ContainerDied","Data":"63283ba3b82394911b63eaaa926396b838ef90c65c4280c975fdcd2eb0be8f8d"}
Sep 08 14:31:10.908168 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:10.908154    2564 scope.go:117] "RemoveContainer" containerID="63283ba3b82394911b63eaaa926396b838ef90c65c4280c975fdcd2eb0be8f8d"
Sep 08 14:31:10.909232 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:10.909203    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:31:10.909288 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:10.909272    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:31:10.909326 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:10.909302    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:31:11.918274 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:11.918232    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" event={"ID":"9f9bc194-70da-4dbb-bf94-788ff2efc078","Type":"ContainerStarted","Data":"7911eebe57d6a0ca5d18c10a211fc024ac85dd86b6711d23253391bc966f15be"}
Sep 08 14:31:12.491976 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:12.491943    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:31:12.492144 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:12.492123    2564 patch_prober.go:28] interesting pod/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 14:31:12.492186 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:12.492172    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 14:31:13.492113 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:13.492081    2564 patch_prober.go:28] interesting pod/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 14:31:13.492486 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:13.492147    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 14:31:14.492019 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:14.491984    2564 patch_prober.go:28] interesting pod/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 14:31:14.492192 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:14.492039    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 14:31:15.492143 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:15.492106    2564 patch_prober.go:28] interesting pod/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 14:31:15.492309 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:15.492174    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 14:31:16.491965 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:16.491929    2564 patch_prober.go:28] interesting pod/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 14:31:16.492136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:16.491991    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 14:31:17.495874 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:17.495839    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:31:17.496298 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:17.496214    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:31:17.496872 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:17.496851    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:31:21.370106 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.370073    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh"]
Sep 08 14:31:21.370453 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.370413    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerName="istio-proxy"
Sep 08 14:31:21.370453 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.370423    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerName="istio-proxy"
Sep 08 14:31:21.370453 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.370432    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerName="istio-proxy"
Sep 08 14:31:21.370453 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.370437    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerName="istio-proxy"
Sep 08 14:31:21.370598 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.370516    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerName="istio-proxy"
Sep 08 14:31:21.370598 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.370524    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a31bf36-55c5-4a27-8251-277ce648a0ad" containerName="istio-proxy"
Sep 08 14:31:21.373419 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.373401    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh"
Sep 08 14:31:21.375743 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.375720    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:31:21.375849 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.375767    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:31:21.381690 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.381658    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh"]
Sep 08 14:31:21.458309 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.458280    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4952e01-1588-4d76-8de3-79a1febcf748-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh\" (UID: \"f4952e01-1588-4d76-8de3-79a1febcf748\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh"
Sep 08 14:31:21.558844 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.558815    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4952e01-1588-4d76-8de3-79a1febcf748-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh\" (UID: \"f4952e01-1588-4d76-8de3-79a1febcf748\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh"
Sep 08 14:31:21.559281 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.559261    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4952e01-1588-4d76-8de3-79a1febcf748-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh\" (UID: \"f4952e01-1588-4d76-8de3-79a1febcf748\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh"
Sep 08 14:31:21.684078 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.684005    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh"
Sep 08 14:31:21.952279 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.952249    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh"]
Sep 08 14:31:21.954248 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:31:21.954215    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4952e01_1588_4d76_8de3_79a1febcf748.slice/crio-0f1b2a4fa9d9dd335efb238e34beb88a8d1cf571d7e9567be4b1ab3f8e048c32 WatchSource:0}: Error finding container 0f1b2a4fa9d9dd335efb238e34beb88a8d1cf571d7e9567be4b1ab3f8e048c32: Status 404 returned error can't find the container with id 0f1b2a4fa9d9dd335efb238e34beb88a8d1cf571d7e9567be4b1ab3f8e048c32
Sep 08 14:31:21.969114 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:21.969089    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh" event={"ID":"f4952e01-1588-4d76-8de3-79a1febcf748","Type":"ContainerStarted","Data":"0f1b2a4fa9d9dd335efb238e34beb88a8d1cf571d7e9567be4b1ab3f8e048c32"}
Sep 08 14:31:22.975017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:22.974983    2564 generic.go:356] "Generic (PLEG): container finished" podID="f4952e01-1588-4d76-8de3-79a1febcf748" containerID="e644ca315d29f78377241e0b39271d601770f41afb58fb0ecc1ecdec3f5518fb" exitCode=0
Sep 08 14:31:22.975387 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:22.975068    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh" event={"ID":"f4952e01-1588-4d76-8de3-79a1febcf748","Type":"ContainerDied","Data":"e644ca315d29f78377241e0b39271d601770f41afb58fb0ecc1ecdec3f5518fb"}
Sep 08 14:31:24.116456 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:24.116433    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh"
Sep 08 14:31:24.183438 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:24.183402    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4952e01-1588-4d76-8de3-79a1febcf748-maas-api-service-ca\") pod \"f4952e01-1588-4d76-8de3-79a1febcf748\" (UID: \"f4952e01-1588-4d76-8de3-79a1febcf748\") "
Sep 08 14:31:24.183763 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:24.183741    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4952e01-1588-4d76-8de3-79a1febcf748-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f4952e01-1588-4d76-8de3-79a1febcf748" (UID: "f4952e01-1588-4d76-8de3-79a1febcf748"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:31:24.285016 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:24.284928    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4952e01-1588-4d76-8de3-79a1febcf748-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:31:24.991528 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:24.991485    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh"
Sep 08 14:31:24.991528 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:24.991518    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh" event={"ID":"f4952e01-1588-4d76-8de3-79a1febcf748","Type":"ContainerDied","Data":"0f1b2a4fa9d9dd335efb238e34beb88a8d1cf571d7e9567be4b1ab3f8e048c32"}
Sep 08 14:31:24.991736 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:24.991582    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f1b2a4fa9d9dd335efb238e34beb88a8d1cf571d7e9567be4b1ab3f8e048c32"
Sep 08 14:31:28.118271 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:28.118238    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh"]
Sep 08 14:31:28.123327 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:28.123304    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0416fe39-kmxmh"]
Sep 08 14:31:28.257162 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:28.257133    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"]
Sep 08 14:31:28.257382 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:28.257335    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy" containerID="cri-o://7911eebe57d6a0ca5d18c10a211fc024ac85dd86b6711d23253391bc966f15be" gracePeriod=30
Sep 08 14:31:29.033524 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.033481    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"]
Sep 08 14:31:29.033843 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.033831    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4952e01-1588-4d76-8de3-79a1febcf748" containerName="revoke-keys"
Sep 08 14:31:29.033887 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.033844    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4952e01-1588-4d76-8de3-79a1febcf748" containerName="revoke-keys"
Sep 08 14:31:29.033919 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.033908    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4952e01-1588-4d76-8de3-79a1febcf748" containerName="revoke-keys"
Sep 08 14:31:29.037078 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.037057    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.040227 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.040205    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5298415e-openshift-default-dockercfg-7zht2\""
Sep 08 14:31:29.066728 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.066699    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"]
Sep 08 14:31:29.128415 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.128382    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-workload-socket\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.129451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.128911    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-token\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.129451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.128998    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-data\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.129451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.129063    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67dmb\" (UniqueName: \"kubernetes.io/projected/94bc9845-6613-4055-b754-6cc8c3b157e2-kube-api-access-67dmb\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.129451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.129146    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-credential-socket\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.129451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.129172    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94bc9845-6613-4055-b754-6cc8c3b157e2-istiod-ca-cert\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.129451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.129226    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-workload-certs\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.129451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.129307    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-podinfo\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.129451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.129338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-envoy\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.185882 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.185845    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4952e01-1588-4d76-8de3-79a1febcf748" path="/var/lib/kubelet/pods/f4952e01-1588-4d76-8de3-79a1febcf748/volumes"
Sep 08 14:31:29.230256 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.230222    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-credential-socket\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.230256 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.230252    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94bc9845-6613-4055-b754-6cc8c3b157e2-istiod-ca-cert\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.230472 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.230285    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-workload-certs\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.230472 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.230321    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-podinfo\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.230472 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.230429    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-envoy\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.230665 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.230529    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-workload-socket\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.230665 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.230565    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-token\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.230665 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.230596    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-data\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.230665 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.230640    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67dmb\" (UniqueName: \"kubernetes.io/projected/94bc9845-6613-4055-b754-6cc8c3b157e2-kube-api-access-67dmb\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.230845 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.230765    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-credential-socket\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.231108 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.231044    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94bc9845-6613-4055-b754-6cc8c3b157e2-istiod-ca-cert\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.231214 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.231175    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-workload-socket\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.231283 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.231220    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-data\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.231364 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.231340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-workload-certs\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.233241 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.233218    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-envoy\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.233563 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.233545    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-podinfo\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.243402 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.243382    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-token\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.244056 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.244030    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67dmb\" (UniqueName: \"kubernetes.io/projected/94bc9845-6613-4055-b754-6cc8c3b157e2-kube-api-access-67dmb\") pod \"e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") " pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.367120 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.367089    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:29.647423 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.647334    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"]
Sep 08 14:31:29.650315 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:31:29.650287    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94bc9845_6613_4055_b754_6cc8c3b157e2.slice/crio-dd376a257a806798a55a24ebd825a4e8ed07a6828ec27e1abc596e4ab1889e2d WatchSource:0}: Error finding container dd376a257a806798a55a24ebd825a4e8ed07a6828ec27e1abc596e4ab1889e2d: Status 404 returned error can't find the container with id dd376a257a806798a55a24ebd825a4e8ed07a6828ec27e1abc596e4ab1889e2d
Sep 08 14:31:29.652331 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.652295    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:31:29.652429 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.652370    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:31:29.652429 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:29.652412    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:31:30.020256 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:30.020174    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc" event={"ID":"94bc9845-6613-4055-b754-6cc8c3b157e2","Type":"ContainerStarted","Data":"962b1249be6894c79dd512a2695cad8bbdbb40c0755ddc1723134666999dae70"}
Sep 08 14:31:30.020256 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:30.020224    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc" event={"ID":"94bc9845-6613-4055-b754-6cc8c3b157e2","Type":"ContainerStarted","Data":"dd376a257a806798a55a24ebd825a4e8ed07a6828ec27e1abc596e4ab1889e2d"}
Sep 08 14:31:30.041948 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:30.041900    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc" podStartSLOduration=1.041884938 podStartE2EDuration="1.041884938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:31:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:31:30.039754686 +0000 UTC m=+891.435704107" watchObservedRunningTime="2026-09-08 14:31:30.041884938 +0000 UTC m=+891.437834369"
Sep 08 14:31:30.367532 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:30.367488    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:30.372160 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:30.372137    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:31.024837 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:31.024806    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:31.025644 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:31.025627    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:32.498877 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:32.498843    2564 patch_prober.go:28] interesting pod/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:31:32.499236 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:32.498903    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:31:33.526508 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.526441    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:31:33.573360 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.573336    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psb4h\" (UniqueName: \"kubernetes.io/projected/9f9bc194-70da-4dbb-bf94-788ff2efc078-kube-api-access-psb4h\") pod \"9f9bc194-70da-4dbb-bf94-788ff2efc078\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") "
Sep 08 14:31:33.573484 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.573373    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-token\") pod \"9f9bc194-70da-4dbb-bf94-788ff2efc078\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") "
Sep 08 14:31:33.573484 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.573397    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f9bc194-70da-4dbb-bf94-788ff2efc078-istiod-ca-cert\") pod \"9f9bc194-70da-4dbb-bf94-788ff2efc078\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") "
Sep 08 14:31:33.573484 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.573430    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-workload-certs\") pod \"9f9bc194-70da-4dbb-bf94-788ff2efc078\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") "
Sep 08 14:31:33.573484 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.573464    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-podinfo\") pod \"9f9bc194-70da-4dbb-bf94-788ff2efc078\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") "
Sep 08 14:31:33.573656 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.573539    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-workload-socket\") pod \"9f9bc194-70da-4dbb-bf94-788ff2efc078\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") "
Sep 08 14:31:33.573656 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.573598    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-data\") pod \"9f9bc194-70da-4dbb-bf94-788ff2efc078\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") "
Sep 08 14:31:33.573656 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.573647    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-envoy\") pod \"9f9bc194-70da-4dbb-bf94-788ff2efc078\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") "
Sep 08 14:31:33.573795 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.573686    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-credential-socket\") pod \"9f9bc194-70da-4dbb-bf94-788ff2efc078\" (UID: \"9f9bc194-70da-4dbb-bf94-788ff2efc078\") "
Sep 08 14:31:33.573795 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.573763    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9f9bc194-70da-4dbb-bf94-788ff2efc078" (UID: "9f9bc194-70da-4dbb-bf94-788ff2efc078"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:31:33.573894 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.573870    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9f9bc194-70da-4dbb-bf94-788ff2efc078" (UID: "9f9bc194-70da-4dbb-bf94-788ff2efc078"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:31:33.573944 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.573888    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f9bc194-70da-4dbb-bf94-788ff2efc078-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9f9bc194-70da-4dbb-bf94-788ff2efc078" (UID: "9f9bc194-70da-4dbb-bf94-788ff2efc078"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:31:33.573999 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.573969    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-data" (OuterVolumeSpecName: "istio-data") pod "9f9bc194-70da-4dbb-bf94-788ff2efc078" (UID: "9f9bc194-70da-4dbb-bf94-788ff2efc078"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:31:33.574132 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.574048    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9f9bc194-70da-4dbb-bf94-788ff2efc078" (UID: "9f9bc194-70da-4dbb-bf94-788ff2efc078"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:31:33.574132 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.574106    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-workload-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:31:33.574132 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.574125    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-data\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:31:33.574267 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.574139    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f9bc194-70da-4dbb-bf94-788ff2efc078-istiod-ca-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:31:33.574267 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.574151    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-workload-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:31:33.575732 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.575711    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f9bc194-70da-4dbb-bf94-788ff2efc078-kube-api-access-psb4h" (OuterVolumeSpecName: "kube-api-access-psb4h") pod "9f9bc194-70da-4dbb-bf94-788ff2efc078" (UID: "9f9bc194-70da-4dbb-bf94-788ff2efc078"). InnerVolumeSpecName "kube-api-access-psb4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:31:33.575805 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.575723    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9f9bc194-70da-4dbb-bf94-788ff2efc078" (UID: "9f9bc194-70da-4dbb-bf94-788ff2efc078"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:31:33.575842 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.575804    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f9bc194-70da-4dbb-bf94-788ff2efc078" (UID: "9f9bc194-70da-4dbb-bf94-788ff2efc078"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:31:33.575992 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.575975    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9f9bc194-70da-4dbb-bf94-788ff2efc078" (UID: "9f9bc194-70da-4dbb-bf94-788ff2efc078"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:31:33.675256 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.675220    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-credential-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:31:33.675256 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.675250    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psb4h\" (UniqueName: \"kubernetes.io/projected/9f9bc194-70da-4dbb-bf94-788ff2efc078-kube-api-access-psb4h\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:31:33.675256 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.675260    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:31:33.675466 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.675269    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-podinfo\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:31:33.675466 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:33.675278    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f9bc194-70da-4dbb-bf94-788ff2efc078-istio-envoy\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:31:34.040057 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:34.040025    2564 generic.go:356] "Generic (PLEG): container finished" podID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerID="7911eebe57d6a0ca5d18c10a211fc024ac85dd86b6711d23253391bc966f15be" exitCode=0
Sep 08 14:31:34.040215 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:34.040068    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"
Sep 08 14:31:34.040215 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:34.040111    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" event={"ID":"9f9bc194-70da-4dbb-bf94-788ff2efc078","Type":"ContainerDied","Data":"7911eebe57d6a0ca5d18c10a211fc024ac85dd86b6711d23253391bc966f15be"}
Sep 08 14:31:34.040215 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:34.040165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c" event={"ID":"9f9bc194-70da-4dbb-bf94-788ff2efc078","Type":"ContainerDied","Data":"1102ad887d92c0d17e32802003d4e805d4a0181b28ba78e811ea2abbc6a91f74"}
Sep 08 14:31:34.040215 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:34.040188    2564 scope.go:117] "RemoveContainer" containerID="7911eebe57d6a0ca5d18c10a211fc024ac85dd86b6711d23253391bc966f15be"
Sep 08 14:31:34.049833 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:34.049816    2564 scope.go:117] "RemoveContainer" containerID="63283ba3b82394911b63eaaa926396b838ef90c65c4280c975fdcd2eb0be8f8d"
Sep 08 14:31:34.057274 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:34.057254    2564 scope.go:117] "RemoveContainer" containerID="7911eebe57d6a0ca5d18c10a211fc024ac85dd86b6711d23253391bc966f15be"
Sep 08 14:31:34.057593 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:31:34.057573    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7911eebe57d6a0ca5d18c10a211fc024ac85dd86b6711d23253391bc966f15be\": container with ID starting with 7911eebe57d6a0ca5d18c10a211fc024ac85dd86b6711d23253391bc966f15be not found: ID does not exist" containerID="7911eebe57d6a0ca5d18c10a211fc024ac85dd86b6711d23253391bc966f15be"
Sep 08 14:31:34.057681 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:34.057599    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7911eebe57d6a0ca5d18c10a211fc024ac85dd86b6711d23253391bc966f15be"} err="failed to get container status \"7911eebe57d6a0ca5d18c10a211fc024ac85dd86b6711d23253391bc966f15be\": rpc error: code = NotFound desc = could not find container \"7911eebe57d6a0ca5d18c10a211fc024ac85dd86b6711d23253391bc966f15be\": container with ID starting with 7911eebe57d6a0ca5d18c10a211fc024ac85dd86b6711d23253391bc966f15be not found: ID does not exist"
Sep 08 14:31:34.057681 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:34.057615    2564 scope.go:117] "RemoveContainer" containerID="63283ba3b82394911b63eaaa926396b838ef90c65c4280c975fdcd2eb0be8f8d"
Sep 08 14:31:34.057901 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:31:34.057879    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63283ba3b82394911b63eaaa926396b838ef90c65c4280c975fdcd2eb0be8f8d\": container with ID starting with 63283ba3b82394911b63eaaa926396b838ef90c65c4280c975fdcd2eb0be8f8d not found: ID does not exist" containerID="63283ba3b82394911b63eaaa926396b838ef90c65c4280c975fdcd2eb0be8f8d"
Sep 08 14:31:34.057963 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:34.057911    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63283ba3b82394911b63eaaa926396b838ef90c65c4280c975fdcd2eb0be8f8d"} err="failed to get container status \"63283ba3b82394911b63eaaa926396b838ef90c65c4280c975fdcd2eb0be8f8d\": rpc error: code = NotFound desc = could not find container \"63283ba3b82394911b63eaaa926396b838ef90c65c4280c975fdcd2eb0be8f8d\": container with ID starting with 63283ba3b82394911b63eaaa926396b838ef90c65c4280c975fdcd2eb0be8f8d not found: ID does not exist"
Sep 08 14:31:34.064790 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:34.064764    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"]
Sep 08 14:31:34.075528 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:34.073258    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-0416fe39-gw-openshift-default-7f49cdcdb4-46h2c"]
Sep 08 14:31:35.185977 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:35.185946    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" path="/var/lib/kubelet/pods/9f9bc194-70da-4dbb-bf94-788ff2efc078/volumes"
Sep 08 14:31:53.144886 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:53.144853    2564 generic.go:356] "Generic (PLEG): container finished" podID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerID="962b1249be6894c79dd512a2695cad8bbdbb40c0755ddc1723134666999dae70" exitCode=0
Sep 08 14:31:53.145326 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:53.144932    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc" event={"ID":"94bc9845-6613-4055-b754-6cc8c3b157e2","Type":"ContainerDied","Data":"962b1249be6894c79dd512a2695cad8bbdbb40c0755ddc1723134666999dae70"}
Sep 08 14:31:53.145367 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:53.145351    2564 scope.go:117] "RemoveContainer" containerID="962b1249be6894c79dd512a2695cad8bbdbb40c0755ddc1723134666999dae70"
Sep 08 14:31:53.146405 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:53.146356    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:31:53.146522 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:53.146446    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:31:53.146522 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:53.146484    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:31:54.151390 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:54.151361    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc" event={"ID":"94bc9845-6613-4055-b754-6cc8c3b157e2","Type":"ContainerStarted","Data":"51db977e0bd103a5d7497aef5deed5fc49e014810f6e1689c1dba9911bd9eb26"}
Sep 08 14:31:54.367922 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:54.367885    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:54.368122 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:54.368101    2564 patch_prober.go:28] interesting pod/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 14:31:54.368166 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:54.368152    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc" podUID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 14:31:55.367845 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:55.367810    2564 patch_prober.go:28] interesting pod/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 14:31:55.368229 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:55.367874    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc" podUID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 14:31:56.368234 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:56.368197    2564 patch_prober.go:28] interesting pod/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 14:31:56.368620 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:56.368254    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc" podUID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 14:31:57.215636 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.215597    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx"]
Sep 08 14:31:57.216136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.216112    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy"
Sep 08 14:31:57.216225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.216138    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy"
Sep 08 14:31:57.216276 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.216239    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy"
Sep 08 14:31:57.219683 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.219657    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx"
Sep 08 14:31:57.222210 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.222187    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:31:57.222433 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.222412    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:31:57.227424 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.227403    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx"]
Sep 08 14:31:57.368066 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.368030    2564 patch_prober.go:28] interesting pod/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 14:31:57.368219 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.368086    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc" podUID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 14:31:57.394447 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.394408    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4363eca3-b265-43f0-9628-4706dedbd143-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5298415e-pfwrx\" (UID: \"4363eca3-b265-43f0-9628-4706dedbd143\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx"
Sep 08 14:31:57.495144 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.495056    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4363eca3-b265-43f0-9628-4706dedbd143-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5298415e-pfwrx\" (UID: \"4363eca3-b265-43f0-9628-4706dedbd143\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx"
Sep 08 14:31:57.495885 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.495859    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4363eca3-b265-43f0-9628-4706dedbd143-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5298415e-pfwrx\" (UID: \"4363eca3-b265-43f0-9628-4706dedbd143\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx"
Sep 08 14:31:57.532852 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.532819    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx"
Sep 08 14:31:57.813962 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:57.813760    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx"]
Sep 08 14:31:58.171787 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:58.171756    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx" event={"ID":"4363eca3-b265-43f0-9628-4706dedbd143","Type":"ContainerStarted","Data":"3d82b827d5f2892e88dbc39456622325748dae7ddaa38a557e068c4e73b3db78"}
Sep 08 14:31:58.171912 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:58.171807    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx" event={"ID":"4363eca3-b265-43f0-9628-4706dedbd143","Type":"ContainerStarted","Data":"4ce46db05f4e3867a7316ff5c703cea1c5ed9ee24b68387fac9dc1d4f2614f0e"}
Sep 08 14:31:58.188459 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:58.188413    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx" podStartSLOduration=1.188398208 podStartE2EDuration="1.188398208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:31:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:31:58.186690709 +0000 UTC m=+919.582640141" watchObservedRunningTime="2026-09-08 14:31:58.188398208 +0000 UTC m=+919.584347638"
Sep 08 14:31:58.367611 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:58.367533    2564 patch_prober.go:28] interesting pod/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 14:31:58.367611 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:58.367583    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc" podUID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 14:31:59.177589 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:59.177557    2564 generic.go:356] "Generic (PLEG): container finished" podID="4363eca3-b265-43f0-9628-4706dedbd143" containerID="3d82b827d5f2892e88dbc39456622325748dae7ddaa38a557e068c4e73b3db78" exitCode=0
Sep 08 14:31:59.178031 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:59.177617    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx" event={"ID":"4363eca3-b265-43f0-9628-4706dedbd143","Type":"ContainerDied","Data":"3d82b827d5f2892e88dbc39456622325748dae7ddaa38a557e068c4e73b3db78"}
Sep 08 14:31:59.371442 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:59.371410    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:59.371785 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:59.371767    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:31:59.372476 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:31:59.372456    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:32:00.309600 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:00.309577    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx"
Sep 08 14:32:00.439462 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:00.439381    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4363eca3-b265-43f0-9628-4706dedbd143-maas-api-service-ca\") pod \"4363eca3-b265-43f0-9628-4706dedbd143\" (UID: \"4363eca3-b265-43f0-9628-4706dedbd143\") "
Sep 08 14:32:00.439769 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:00.439745    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4363eca3-b265-43f0-9628-4706dedbd143-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4363eca3-b265-43f0-9628-4706dedbd143" (UID: "4363eca3-b265-43f0-9628-4706dedbd143"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:32:00.540402 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:00.540364    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4363eca3-b265-43f0-9628-4706dedbd143-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:01.188537 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:01.188509    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx"
Sep 08 14:32:01.188705 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:01.188534    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx" event={"ID":"4363eca3-b265-43f0-9628-4706dedbd143","Type":"ContainerDied","Data":"4ce46db05f4e3867a7316ff5c703cea1c5ed9ee24b68387fac9dc1d4f2614f0e"}
Sep 08 14:32:01.188705 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:01.188579    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ce46db05f4e3867a7316ff5c703cea1c5ed9ee24b68387fac9dc1d4f2614f0e"
Sep 08 14:32:03.288292 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:03.288258    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx"]
Sep 08 14:32:03.291019 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:03.290991    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5298415e-pfwrx"]
Sep 08 14:32:04.409453 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:04.409420    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"]
Sep 08 14:32:04.409820 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:04.409695    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc" podUID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerName="istio-proxy" containerID="cri-o://51db977e0bd103a5d7497aef5deed5fc49e014810f6e1689c1dba9911bd9eb26" gracePeriod=30
Sep 08 14:32:05.172336 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.172303    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"]
Sep 08 14:32:05.172763 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.172745    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy"
Sep 08 14:32:05.172858 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.172765    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy"
Sep 08 14:32:05.172858 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.172804    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4363eca3-b265-43f0-9628-4706dedbd143" containerName="revoke-keys"
Sep 08 14:32:05.172858 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.172813    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4363eca3-b265-43f0-9628-4706dedbd143" containerName="revoke-keys"
Sep 08 14:32:05.172999 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.172901    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f9bc194-70da-4dbb-bf94-788ff2efc078" containerName="istio-proxy"
Sep 08 14:32:05.172999 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.172917    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4363eca3-b265-43f0-9628-4706dedbd143" containerName="revoke-keys"
Sep 08 14:32:05.176102 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.176083    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.178731 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.178708    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c7c09416-openshift-default-dockercfg-wws6k\""
Sep 08 14:32:05.179398 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.179180    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-credential-socket\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.179398 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.179243    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-workload-socket\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.179398 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.179272    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-889m8\" (UniqueName: \"kubernetes.io/projected/53ec723e-c461-4531-b592-6e5d4310816d-kube-api-access-889m8\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.179398 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.179316    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53ec723e-c461-4531-b592-6e5d4310816d-istio-podinfo\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.179398 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.179360    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53ec723e-c461-4531-b592-6e5d4310816d-istiod-ca-cert\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.179398 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.179384    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-istio-data\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.179789 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.179406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53ec723e-c461-4531-b592-6e5d4310816d-istio-token\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.179789 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.179440    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-workload-certs\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.179789 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.179569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-istio-envoy\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.201136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.201099    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4363eca3-b265-43f0-9628-4706dedbd143" path="/var/lib/kubelet/pods/4363eca3-b265-43f0-9628-4706dedbd143/volumes"
Sep 08 14:32:05.201462 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.201444    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"]
Sep 08 14:32:05.281518 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.280993    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-istio-envoy\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.281518 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.281078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-credential-socket\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.281518 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.281130    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-workload-socket\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.281518 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.281155    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-889m8\" (UniqueName: \"kubernetes.io/projected/53ec723e-c461-4531-b592-6e5d4310816d-kube-api-access-889m8\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.281860 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.281578    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-credential-socket\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.281860 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.281628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53ec723e-c461-4531-b592-6e5d4310816d-istio-podinfo\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.283309 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.282071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-workload-socket\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.283309 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.282605    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53ec723e-c461-4531-b592-6e5d4310816d-istiod-ca-cert\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.283309 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.282643    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-istio-data\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.283309 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.282666    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53ec723e-c461-4531-b592-6e5d4310816d-istio-token\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.283309 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.282702    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-workload-certs\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.283309 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.283010    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-workload-certs\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.283309 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.283307    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-istio-data\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.284109 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.284090    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53ec723e-c461-4531-b592-6e5d4310816d-istiod-ca-cert\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.289517 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.287935    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53ec723e-c461-4531-b592-6e5d4310816d-istio-podinfo\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.295593 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.295568    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-istio-envoy\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.302004 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.301980    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53ec723e-c461-4531-b592-6e5d4310816d-istio-token\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.302743 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.302709    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-889m8\" (UniqueName: \"kubernetes.io/projected/53ec723e-c461-4531-b592-6e5d4310816d-kube-api-access-889m8\") pod \"e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") " pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.502890 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.502806    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:05.788048 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.788013    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"]
Sep 08 14:32:05.789592 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:32:05.789567    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53ec723e_c461_4531_b592_6e5d4310816d.slice/crio-24faf74ae4ba75916ed25098215f65f9e3f92d2d45263cd69665e0534cbfd30e WatchSource:0}: Error finding container 24faf74ae4ba75916ed25098215f65f9e3f92d2d45263cd69665e0534cbfd30e: Status 404 returned error can't find the container with id 24faf74ae4ba75916ed25098215f65f9e3f92d2d45263cd69665e0534cbfd30e
Sep 08 14:32:05.791761 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.791725    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:32:05.791847 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.791807    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:32:05.791900 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:05.791852    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:32:06.217160 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:06.217127    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" event={"ID":"53ec723e-c461-4531-b592-6e5d4310816d","Type":"ContainerStarted","Data":"be718154d26c088e7bbcf8c11e3ea90020f5159d4fcef44acca4b63630694ad4"}
Sep 08 14:32:06.217318 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:06.217185    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" event={"ID":"53ec723e-c461-4531-b592-6e5d4310816d","Type":"ContainerStarted","Data":"24faf74ae4ba75916ed25098215f65f9e3f92d2d45263cd69665e0534cbfd30e"}
Sep 08 14:32:06.238562 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:06.238520    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" podStartSLOduration=1.2384919110000001 podStartE2EDuration="1.238491911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:32:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:32:06.236981266 +0000 UTC m=+927.632930709" watchObservedRunningTime="2026-09-08 14:32:06.238491911 +0000 UTC m=+927.634441342"
Sep 08 14:32:06.503120 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:06.503043    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:06.508139 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:06.508118    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:07.222662 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:07.222636    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:07.223463 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:07.223446    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:09.658599 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.658576    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:32:09.724608 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.724524    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-workload-certs\") pod \"94bc9845-6613-4055-b754-6cc8c3b157e2\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") "
Sep 08 14:32:09.724608 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.724601    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-workload-socket\") pod \"94bc9845-6613-4055-b754-6cc8c3b157e2\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") "
Sep 08 14:32:09.724842 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.724656    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94bc9845-6613-4055-b754-6cc8c3b157e2-istiod-ca-cert\") pod \"94bc9845-6613-4055-b754-6cc8c3b157e2\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") "
Sep 08 14:32:09.724842 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.724695    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-credential-socket\") pod \"94bc9845-6613-4055-b754-6cc8c3b157e2\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") "
Sep 08 14:32:09.724842 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.724723    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67dmb\" (UniqueName: \"kubernetes.io/projected/94bc9845-6613-4055-b754-6cc8c3b157e2-kube-api-access-67dmb\") pod \"94bc9845-6613-4055-b754-6cc8c3b157e2\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") "
Sep 08 14:32:09.724842 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.724788    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-token\") pod \"94bc9845-6613-4055-b754-6cc8c3b157e2\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") "
Sep 08 14:32:09.724842 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.724814    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-envoy\") pod \"94bc9845-6613-4055-b754-6cc8c3b157e2\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") "
Sep 08 14:32:09.725076 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.724852    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-podinfo\") pod \"94bc9845-6613-4055-b754-6cc8c3b157e2\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") "
Sep 08 14:32:09.725076 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.724891    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-data\") pod \"94bc9845-6613-4055-b754-6cc8c3b157e2\" (UID: \"94bc9845-6613-4055-b754-6cc8c3b157e2\") "
Sep 08 14:32:09.725394 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.725219    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "94bc9845-6613-4055-b754-6cc8c3b157e2" (UID: "94bc9845-6613-4055-b754-6cc8c3b157e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:09.725750 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.725567    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94bc9845-6613-4055-b754-6cc8c3b157e2" (UID: "94bc9845-6613-4055-b754-6cc8c3b157e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:09.725854 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.725750    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-data\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:09.725854 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.725773    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-workload-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:09.726251 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.726001    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94bc9845-6613-4055-b754-6cc8c3b157e2" (UID: "94bc9845-6613-4055-b754-6cc8c3b157e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:09.726804 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.726738    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94bc9845-6613-4055-b754-6cc8c3b157e2" (UID: "94bc9845-6613-4055-b754-6cc8c3b157e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:09.726804 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.726783    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94bc9845-6613-4055-b754-6cc8c3b157e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94bc9845-6613-4055-b754-6cc8c3b157e2" (UID: "94bc9845-6613-4055-b754-6cc8c3b157e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:32:09.731687 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.731660    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94bc9845-6613-4055-b754-6cc8c3b157e2-kube-api-access-67dmb" (OuterVolumeSpecName: "kube-api-access-67dmb") pod "94bc9845-6613-4055-b754-6cc8c3b157e2" (UID: "94bc9845-6613-4055-b754-6cc8c3b157e2"). InnerVolumeSpecName "kube-api-access-67dmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:32:09.732017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.731979    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94bc9845-6613-4055-b754-6cc8c3b157e2" (UID: "94bc9845-6613-4055-b754-6cc8c3b157e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:32:09.734380 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.734351    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94bc9845-6613-4055-b754-6cc8c3b157e2" (UID: "94bc9845-6613-4055-b754-6cc8c3b157e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:09.734768 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.734738    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "94bc9845-6613-4055-b754-6cc8c3b157e2" (UID: "94bc9845-6613-4055-b754-6cc8c3b157e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:32:09.827107 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.827076    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-credential-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:09.827107 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.827102    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67dmb\" (UniqueName: \"kubernetes.io/projected/94bc9845-6613-4055-b754-6cc8c3b157e2-kube-api-access-67dmb\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:09.827107 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.827112    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:09.827287 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.827120    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-envoy\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:09.827287 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.827128    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94bc9845-6613-4055-b754-6cc8c3b157e2-istio-podinfo\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:09.827287 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.827135    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94bc9845-6613-4055-b754-6cc8c3b157e2-workload-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:09.827287 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:09.827143    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94bc9845-6613-4055-b754-6cc8c3b157e2-istiod-ca-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:10.237817 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:10.237783    2564 generic.go:356] "Generic (PLEG): container finished" podID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerID="51db977e0bd103a5d7497aef5deed5fc49e014810f6e1689c1dba9911bd9eb26" exitCode=0
Sep 08 14:32:10.237987 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:10.237854    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"
Sep 08 14:32:10.237987 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:10.237858    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc" event={"ID":"94bc9845-6613-4055-b754-6cc8c3b157e2","Type":"ContainerDied","Data":"51db977e0bd103a5d7497aef5deed5fc49e014810f6e1689c1dba9911bd9eb26"}
Sep 08 14:32:10.237987 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:10.237916    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc" event={"ID":"94bc9845-6613-4055-b754-6cc8c3b157e2","Type":"ContainerDied","Data":"dd376a257a806798a55a24ebd825a4e8ed07a6828ec27e1abc596e4ab1889e2d"}
Sep 08 14:32:10.237987 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:10.237942    2564 scope.go:117] "RemoveContainer" containerID="51db977e0bd103a5d7497aef5deed5fc49e014810f6e1689c1dba9911bd9eb26"
Sep 08 14:32:10.247770 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:10.247755    2564 scope.go:117] "RemoveContainer" containerID="962b1249be6894c79dd512a2695cad8bbdbb40c0755ddc1723134666999dae70"
Sep 08 14:32:10.255882 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:10.255866    2564 scope.go:117] "RemoveContainer" containerID="51db977e0bd103a5d7497aef5deed5fc49e014810f6e1689c1dba9911bd9eb26"
Sep 08 14:32:10.256154 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:32:10.256137    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51db977e0bd103a5d7497aef5deed5fc49e014810f6e1689c1dba9911bd9eb26\": container with ID starting with 51db977e0bd103a5d7497aef5deed5fc49e014810f6e1689c1dba9911bd9eb26 not found: ID does not exist" containerID="51db977e0bd103a5d7497aef5deed5fc49e014810f6e1689c1dba9911bd9eb26"
Sep 08 14:32:10.256202 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:10.256164    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51db977e0bd103a5d7497aef5deed5fc49e014810f6e1689c1dba9911bd9eb26"} err="failed to get container status \"51db977e0bd103a5d7497aef5deed5fc49e014810f6e1689c1dba9911bd9eb26\": rpc error: code = NotFound desc = could not find container \"51db977e0bd103a5d7497aef5deed5fc49e014810f6e1689c1dba9911bd9eb26\": container with ID starting with 51db977e0bd103a5d7497aef5deed5fc49e014810f6e1689c1dba9911bd9eb26 not found: ID does not exist"
Sep 08 14:32:10.256202 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:10.256180    2564 scope.go:117] "RemoveContainer" containerID="962b1249be6894c79dd512a2695cad8bbdbb40c0755ddc1723134666999dae70"
Sep 08 14:32:10.256457 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:32:10.256438    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"962b1249be6894c79dd512a2695cad8bbdbb40c0755ddc1723134666999dae70\": container with ID starting with 962b1249be6894c79dd512a2695cad8bbdbb40c0755ddc1723134666999dae70 not found: ID does not exist" containerID="962b1249be6894c79dd512a2695cad8bbdbb40c0755ddc1723134666999dae70"
Sep 08 14:32:10.256531 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:10.256461    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"962b1249be6894c79dd512a2695cad8bbdbb40c0755ddc1723134666999dae70"} err="failed to get container status \"962b1249be6894c79dd512a2695cad8bbdbb40c0755ddc1723134666999dae70\": rpc error: code = NotFound desc = could not find container \"962b1249be6894c79dd512a2695cad8bbdbb40c0755ddc1723134666999dae70\": container with ID starting with 962b1249be6894c79dd512a2695cad8bbdbb40c0755ddc1723134666999dae70 not found: ID does not exist"
Sep 08 14:32:10.260703 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:10.260683    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"]
Sep 08 14:32:10.266704 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:10.266683    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5298415e-openshift-default-6c9c7958f8-mxczc"]
Sep 08 14:32:11.186353 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:11.186322    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94bc9845-6613-4055-b754-6cc8c3b157e2" path="/var/lib/kubelet/pods/94bc9845-6613-4055-b754-6cc8c3b157e2/volumes"
Sep 08 14:32:14.942834 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.942798    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"]
Sep 08 14:32:14.943349 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.943328    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerName="istio-proxy"
Sep 08 14:32:14.943408 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.943352    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerName="istio-proxy"
Sep 08 14:32:14.943524 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.943486    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerName="istio-proxy"
Sep 08 14:32:14.948428 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.948406    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:14.950782 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.950753    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-75b8cd\"/\"kube-root-ca.crt\""
Sep 08 14:32:14.951752 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.951730    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-75b8cd\"/\"default-dockercfg-xtml5\""
Sep 08 14:32:14.951855 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.951814    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-75b8cd\"/\"test-model-75b8cd-kserve-self-signed-certs\""
Sep 08 14:32:14.952020 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.951998    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-75b8cd\"/\"openshift-service-ca.crt\""
Sep 08 14:32:14.964630 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.964600    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"]
Sep 08 14:32:14.976229 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.976185    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-tmp-dir\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:14.976371 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.976286    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-dshm\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:14.976371 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.976340    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7k58\" (UniqueName: \"kubernetes.io/projected/d036e31f-20ad-426e-9e3d-1031d9b130c5-kube-api-access-t7k58\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:14.976485 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.976376    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-home\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:14.976485 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.976446    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-model-cache\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:14.976610 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:14.976492    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d036e31f-20ad-426e-9e3d-1031d9b130c5-tls-certs\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.077483 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.077445    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7k58\" (UniqueName: \"kubernetes.io/projected/d036e31f-20ad-426e-9e3d-1031d9b130c5-kube-api-access-t7k58\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.077483 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.077483    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-home\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.077737 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.077559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-model-cache\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.077737 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.077590    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d036e31f-20ad-426e-9e3d-1031d9b130c5-tls-certs\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.077737 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.077635    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-tmp-dir\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.077737 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.077682    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-dshm\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.078041 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.078014    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-model-cache\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.078126 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.078044    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-home\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.078126 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.078058    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-tmp-dir\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.079901 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.079881    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-dshm\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.080085 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.080067    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d036e31f-20ad-426e-9e3d-1031d9b130c5-tls-certs\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.085979 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.085957    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7k58\" (UniqueName: \"kubernetes.io/projected/d036e31f-20ad-426e-9e3d-1031d9b130c5-kube-api-access-t7k58\") pod \"test-model-75b8cd-kserve-84f7c88cd7-4df5s\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") " pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.266798 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.266715    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:15.567072 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:15.567041    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"]
Sep 08 14:32:15.568923 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:32:15.568894    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd036e31f_20ad_426e_9e3d_1031d9b130c5.slice/crio-49eabf2d8a42215b4b121826b2226f747b63d045daae7029972eaa3e38b2b0c7 WatchSource:0}: Error finding container 49eabf2d8a42215b4b121826b2226f747b63d045daae7029972eaa3e38b2b0c7: Status 404 returned error can't find the container with id 49eabf2d8a42215b4b121826b2226f747b63d045daae7029972eaa3e38b2b0c7
Sep 08 14:32:16.268961 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:16.268929    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s" event={"ID":"d036e31f-20ad-426e-9e3d-1031d9b130c5","Type":"ContainerStarted","Data":"6667638a4152dec964359e51e40b5a2bfd54f09af637b0554e871e877a3390d1"}
Sep 08 14:32:16.269313 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:16.268974    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s" event={"ID":"d036e31f-20ad-426e-9e3d-1031d9b130c5","Type":"ContainerStarted","Data":"49eabf2d8a42215b4b121826b2226f747b63d045daae7029972eaa3e38b2b0c7"}
Sep 08 14:32:16.286526 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:16.286471    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s" podStartSLOduration=2.286456467 podStartE2EDuration="2.286456467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:32:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:32:16.284480022 +0000 UTC m=+937.680429453" watchObservedRunningTime="2026-09-08 14:32:16.286456467 +0000 UTC m=+937.682405898"
Sep 08 14:32:17.840569 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:17.840538    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"]
Sep 08 14:32:23.212300 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:23.211565    2564 patch_prober.go:28] interesting pod/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:43038->10.134.0.39:15021: read: connection reset by peer" start-of-body=
Sep 08 14:32:23.212300 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:23.211632    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:43038->10.134.0.39:15021: read: connection reset by peer"
Sep 08 14:32:23.308456 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:23.308423    2564 generic.go:356] "Generic (PLEG): container finished" podID="53ec723e-c461-4531-b592-6e5d4310816d" containerID="be718154d26c088e7bbcf8c11e3ea90020f5159d4fcef44acca4b63630694ad4" exitCode=0
Sep 08 14:32:23.308642 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:23.308474    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" event={"ID":"53ec723e-c461-4531-b592-6e5d4310816d","Type":"ContainerDied","Data":"be718154d26c088e7bbcf8c11e3ea90020f5159d4fcef44acca4b63630694ad4"}
Sep 08 14:32:23.309007 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:23.308991    2564 scope.go:117] "RemoveContainer" containerID="be718154d26c088e7bbcf8c11e3ea90020f5159d4fcef44acca4b63630694ad4"
Sep 08 14:32:23.310199 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:23.310170    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:32:23.310259 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:23.310241    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:32:23.310293 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:23.310273    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:32:24.319444 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.319398    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" event={"ID":"53ec723e-c461-4531-b592-6e5d4310816d","Type":"ContainerStarted","Data":"cd24517b5444e000b74cde0be2defbfedb19c8df65b698f3589d7ec47ca44a97"}
Sep 08 14:32:24.509520 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.506906    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:24.509520 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.507065    2564 patch_prober.go:28] interesting pod/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 14:32:24.509520 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.507113    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 14:32:24.602148 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.602103    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s"]
Sep 08 14:32:24.602701 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.602678    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerName="istio-proxy"
Sep 08 14:32:24.602701 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.602702    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerName="istio-proxy"
Sep 08 14:32:24.602928 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.602819    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="94bc9845-6613-4055-b754-6cc8c3b157e2" containerName="istio-proxy"
Sep 08 14:32:24.606144 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.606125    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s"
Sep 08 14:32:24.614324 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.612115    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s"]
Sep 08 14:32:24.614324 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.612351    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:32:24.615460 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.615414    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:32:24.673893 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.673858    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8680444-b8f7-4ad2-93c2-d7e768997e7d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-47d144-p487s\" (UID: \"e8680444-b8f7-4ad2-93c2-d7e768997e7d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s"
Sep 08 14:32:24.774459 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.774428    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8680444-b8f7-4ad2-93c2-d7e768997e7d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-47d144-p487s\" (UID: \"e8680444-b8f7-4ad2-93c2-d7e768997e7d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s"
Sep 08 14:32:24.775015 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.774996    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8680444-b8f7-4ad2-93c2-d7e768997e7d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-47d144-p487s\" (UID: \"e8680444-b8f7-4ad2-93c2-d7e768997e7d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s"
Sep 08 14:32:24.928670 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:24.928597    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s"
Sep 08 14:32:25.201638 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:25.201556    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s"]
Sep 08 14:32:25.229456 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:32:25.229431    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8680444_b8f7_4ad2_93c2_d7e768997e7d.slice/crio-d12e9c86bf7556fb18a510919f25a9ab0b02d76e1b1e91f87c1273f91d164b72 WatchSource:0}: Error finding container d12e9c86bf7556fb18a510919f25a9ab0b02d76e1b1e91f87c1273f91d164b72: Status 404 returned error can't find the container with id d12e9c86bf7556fb18a510919f25a9ab0b02d76e1b1e91f87c1273f91d164b72
Sep 08 14:32:25.267237 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:25.267214    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:25.267337 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:25.267252    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:25.278728 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:25.278709    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:25.327059 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:25.327024    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s" event={"ID":"e8680444-b8f7-4ad2-93c2-d7e768997e7d","Type":"ContainerStarted","Data":"d12e9c86bf7556fb18a510919f25a9ab0b02d76e1b1e91f87c1273f91d164b72"}
Sep 08 14:32:25.337837 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:25.337813    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:32:25.506902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:25.506090    2564 patch_prober.go:28] interesting pod/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 14:32:25.506902 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:25.506149    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 14:32:26.333621 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:26.333594    2564 generic.go:356] "Generic (PLEG): container finished" podID="e8680444-b8f7-4ad2-93c2-d7e768997e7d" containerID="6fad50a1a32d109e21a9e406fd5920c3b03acbbaa923adfc357502d7e754a2f3" exitCode=0
Sep 08 14:32:26.334004 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:26.333678    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s" event={"ID":"e8680444-b8f7-4ad2-93c2-d7e768997e7d","Type":"ContainerDied","Data":"6fad50a1a32d109e21a9e406fd5920c3b03acbbaa923adfc357502d7e754a2f3"}
Sep 08 14:32:26.503786 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:26.503697    2564 patch_prober.go:28] interesting pod/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 14:32:26.503786 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:26.503760    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 14:32:27.477039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:27.477013    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s"
Sep 08 14:32:27.515519 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:27.506366    2564 patch_prober.go:28] interesting pod/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 14:32:27.515519 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:27.506427    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 14:32:27.608557 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:27.607841    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8680444-b8f7-4ad2-93c2-d7e768997e7d-maas-api-service-ca\") pod \"e8680444-b8f7-4ad2-93c2-d7e768997e7d\" (UID: \"e8680444-b8f7-4ad2-93c2-d7e768997e7d\") "
Sep 08 14:32:27.608557 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:27.608444    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8680444-b8f7-4ad2-93c2-d7e768997e7d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e8680444-b8f7-4ad2-93c2-d7e768997e7d" (UID: "e8680444-b8f7-4ad2-93c2-d7e768997e7d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:32:27.709263 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:27.709215    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8680444-b8f7-4ad2-93c2-d7e768997e7d-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:28.344645 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:28.344618    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s"
Sep 08 14:32:28.344814 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:28.344618    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s" event={"ID":"e8680444-b8f7-4ad2-93c2-d7e768997e7d","Type":"ContainerDied","Data":"d12e9c86bf7556fb18a510919f25a9ab0b02d76e1b1e91f87c1273f91d164b72"}
Sep 08 14:32:28.344814 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:28.344746    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d12e9c86bf7556fb18a510919f25a9ab0b02d76e1b1e91f87c1273f91d164b72"
Sep 08 14:32:28.503825 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:28.503780    2564 patch_prober.go:28] interesting pod/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 14:32:28.504316 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:28.503865    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 14:32:29.507214 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:29.507182    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:29.507632 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:29.507610    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:29.508200 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:29.508179    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:32.437649 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:32.437619    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7"]
Sep 08 14:32:32.438024 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:32.437998    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8680444-b8f7-4ad2-93c2-d7e768997e7d" containerName="revoke-keys"
Sep 08 14:32:32.438024 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:32.438010    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8680444-b8f7-4ad2-93c2-d7e768997e7d" containerName="revoke-keys"
Sep 08 14:32:32.438103 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:32.438069    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8680444-b8f7-4ad2-93c2-d7e768997e7d" containerName="revoke-keys"
Sep 08 14:32:32.441078 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:32.441061    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7"
Sep 08 14:32:32.443190 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:32.443168    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:32:32.443546 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:32.443523    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:32:32.449168 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:32.449144    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7"]
Sep 08 14:32:32.557382 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:32.557356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c84a2f5-4e02-4a34-b896-818199081631-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7\" (UID: \"2c84a2f5-4e02-4a34-b896-818199081631\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7"
Sep 08 14:32:32.658257 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:32.658232    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c84a2f5-4e02-4a34-b896-818199081631-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7\" (UID: \"2c84a2f5-4e02-4a34-b896-818199081631\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7"
Sep 08 14:32:32.658887 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:32.658864    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c84a2f5-4e02-4a34-b896-818199081631-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7\" (UID: \"2c84a2f5-4e02-4a34-b896-818199081631\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7"
Sep 08 14:32:32.752261 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:32.752195    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7"
Sep 08 14:32:32.860257 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:32.860222    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz" podUID="8d877ef3-3e73-4817-b311-03866013bef2" containerName="main" containerID="cri-o://aadcdce120d1b6b6195ccc28cf0650a69355065e8319f31def8502042bea8ba0" gracePeriod=45
Sep 08 14:32:33.021374 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.021349    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7"]
Sep 08 14:32:33.023950 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:32:33.023923    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c84a2f5_4e02_4a34_b896_818199081631.slice/crio-d5011b51aafc3d97831c89bd18dffc974de793bd9374be801ba5a77aacee161f WatchSource:0}: Error finding container d5011b51aafc3d97831c89bd18dffc974de793bd9374be801ba5a77aacee161f: Status 404 returned error can't find the container with id d5011b51aafc3d97831c89bd18dffc974de793bd9374be801ba5a77aacee161f
Sep 08 14:32:33.098058 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.098032    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:32:33.264274 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.264250    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-dshm\") pod \"8d877ef3-3e73-4817-b311-03866013bef2\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") "
Sep 08 14:32:33.264422 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.264316    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6ccj\" (UniqueName: \"kubernetes.io/projected/8d877ef3-3e73-4817-b311-03866013bef2-kube-api-access-w6ccj\") pod \"8d877ef3-3e73-4817-b311-03866013bef2\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") "
Sep 08 14:32:33.264422 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.264340    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-home\") pod \"8d877ef3-3e73-4817-b311-03866013bef2\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") "
Sep 08 14:32:33.264422 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.264367    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-model-cache\") pod \"8d877ef3-3e73-4817-b311-03866013bef2\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") "
Sep 08 14:32:33.264422 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.264385    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-tmp-dir\") pod \"8d877ef3-3e73-4817-b311-03866013bef2\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") "
Sep 08 14:32:33.264422 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.264401    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d877ef3-3e73-4817-b311-03866013bef2-tls-certs\") pod \"8d877ef3-3e73-4817-b311-03866013bef2\" (UID: \"8d877ef3-3e73-4817-b311-03866013bef2\") "
Sep 08 14:32:33.264705 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.264618    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-home" (OuterVolumeSpecName: "home") pod "8d877ef3-3e73-4817-b311-03866013bef2" (UID: "8d877ef3-3e73-4817-b311-03866013bef2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:33.264705 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.264678    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-model-cache" (OuterVolumeSpecName: "model-cache") pod "8d877ef3-3e73-4817-b311-03866013bef2" (UID: "8d877ef3-3e73-4817-b311-03866013bef2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:33.264776 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.264692    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8d877ef3-3e73-4817-b311-03866013bef2" (UID: "8d877ef3-3e73-4817-b311-03866013bef2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:33.266452 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.266426    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-dshm" (OuterVolumeSpecName: "dshm") pod "8d877ef3-3e73-4817-b311-03866013bef2" (UID: "8d877ef3-3e73-4817-b311-03866013bef2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:33.266452 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.266443    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d877ef3-3e73-4817-b311-03866013bef2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8d877ef3-3e73-4817-b311-03866013bef2" (UID: "8d877ef3-3e73-4817-b311-03866013bef2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:32:33.266607 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.266488    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d877ef3-3e73-4817-b311-03866013bef2-kube-api-access-w6ccj" (OuterVolumeSpecName: "kube-api-access-w6ccj") pod "8d877ef3-3e73-4817-b311-03866013bef2" (UID: "8d877ef3-3e73-4817-b311-03866013bef2"). InnerVolumeSpecName "kube-api-access-w6ccj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:32:33.365031 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.365005    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-dshm\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:33.365031 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.365032    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6ccj\" (UniqueName: \"kubernetes.io/projected/8d877ef3-3e73-4817-b311-03866013bef2-kube-api-access-w6ccj\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:33.365173 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.365046    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-home\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:33.365173 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.365057    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-model-cache\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:33.365173 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.365070    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d877ef3-3e73-4817-b311-03866013bef2-tmp-dir\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:33.365173 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.365081    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8d877ef3-3e73-4817-b311-03866013bef2-tls-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:33.372132 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.372106    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7" event={"ID":"2c84a2f5-4e02-4a34-b896-818199081631","Type":"ContainerStarted","Data":"9f3ef4816f93171265d3219e610c5a6fe6fd624ff3da7fdf03f83c08714213af"}
Sep 08 14:32:33.372246 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.372158    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7" event={"ID":"2c84a2f5-4e02-4a34-b896-818199081631","Type":"ContainerStarted","Data":"d5011b51aafc3d97831c89bd18dffc974de793bd9374be801ba5a77aacee161f"}
Sep 08 14:32:33.373433 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.373411    2564 generic.go:356] "Generic (PLEG): container finished" podID="8d877ef3-3e73-4817-b311-03866013bef2" containerID="aadcdce120d1b6b6195ccc28cf0650a69355065e8319f31def8502042bea8ba0" exitCode=0
Sep 08 14:32:33.373558 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.373446    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"
Sep 08 14:32:33.373558 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.373446    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz" event={"ID":"8d877ef3-3e73-4817-b311-03866013bef2","Type":"ContainerDied","Data":"aadcdce120d1b6b6195ccc28cf0650a69355065e8319f31def8502042bea8ba0"}
Sep 08 14:32:33.373657 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.373555    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz" event={"ID":"8d877ef3-3e73-4817-b311-03866013bef2","Type":"ContainerDied","Data":"6a41c0577607e51731a4f4e312fba7566520734002a2ec309806889d5ba9d099"}
Sep 08 14:32:33.373657 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.373581    2564 scope.go:117] "RemoveContainer" containerID="aadcdce120d1b6b6195ccc28cf0650a69355065e8319f31def8502042bea8ba0"
Sep 08 14:32:33.381881 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.381867    2564 scope.go:117] "RemoveContainer" containerID="aadcdce120d1b6b6195ccc28cf0650a69355065e8319f31def8502042bea8ba0"
Sep 08 14:32:33.382158 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:32:33.382141    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aadcdce120d1b6b6195ccc28cf0650a69355065e8319f31def8502042bea8ba0\": container with ID starting with aadcdce120d1b6b6195ccc28cf0650a69355065e8319f31def8502042bea8ba0 not found: ID does not exist" containerID="aadcdce120d1b6b6195ccc28cf0650a69355065e8319f31def8502042bea8ba0"
Sep 08 14:32:33.382214 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.382165    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aadcdce120d1b6b6195ccc28cf0650a69355065e8319f31def8502042bea8ba0"} err="failed to get container status \"aadcdce120d1b6b6195ccc28cf0650a69355065e8319f31def8502042bea8ba0\": rpc error: code = NotFound desc = could not find container \"aadcdce120d1b6b6195ccc28cf0650a69355065e8319f31def8502042bea8ba0\": container with ID starting with aadcdce120d1b6b6195ccc28cf0650a69355065e8319f31def8502042bea8ba0 not found: ID does not exist"
Sep 08 14:32:33.391371 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.389717    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7" podStartSLOduration=1.3896947929999999 podStartE2EDuration="1.389694793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:32:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:32:33.386883079 +0000 UTC m=+954.782832511" watchObservedRunningTime="2026-09-08 14:32:33.389694793 +0000 UTC m=+954.785644224"
Sep 08 14:32:33.405861 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.405839    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"]
Sep 08 14:32:33.413337 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:33.413317    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-ef197403-kserve-84d8494788-gcsjz"]
Sep 08 14:32:34.379603 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:34.379575    2564 generic.go:356] "Generic (PLEG): container finished" podID="2c84a2f5-4e02-4a34-b896-818199081631" containerID="9f3ef4816f93171265d3219e610c5a6fe6fd624ff3da7fdf03f83c08714213af" exitCode=0
Sep 08 14:32:34.380013 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:34.379669    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7" event={"ID":"2c84a2f5-4e02-4a34-b896-818199081631","Type":"ContainerDied","Data":"9f3ef4816f93171265d3219e610c5a6fe6fd624ff3da7fdf03f83c08714213af"}
Sep 08 14:32:35.187135 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:35.187104    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d877ef3-3e73-4817-b311-03866013bef2" path="/var/lib/kubelet/pods/8d877ef3-3e73-4817-b311-03866013bef2/volumes"
Sep 08 14:32:35.524326 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:35.524303    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7"
Sep 08 14:32:35.554741 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:35.554716    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s"]
Sep 08 14:32:35.557924 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:35.557899    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-47d144-p487s"]
Sep 08 14:32:35.687310 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:35.687275    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c84a2f5-4e02-4a34-b896-818199081631-maas-api-service-ca\") pod \"2c84a2f5-4e02-4a34-b896-818199081631\" (UID: \"2c84a2f5-4e02-4a34-b896-818199081631\") "
Sep 08 14:32:35.687607 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:35.687584    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c84a2f5-4e02-4a34-b896-818199081631-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2c84a2f5-4e02-4a34-b896-818199081631" (UID: "2c84a2f5-4e02-4a34-b896-818199081631"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:32:35.788152 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:35.788073    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c84a2f5-4e02-4a34-b896-818199081631-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:36.393806 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:36.393779    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7"
Sep 08 14:32:36.393964 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:36.393778    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7" event={"ID":"2c84a2f5-4e02-4a34-b896-818199081631","Type":"ContainerDied","Data":"d5011b51aafc3d97831c89bd18dffc974de793bd9374be801ba5a77aacee161f"}
Sep 08 14:32:36.393964 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:36.393909    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5011b51aafc3d97831c89bd18dffc974de793bd9374be801ba5a77aacee161f"
Sep 08 14:32:37.186390 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:37.186349    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8680444-b8f7-4ad2-93c2-d7e768997e7d" path="/var/lib/kubelet/pods/e8680444-b8f7-4ad2-93c2-d7e768997e7d/volumes"
Sep 08 14:32:40.125527 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:40.125471    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7"]
Sep 08 14:32:40.133039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:40.130445    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-c7c09416-7nkd7"]
Sep 08 14:32:40.268066 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:40.268032    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"]
Sep 08 14:32:40.268341 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:40.268283    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy" containerID="cri-o://cd24517b5444e000b74cde0be2defbfedb19c8df65b698f3589d7ec47ca44a97" gracePeriod=30
Sep 08 14:32:41.185648 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:41.185610    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c84a2f5-4e02-4a34-b896-818199081631" path="/var/lib/kubelet/pods/2c84a2f5-4e02-4a34-b896-818199081631/volumes"
Sep 08 14:32:43.310417 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:43.310388    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"]
Sep 08 14:32:43.310877 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:43.310613    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy" containerID="cri-o://835146c0e51baf013fa6b67c6ccecb2ed948121c1401993f1f49d7076add76fb" gracePeriod=30
Sep 08 14:32:44.510094 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:44.510057    2564 patch_prober.go:28] interesting pod/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 08 14:32:44.510453 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:44.510119    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:32:45.449289 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.449254    2564 generic.go:356] "Generic (PLEG): container finished" podID="53ec723e-c461-4531-b592-6e5d4310816d" containerID="cd24517b5444e000b74cde0be2defbfedb19c8df65b698f3589d7ec47ca44a97" exitCode=0
Sep 08 14:32:45.449432 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.449382    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" event={"ID":"53ec723e-c461-4531-b592-6e5d4310816d","Type":"ContainerDied","Data":"cd24517b5444e000b74cde0be2defbfedb19c8df65b698f3589d7ec47ca44a97"}
Sep 08 14:32:45.449485 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.449460    2564 scope.go:117] "RemoveContainer" containerID="be718154d26c088e7bbcf8c11e3ea90020f5159d4fcef44acca4b63630694ad4"
Sep 08 14:32:45.524074 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.524049    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:45.566467 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.566382    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53ec723e-c461-4531-b592-6e5d4310816d-istio-podinfo\") pod \"53ec723e-c461-4531-b592-6e5d4310816d\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") "
Sep 08 14:32:45.566467 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.566443    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-workload-socket\") pod \"53ec723e-c461-4531-b592-6e5d4310816d\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") "
Sep 08 14:32:45.566691 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.566492    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-credential-socket\") pod \"53ec723e-c461-4531-b592-6e5d4310816d\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") "
Sep 08 14:32:45.566691 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.566549    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-istio-data\") pod \"53ec723e-c461-4531-b592-6e5d4310816d\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") "
Sep 08 14:32:45.566691 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.566574    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-istio-envoy\") pod \"53ec723e-c461-4531-b592-6e5d4310816d\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") "
Sep 08 14:32:45.566691 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.566666    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53ec723e-c461-4531-b592-6e5d4310816d-istiod-ca-cert\") pod \"53ec723e-c461-4531-b592-6e5d4310816d\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") "
Sep 08 14:32:45.566884 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.566698    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53ec723e-c461-4531-b592-6e5d4310816d-istio-token\") pod \"53ec723e-c461-4531-b592-6e5d4310816d\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") "
Sep 08 14:32:45.566884 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.566726    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-workload-certs\") pod \"53ec723e-c461-4531-b592-6e5d4310816d\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") "
Sep 08 14:32:45.566884 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.566776    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "53ec723e-c461-4531-b592-6e5d4310816d" (UID: "53ec723e-c461-4531-b592-6e5d4310816d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:45.566884 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.566800    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-889m8\" (UniqueName: \"kubernetes.io/projected/53ec723e-c461-4531-b592-6e5d4310816d-kube-api-access-889m8\") pod \"53ec723e-c461-4531-b592-6e5d4310816d\" (UID: \"53ec723e-c461-4531-b592-6e5d4310816d\") "
Sep 08 14:32:45.566884 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.566856    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "53ec723e-c461-4531-b592-6e5d4310816d" (UID: "53ec723e-c461-4531-b592-6e5d4310816d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:45.567167 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.567125    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-credential-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:45.567167 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.567127    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53ec723e-c461-4531-b592-6e5d4310816d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "53ec723e-c461-4531-b592-6e5d4310816d" (UID: "53ec723e-c461-4531-b592-6e5d4310816d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:32:45.567167 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.567144    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-workload-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:45.567413 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.567387    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "53ec723e-c461-4531-b592-6e5d4310816d" (UID: "53ec723e-c461-4531-b592-6e5d4310816d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:45.567489 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.567454    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-istio-data" (OuterVolumeSpecName: "istio-data") pod "53ec723e-c461-4531-b592-6e5d4310816d" (UID: "53ec723e-c461-4531-b592-6e5d4310816d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:45.568867 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.568828    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/53ec723e-c461-4531-b592-6e5d4310816d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "53ec723e-c461-4531-b592-6e5d4310816d" (UID: "53ec723e-c461-4531-b592-6e5d4310816d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:32:45.568966 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.568913    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "53ec723e-c461-4531-b592-6e5d4310816d" (UID: "53ec723e-c461-4531-b592-6e5d4310816d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:45.568966 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.568930    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53ec723e-c461-4531-b592-6e5d4310816d-istio-token" (OuterVolumeSpecName: "istio-token") pod "53ec723e-c461-4531-b592-6e5d4310816d" (UID: "53ec723e-c461-4531-b592-6e5d4310816d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:32:45.569408 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.569392    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53ec723e-c461-4531-b592-6e5d4310816d-kube-api-access-889m8" (OuterVolumeSpecName: "kube-api-access-889m8") pod "53ec723e-c461-4531-b592-6e5d4310816d" (UID: "53ec723e-c461-4531-b592-6e5d4310816d"). InnerVolumeSpecName "kube-api-access-889m8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:32:45.667723 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.667691    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/53ec723e-c461-4531-b592-6e5d4310816d-istiod-ca-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:45.667723 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.667719    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/53ec723e-c461-4531-b592-6e5d4310816d-istio-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:45.667723 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.667728    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-workload-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:45.667946 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.667736    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-889m8\" (UniqueName: \"kubernetes.io/projected/53ec723e-c461-4531-b592-6e5d4310816d-kube-api-access-889m8\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:45.667946 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.667745    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/53ec723e-c461-4531-b592-6e5d4310816d-istio-podinfo\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:45.667946 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.667753    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-istio-data\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:45.667946 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.667761    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/53ec723e-c461-4531-b592-6e5d4310816d-istio-envoy\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:45.830816 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.830785    2564 patch_prober.go:28] interesting pod/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:32:45.830957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:45.830847    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:32:46.455418 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:46.455376    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4" event={"ID":"53ec723e-c461-4531-b592-6e5d4310816d","Type":"ContainerDied","Data":"24faf74ae4ba75916ed25098215f65f9e3f92d2d45263cd69665e0534cbfd30e"}
Sep 08 14:32:46.455418 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:46.455411    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"
Sep 08 14:32:46.455643 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:46.455438    2564 scope.go:117] "RemoveContainer" containerID="cd24517b5444e000b74cde0be2defbfedb19c8df65b698f3589d7ec47ca44a97"
Sep 08 14:32:46.478329 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:46.478306    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"]
Sep 08 14:32:46.482430 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:46.482407    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c7c09416-openshift-default-d68759d8d-wh2m4"]
Sep 08 14:32:47.186126 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:47.186092    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53ec723e-c461-4531-b592-6e5d4310816d" path="/var/lib/kubelet/pods/53ec723e-c461-4531-b592-6e5d4310816d/volumes"
Sep 08 14:32:48.469023 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.468993    2564 generic.go:356] "Generic (PLEG): container finished" podID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerID="835146c0e51baf013fa6b67c6ccecb2ed948121c1401993f1f49d7076add76fb" exitCode=0
Sep 08 14:32:48.469402 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.469072    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" event={"ID":"b378114b-fa36-462c-b0a1-9f609e1899f6","Type":"ContainerDied","Data":"835146c0e51baf013fa6b67c6ccecb2ed948121c1401993f1f49d7076add76fb"}
Sep 08 14:32:48.469402 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.469147    2564 scope.go:117] "RemoveContainer" containerID="9d345db8ba57a7bef8518927324540d3898eb91654ddb1b5bf47174876b3398c"
Sep 08 14:32:48.568231 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.568209    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:32:48.593443 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.592544    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jknv9\" (UniqueName: \"kubernetes.io/projected/b378114b-fa36-462c-b0a1-9f609e1899f6-kube-api-access-jknv9\") pod \"b378114b-fa36-462c-b0a1-9f609e1899f6\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") "
Sep 08 14:32:48.593443 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.592601    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b378114b-fa36-462c-b0a1-9f609e1899f6-istiod-ca-cert\") pod \"b378114b-fa36-462c-b0a1-9f609e1899f6\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") "
Sep 08 14:32:48.593443 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.592639    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-data\") pod \"b378114b-fa36-462c-b0a1-9f609e1899f6\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") "
Sep 08 14:32:48.593443 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.592686    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-podinfo\") pod \"b378114b-fa36-462c-b0a1-9f609e1899f6\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") "
Sep 08 14:32:48.593443 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.592715    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-workload-socket\") pod \"b378114b-fa36-462c-b0a1-9f609e1899f6\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") "
Sep 08 14:32:48.593443 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.592744    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-workload-certs\") pod \"b378114b-fa36-462c-b0a1-9f609e1899f6\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") "
Sep 08 14:32:48.593443 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.592804    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-envoy\") pod \"b378114b-fa36-462c-b0a1-9f609e1899f6\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") "
Sep 08 14:32:48.593443 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.592831    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-token\") pod \"b378114b-fa36-462c-b0a1-9f609e1899f6\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") "
Sep 08 14:32:48.593443 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.592896    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-credential-socket\") pod \"b378114b-fa36-462c-b0a1-9f609e1899f6\" (UID: \"b378114b-fa36-462c-b0a1-9f609e1899f6\") "
Sep 08 14:32:48.594362 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.594142    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b378114b-fa36-462c-b0a1-9f609e1899f6" (UID: "b378114b-fa36-462c-b0a1-9f609e1899f6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:48.594817 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.594531    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b378114b-fa36-462c-b0a1-9f609e1899f6" (UID: "b378114b-fa36-462c-b0a1-9f609e1899f6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:48.598246 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.597720    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b378114b-fa36-462c-b0a1-9f609e1899f6" (UID: "b378114b-fa36-462c-b0a1-9f609e1899f6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:48.598246 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.598007    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b378114b-fa36-462c-b0a1-9f609e1899f6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b378114b-fa36-462c-b0a1-9f609e1899f6" (UID: "b378114b-fa36-462c-b0a1-9f609e1899f6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:32:48.601072 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.600904    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b378114b-fa36-462c-b0a1-9f609e1899f6-kube-api-access-jknv9" (OuterVolumeSpecName: "kube-api-access-jknv9") pod "b378114b-fa36-462c-b0a1-9f609e1899f6" (UID: "b378114b-fa36-462c-b0a1-9f609e1899f6"). InnerVolumeSpecName "kube-api-access-jknv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:32:48.601181 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.601154    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b378114b-fa36-462c-b0a1-9f609e1899f6" (UID: "b378114b-fa36-462c-b0a1-9f609e1899f6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:48.601320 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.601288    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-data" (OuterVolumeSpecName: "istio-data") pod "b378114b-fa36-462c-b0a1-9f609e1899f6" (UID: "b378114b-fa36-462c-b0a1-9f609e1899f6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:32:48.602863 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.602828    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "b378114b-fa36-462c-b0a1-9f609e1899f6" (UID: "b378114b-fa36-462c-b0a1-9f609e1899f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:32:48.608156 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.606619    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b378114b-fa36-462c-b0a1-9f609e1899f6" (UID: "b378114b-fa36-462c-b0a1-9f609e1899f6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:32:48.694024 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.693980    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b378114b-fa36-462c-b0a1-9f609e1899f6-istiod-ca-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:48.694024 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.694014    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-data\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:48.694024 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.694029    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-podinfo\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:48.694330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.694041    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-workload-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:48.694330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.694056    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-workload-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:48.694330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.694069    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-envoy\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:48.694330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.694081    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b378114b-fa36-462c-b0a1-9f609e1899f6-istio-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:48.694330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.694092    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b378114b-fa36-462c-b0a1-9f609e1899f6-credential-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:48.694330 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:48.694105    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jknv9\" (UniqueName: \"kubernetes.io/projected/b378114b-fa36-462c-b0a1-9f609e1899f6-kube-api-access-jknv9\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:32:49.475270 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:49.475179    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"
Sep 08 14:32:49.475270 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:49.475219    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq" event={"ID":"b378114b-fa36-462c-b0a1-9f609e1899f6","Type":"ContainerDied","Data":"e9617e288cf145b9c9bf01d9d78c84d48429333fba06d0aaaded15d641042ed6"}
Sep 08 14:32:49.475786 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:49.475290    2564 scope.go:117] "RemoveContainer" containerID="835146c0e51baf013fa6b67c6ccecb2ed948121c1401993f1f49d7076add76fb"
Sep 08 14:32:49.497516 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:49.497461    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"]
Sep 08 14:32:49.508439 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:49.502933    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-47d144-openshift-default-55dd49bdc8-jhqjq"]
Sep 08 14:32:51.185733 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.185693    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" path="/var/lib/kubelet/pods/b378114b-fa36-462c-b0a1-9f609e1899f6/volumes"
Sep 08 14:32:51.729546 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.729492    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"]
Sep 08 14:32:51.729946 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.729920    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy"
Sep 08 14:32:51.729946 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.729945    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy"
Sep 08 14:32:51.730113 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.729958    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy"
Sep 08 14:32:51.730113 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.729967    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy"
Sep 08 14:32:51.730113 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.729984    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d877ef3-3e73-4817-b311-03866013bef2" containerName="main"
Sep 08 14:32:51.730113 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.729992    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d877ef3-3e73-4817-b311-03866013bef2" containerName="main"
Sep 08 14:32:51.730113 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.730016    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c84a2f5-4e02-4a34-b896-818199081631" containerName="revoke-keys"
Sep 08 14:32:51.730113 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.730024    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c84a2f5-4e02-4a34-b896-818199081631" containerName="revoke-keys"
Sep 08 14:32:51.730113 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.730107    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy"
Sep 08 14:32:51.730370 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.730117    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c84a2f5-4e02-4a34-b896-818199081631" containerName="revoke-keys"
Sep 08 14:32:51.730370 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.730128    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy"
Sep 08 14:32:51.730370 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.730138    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy"
Sep 08 14:32:51.730370 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.730146    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy"
Sep 08 14:32:51.730370 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.730153    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d877ef3-3e73-4817-b311-03866013bef2" containerName="main"
Sep 08 14:32:51.735056 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.735035    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"
Sep 08 14:32:51.737807 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.737782    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-ae4649-dockercfg-59n7r\""
Sep 08 14:32:51.737962 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.737786    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-ae4649\""
Sep 08 14:32:51.743460 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.743433    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"]
Sep 08 14:32:51.820054 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.820013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/811bb03d-3310-492e-a945-b6bc9645c649-plugins-config-volume\") pod \"payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k\" (UID: \"811bb03d-3310-492e-a945-b6bc9645c649\") " pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"
Sep 08 14:32:51.820351 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.820315    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwwcz\" (UniqueName: \"kubernetes.io/projected/811bb03d-3310-492e-a945-b6bc9645c649-kube-api-access-qwwcz\") pod \"payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k\" (UID: \"811bb03d-3310-492e-a945-b6bc9645c649\") " pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"
Sep 08 14:32:51.921357 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.921318    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/811bb03d-3310-492e-a945-b6bc9645c649-plugins-config-volume\") pod \"payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k\" (UID: \"811bb03d-3310-492e-a945-b6bc9645c649\") " pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"
Sep 08 14:32:51.921357 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.921360    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwwcz\" (UniqueName: \"kubernetes.io/projected/811bb03d-3310-492e-a945-b6bc9645c649-kube-api-access-qwwcz\") pod \"payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k\" (UID: \"811bb03d-3310-492e-a945-b6bc9645c649\") " pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"
Sep 08 14:32:51.922056 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.922036    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/811bb03d-3310-492e-a945-b6bc9645c649-plugins-config-volume\") pod \"payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k\" (UID: \"811bb03d-3310-492e-a945-b6bc9645c649\") " pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"
Sep 08 14:32:51.929582 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:51.929564    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwwcz\" (UniqueName: \"kubernetes.io/projected/811bb03d-3310-492e-a945-b6bc9645c649-kube-api-access-qwwcz\") pod \"payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k\" (UID: \"811bb03d-3310-492e-a945-b6bc9645c649\") " pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"
Sep 08 14:32:52.047000 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:52.046916    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"
Sep 08 14:32:52.322970 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:52.322946    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"]
Sep 08 14:32:52.324951 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:32:52.324924    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod811bb03d_3310_492e_a945_b6bc9645c649.slice/crio-6fe9d5341d46eb2af5f862b3ae8231037ee4c7879186e9a94a138cd3cff74a27 WatchSource:0}: Error finding container 6fe9d5341d46eb2af5f862b3ae8231037ee4c7879186e9a94a138cd3cff74a27: Status 404 returned error can't find the container with id 6fe9d5341d46eb2af5f862b3ae8231037ee4c7879186e9a94a138cd3cff74a27
Sep 08 14:32:52.326818 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:52.326802    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:32:52.493028 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:52.492991    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k" event={"ID":"811bb03d-3310-492e-a945-b6bc9645c649","Type":"ContainerStarted","Data":"6fe9d5341d46eb2af5f862b3ae8231037ee4c7879186e9a94a138cd3cff74a27"}
Sep 08 14:32:54.507392 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:54.507288    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k" event={"ID":"811bb03d-3310-492e-a945-b6bc9645c649","Type":"ContainerStarted","Data":"149a12a4c5f65ccdebafdfd566f082007a9ccdf99d6369b670936614a410fe7a"}
Sep 08 14:32:54.507392 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:54.507381    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"
Sep 08 14:32:54.524455 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:32:54.524405    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k" podStartSLOduration=1.774230252 podStartE2EDuration="3.524389295s" totalImagesPullingTime="1.750159043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:32:54.522892026 +0000 UTC m=+975.918841482" watchObservedRunningTime="2026-09-08 14:32:54.524389295 +0000 UTC m=+975.920338727"
Sep 08 14:33:05.515081 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:05.514999    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"
Sep 08 14:33:37.538422 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.538384    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"]
Sep 08 14:33:37.538901 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.538795    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy"
Sep 08 14:33:37.538901 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.538809    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b378114b-fa36-462c-b0a1-9f609e1899f6" containerName="istio-proxy"
Sep 08 14:33:37.538901 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.538817    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy"
Sep 08 14:33:37.538901 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.538822    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="53ec723e-c461-4531-b592-6e5d4310816d" containerName="istio-proxy"
Sep 08 14:33:37.541705 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.541689    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.545581 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.545557    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-ae4649\"/\"openshift-service-ca.crt\""
Sep 08 14:33:37.545731 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.545598    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-ae4649\"/\"kube-root-ca.crt\""
Sep 08 14:33:37.545731 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.545609    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-ae4649\"/\"explicit-model-ae4649-kserve-self-signed-certs\""
Sep 08 14:33:37.545731 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.545650    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-ae4649\"/\"default-dockercfg-sbxsf\""
Sep 08 14:33:37.550564 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.550539    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"]
Sep 08 14:33:37.630604 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.630572    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a70c94f1-9df5-48a7-b094-50d762e3af98-tls-certs\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.630798 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.630615    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-home\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.630798 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.630715    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-dshm\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.630798 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.630785    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-model-cache\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.630974 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.630847    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8662b\" (UniqueName: \"kubernetes.io/projected/a70c94f1-9df5-48a7-b094-50d762e3af98-kube-api-access-8662b\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.630974 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.630880    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-tmp-dir\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.731588 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.731547    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-dshm\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.731776 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.731617    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-model-cache\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.731776 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.731673    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8662b\" (UniqueName: \"kubernetes.io/projected/a70c94f1-9df5-48a7-b094-50d762e3af98-kube-api-access-8662b\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.731776 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.731693    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-tmp-dir\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.731776 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.731724    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a70c94f1-9df5-48a7-b094-50d762e3af98-tls-certs\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.732007 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.731952    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-home\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.732089 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.732064    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-model-cache\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.732146 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.732106    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-tmp-dir\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.732315 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.732279    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-home\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.733931 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.733908    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-dshm\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.734068 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.734053    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a70c94f1-9df5-48a7-b094-50d762e3af98-tls-certs\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.739602 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.739584    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8662b\" (UniqueName: \"kubernetes.io/projected/a70c94f1-9df5-48a7-b094-50d762e3af98-kube-api-access-8662b\") pod \"explicit-model-ae4649-kserve-7b647bd9bc-w8kcv\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") " pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:37.851120 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:37.851097    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:38.122968 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:38.122942    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"]
Sep 08 14:33:38.124883 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:33:38.124851    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda70c94f1_9df5_48a7_b094_50d762e3af98.slice/crio-165f0a34e59778ecdc3489b9d61a115bc71d6fd9ad3ca4a6c33f72b6f79129b0 WatchSource:0}: Error finding container 165f0a34e59778ecdc3489b9d61a115bc71d6fd9ad3ca4a6c33f72b6f79129b0: Status 404 returned error can't find the container with id 165f0a34e59778ecdc3489b9d61a115bc71d6fd9ad3ca4a6c33f72b6f79129b0
Sep 08 14:33:38.734996 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:38.734958    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv" event={"ID":"a70c94f1-9df5-48a7-b094-50d762e3af98","Type":"ContainerStarted","Data":"d8d820b9d624c7cb1086e4b34229ebb7f6a9a2140b8f401d585e25dd068aebc6"}
Sep 08 14:33:38.735421 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:38.735008    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv" event={"ID":"a70c94f1-9df5-48a7-b094-50d762e3af98","Type":"ContainerStarted","Data":"165f0a34e59778ecdc3489b9d61a115bc71d6fd9ad3ca4a6c33f72b6f79129b0"}
Sep 08 14:33:38.751799 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:38.751744    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv" podStartSLOduration=1.7517273420000001 podStartE2EDuration="1.751727342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:33:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:33:38.751694379 +0000 UTC m=+1020.147643810" watchObservedRunningTime="2026-09-08 14:33:38.751727342 +0000 UTC m=+1020.147676775"
Sep 08 14:33:47.852229 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:47.852197    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:47.852817 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:47.852245    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:47.864893 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:47.864871    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:48.802723 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:48.802693    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:33:52.945166 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:52.945135    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"]
Sep 08 14:33:53.077150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:53.077110    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh"]
Sep 08 14:33:53.081866 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:53.081833    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh"
Sep 08 14:33:53.084176 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:53.084145    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:33:53.084176 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:53.084152    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:33:53.087464 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:53.087442    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh"]
Sep 08 14:33:53.170166 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:53.170135    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23c16d72-1abf-47f7-a5ff-bac1355c61f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh\" (UID: \"23c16d72-1abf-47f7-a5ff-bac1355c61f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh"
Sep 08 14:33:53.270838 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:53.270768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23c16d72-1abf-47f7-a5ff-bac1355c61f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh\" (UID: \"23c16d72-1abf-47f7-a5ff-bac1355c61f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh"
Sep 08 14:33:53.271351 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:53.271333    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23c16d72-1abf-47f7-a5ff-bac1355c61f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh\" (UID: \"23c16d72-1abf-47f7-a5ff-bac1355c61f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh"
Sep 08 14:33:53.393510 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:53.393478    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh"
Sep 08 14:33:53.666394 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:53.666367    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh"]
Sep 08 14:33:53.668895 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:33:53.668868    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c16d72_1abf_47f7_a5ff_bac1355c61f2.slice/crio-4a47297a3c65fa50f5987706f47a0164aaa9e68530ebc034aa58c7dd86b36ec1 WatchSource:0}: Error finding container 4a47297a3c65fa50f5987706f47a0164aaa9e68530ebc034aa58c7dd86b36ec1: Status 404 returned error can't find the container with id 4a47297a3c65fa50f5987706f47a0164aaa9e68530ebc034aa58c7dd86b36ec1
Sep 08 14:33:53.817687 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:53.817658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh" event={"ID":"23c16d72-1abf-47f7-a5ff-bac1355c61f2","Type":"ContainerStarted","Data":"4a47297a3c65fa50f5987706f47a0164aaa9e68530ebc034aa58c7dd86b36ec1"}
Sep 08 14:33:54.823934 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:54.823896    2564 generic.go:356] "Generic (PLEG): container finished" podID="23c16d72-1abf-47f7-a5ff-bac1355c61f2" containerID="2f0324df448c6c9f88e935c23c271f93b63f8d96759ad77e550c5cc62bc6be73" exitCode=0
Sep 08 14:33:54.824335 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:54.823979    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh" event={"ID":"23c16d72-1abf-47f7-a5ff-bac1355c61f2","Type":"ContainerDied","Data":"2f0324df448c6c9f88e935c23c271f93b63f8d96759ad77e550c5cc62bc6be73"}
Sep 08 14:33:55.952815 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:55.952792    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh"
Sep 08 14:33:56.097888 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:56.097804    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23c16d72-1abf-47f7-a5ff-bac1355c61f2-maas-api-service-ca\") pod \"23c16d72-1abf-47f7-a5ff-bac1355c61f2\" (UID: \"23c16d72-1abf-47f7-a5ff-bac1355c61f2\") "
Sep 08 14:33:56.098440 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:56.098415    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23c16d72-1abf-47f7-a5ff-bac1355c61f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "23c16d72-1abf-47f7-a5ff-bac1355c61f2" (UID: "23c16d72-1abf-47f7-a5ff-bac1355c61f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:33:56.198617 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:56.198587    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/23c16d72-1abf-47f7-a5ff-bac1355c61f2-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:33:56.836246 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:56.836210    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh"
Sep 08 14:33:56.836246 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:56.836230    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh" event={"ID":"23c16d72-1abf-47f7-a5ff-bac1355c61f2","Type":"ContainerDied","Data":"4a47297a3c65fa50f5987706f47a0164aaa9e68530ebc034aa58c7dd86b36ec1"}
Sep 08 14:33:56.836599 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:33:56.836273    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a47297a3c65fa50f5987706f47a0164aaa9e68530ebc034aa58c7dd86b36ec1"
Sep 08 14:34:03.853244 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:03.853208    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"]
Sep 08 14:34:03.853866 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:03.853436    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k" podUID="811bb03d-3310-492e-a945-b6bc9645c649" containerName="payload-processing" containerID="cri-o://149a12a4c5f65ccdebafdfd566f082007a9ccdf99d6369b670936614a410fe7a" gracePeriod=30
Sep 08 14:34:04.049686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.049656    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh"]
Sep 08 14:34:04.052821 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.052794    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-ae4649-7fkzh"]
Sep 08 14:34:04.111590 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.111535    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"
Sep 08 14:34:04.274928 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.274896    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/811bb03d-3310-492e-a945-b6bc9645c649-plugins-config-volume\") pod \"811bb03d-3310-492e-a945-b6bc9645c649\" (UID: \"811bb03d-3310-492e-a945-b6bc9645c649\") "
Sep 08 14:34:04.275096 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.274971    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qwwcz\" (UniqueName: \"kubernetes.io/projected/811bb03d-3310-492e-a945-b6bc9645c649-kube-api-access-qwwcz\") pod \"811bb03d-3310-492e-a945-b6bc9645c649\" (UID: \"811bb03d-3310-492e-a945-b6bc9645c649\") "
Sep 08 14:34:04.275221 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.275197    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/811bb03d-3310-492e-a945-b6bc9645c649-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "811bb03d-3310-492e-a945-b6bc9645c649" (UID: "811bb03d-3310-492e-a945-b6bc9645c649"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:34:04.277010 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.276984    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/811bb03d-3310-492e-a945-b6bc9645c649-kube-api-access-qwwcz" (OuterVolumeSpecName: "kube-api-access-qwwcz") pod "811bb03d-3310-492e-a945-b6bc9645c649" (UID: "811bb03d-3310-492e-a945-b6bc9645c649"). InnerVolumeSpecName "kube-api-access-qwwcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:34:04.376243 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.376176    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/811bb03d-3310-492e-a945-b6bc9645c649-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:04.376243 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.376202    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qwwcz\" (UniqueName: \"kubernetes.io/projected/811bb03d-3310-492e-a945-b6bc9645c649-kube-api-access-qwwcz\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:04.878523 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.878478    2564 generic.go:356] "Generic (PLEG): container finished" podID="811bb03d-3310-492e-a945-b6bc9645c649" containerID="149a12a4c5f65ccdebafdfd566f082007a9ccdf99d6369b670936614a410fe7a" exitCode=0
Sep 08 14:34:04.878977 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.878548    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"
Sep 08 14:34:04.878977 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.878570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k" event={"ID":"811bb03d-3310-492e-a945-b6bc9645c649","Type":"ContainerDied","Data":"149a12a4c5f65ccdebafdfd566f082007a9ccdf99d6369b670936614a410fe7a"}
Sep 08 14:34:04.878977 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.878625    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k" event={"ID":"811bb03d-3310-492e-a945-b6bc9645c649","Type":"ContainerDied","Data":"6fe9d5341d46eb2af5f862b3ae8231037ee4c7879186e9a94a138cd3cff74a27"}
Sep 08 14:34:04.878977 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.878648    2564 scope.go:117] "RemoveContainer" containerID="149a12a4c5f65ccdebafdfd566f082007a9ccdf99d6369b670936614a410fe7a"
Sep 08 14:34:04.887737 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.887714    2564 scope.go:117] "RemoveContainer" containerID="149a12a4c5f65ccdebafdfd566f082007a9ccdf99d6369b670936614a410fe7a"
Sep 08 14:34:04.888032 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:34:04.888013    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"149a12a4c5f65ccdebafdfd566f082007a9ccdf99d6369b670936614a410fe7a\": container with ID starting with 149a12a4c5f65ccdebafdfd566f082007a9ccdf99d6369b670936614a410fe7a not found: ID does not exist" containerID="149a12a4c5f65ccdebafdfd566f082007a9ccdf99d6369b670936614a410fe7a"
Sep 08 14:34:04.888083 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.888042    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"149a12a4c5f65ccdebafdfd566f082007a9ccdf99d6369b670936614a410fe7a"} err="failed to get container status \"149a12a4c5f65ccdebafdfd566f082007a9ccdf99d6369b670936614a410fe7a\": rpc error: code = NotFound desc = could not find container \"149a12a4c5f65ccdebafdfd566f082007a9ccdf99d6369b670936614a410fe7a\": container with ID starting with 149a12a4c5f65ccdebafdfd566f082007a9ccdf99d6369b670936614a410fe7a not found: ID does not exist"
Sep 08 14:34:04.901253 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.901231    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"]
Sep 08 14:34:04.905311 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:04.905290    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-ae4649-85d94784bf-hp85k"]
Sep 08 14:34:05.186375 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:05.186296    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23c16d72-1abf-47f7-a5ff-bac1355c61f2" path="/var/lib/kubelet/pods/23c16d72-1abf-47f7-a5ff-bac1355c61f2/volumes"
Sep 08 14:34:05.186683 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:05.186668    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="811bb03d-3310-492e-a945-b6bc9645c649" path="/var/lib/kubelet/pods/811bb03d-3310-492e-a945-b6bc9645c649/volumes"
Sep 08 14:34:07.965170 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:07.965131    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv" podUID="a70c94f1-9df5-48a7-b094-50d762e3af98" containerName="main" containerID="cri-o://d8d820b9d624c7cb1086e4b34229ebb7f6a9a2140b8f401d585e25dd068aebc6" gracePeriod=45
Sep 08 14:34:08.211577 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.211555    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:34:08.309394 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.309311    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-home\") pod \"a70c94f1-9df5-48a7-b094-50d762e3af98\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") "
Sep 08 14:34:08.309394 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.309342    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-dshm\") pod \"a70c94f1-9df5-48a7-b094-50d762e3af98\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") "
Sep 08 14:34:08.309394 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.309383    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-model-cache\") pod \"a70c94f1-9df5-48a7-b094-50d762e3af98\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") "
Sep 08 14:34:08.309671 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.309413    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a70c94f1-9df5-48a7-b094-50d762e3af98-tls-certs\") pod \"a70c94f1-9df5-48a7-b094-50d762e3af98\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") "
Sep 08 14:34:08.309671 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.309453    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8662b\" (UniqueName: \"kubernetes.io/projected/a70c94f1-9df5-48a7-b094-50d762e3af98-kube-api-access-8662b\") pod \"a70c94f1-9df5-48a7-b094-50d762e3af98\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") "
Sep 08 14:34:08.309671 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.309493    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-tmp-dir\") pod \"a70c94f1-9df5-48a7-b094-50d762e3af98\" (UID: \"a70c94f1-9df5-48a7-b094-50d762e3af98\") "
Sep 08 14:34:08.309831 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.309661    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-home" (OuterVolumeSpecName: "home") pod "a70c94f1-9df5-48a7-b094-50d762e3af98" (UID: "a70c94f1-9df5-48a7-b094-50d762e3af98"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:34:08.309831 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.309770    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-model-cache" (OuterVolumeSpecName: "model-cache") pod "a70c94f1-9df5-48a7-b094-50d762e3af98" (UID: "a70c94f1-9df5-48a7-b094-50d762e3af98"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:34:08.309947 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.309859    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-model-cache\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:08.309947 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.309878    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-home\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:08.309947 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.309875    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a70c94f1-9df5-48a7-b094-50d762e3af98" (UID: "a70c94f1-9df5-48a7-b094-50d762e3af98"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:34:08.311894 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.311864    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a70c94f1-9df5-48a7-b094-50d762e3af98-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a70c94f1-9df5-48a7-b094-50d762e3af98" (UID: "a70c94f1-9df5-48a7-b094-50d762e3af98"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:34:08.312029 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.311922    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-dshm" (OuterVolumeSpecName: "dshm") pod "a70c94f1-9df5-48a7-b094-50d762e3af98" (UID: "a70c94f1-9df5-48a7-b094-50d762e3af98"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:34:08.312029 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.312005    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a70c94f1-9df5-48a7-b094-50d762e3af98-kube-api-access-8662b" (OuterVolumeSpecName: "kube-api-access-8662b") pod "a70c94f1-9df5-48a7-b094-50d762e3af98" (UID: "a70c94f1-9df5-48a7-b094-50d762e3af98"). InnerVolumeSpecName "kube-api-access-8662b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:34:08.410864 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.410839    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-dshm\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:08.410864 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.410862    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a70c94f1-9df5-48a7-b094-50d762e3af98-tls-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:08.411025 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.410872    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8662b\" (UniqueName: \"kubernetes.io/projected/a70c94f1-9df5-48a7-b094-50d762e3af98-kube-api-access-8662b\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:08.411025 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.410880    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a70c94f1-9df5-48a7-b094-50d762e3af98-tmp-dir\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:08.909142 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.909106    2564 generic.go:356] "Generic (PLEG): container finished" podID="a70c94f1-9df5-48a7-b094-50d762e3af98" containerID="d8d820b9d624c7cb1086e4b34229ebb7f6a9a2140b8f401d585e25dd068aebc6" exitCode=0
Sep 08 14:34:08.909142 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.909148    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv" event={"ID":"a70c94f1-9df5-48a7-b094-50d762e3af98","Type":"ContainerDied","Data":"d8d820b9d624c7cb1086e4b34229ebb7f6a9a2140b8f401d585e25dd068aebc6"}
Sep 08 14:34:08.909407 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.909166    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"
Sep 08 14:34:08.909407 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.909185    2564 scope.go:117] "RemoveContainer" containerID="d8d820b9d624c7cb1086e4b34229ebb7f6a9a2140b8f401d585e25dd068aebc6"
Sep 08 14:34:08.909407 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.909176    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv" event={"ID":"a70c94f1-9df5-48a7-b094-50d762e3af98","Type":"ContainerDied","Data":"165f0a34e59778ecdc3489b9d61a115bc71d6fd9ad3ca4a6c33f72b6f79129b0"}
Sep 08 14:34:08.918265 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.918244    2564 scope.go:117] "RemoveContainer" containerID="d8d820b9d624c7cb1086e4b34229ebb7f6a9a2140b8f401d585e25dd068aebc6"
Sep 08 14:34:08.918539 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:34:08.918520    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8d820b9d624c7cb1086e4b34229ebb7f6a9a2140b8f401d585e25dd068aebc6\": container with ID starting with d8d820b9d624c7cb1086e4b34229ebb7f6a9a2140b8f401d585e25dd068aebc6 not found: ID does not exist" containerID="d8d820b9d624c7cb1086e4b34229ebb7f6a9a2140b8f401d585e25dd068aebc6"
Sep 08 14:34:08.918591 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.918548    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8d820b9d624c7cb1086e4b34229ebb7f6a9a2140b8f401d585e25dd068aebc6"} err="failed to get container status \"d8d820b9d624c7cb1086e4b34229ebb7f6a9a2140b8f401d585e25dd068aebc6\": rpc error: code = NotFound desc = could not find container \"d8d820b9d624c7cb1086e4b34229ebb7f6a9a2140b8f401d585e25dd068aebc6\": container with ID starting with d8d820b9d624c7cb1086e4b34229ebb7f6a9a2140b8f401d585e25dd068aebc6 not found: ID does not exist"
Sep 08 14:34:08.933113 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.933084    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"]
Sep 08 14:34:08.939119 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:08.939094    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-ae4649/explicit-model-ae4649-kserve-7b647bd9bc-w8kcv"]
Sep 08 14:34:09.188057 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:09.187983    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a70c94f1-9df5-48a7-b094-50d762e3af98" path="/var/lib/kubelet/pods/a70c94f1-9df5-48a7-b094-50d762e3af98/volumes"
Sep 08 14:34:11.973349 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:11.973308    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"]
Sep 08 14:34:11.973923 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:11.973819    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a70c94f1-9df5-48a7-b094-50d762e3af98" containerName="main"
Sep 08 14:34:11.973923 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:11.973839    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a70c94f1-9df5-48a7-b094-50d762e3af98" containerName="main"
Sep 08 14:34:11.973923 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:11.973852    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="811bb03d-3310-492e-a945-b6bc9645c649" containerName="payload-processing"
Sep 08 14:34:11.973923 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:11.973861    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="811bb03d-3310-492e-a945-b6bc9645c649" containerName="payload-processing"
Sep 08 14:34:11.973923 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:11.973895    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23c16d72-1abf-47f7-a5ff-bac1355c61f2" containerName="revoke-keys"
Sep 08 14:34:11.973923 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:11.973905    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="23c16d72-1abf-47f7-a5ff-bac1355c61f2" containerName="revoke-keys"
Sep 08 14:34:11.974239 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:11.973982    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a70c94f1-9df5-48a7-b094-50d762e3af98" containerName="main"
Sep 08 14:34:11.974239 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:11.973995    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="811bb03d-3310-492e-a945-b6bc9645c649" containerName="payload-processing"
Sep 08 14:34:11.974239 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:11.974006    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="23c16d72-1abf-47f7-a5ff-bac1355c61f2" containerName="revoke-keys"
Sep 08 14:34:11.978390 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:11.978368    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:11.980785 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:11.980763    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-a76115-openshift-default-dockercfg-spj24\""
Sep 08 14:34:11.993260 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:11.993239    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"]
Sep 08 14:34:12.144540 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.144485    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-credential-socket\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.144540 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.144547    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-992vx\" (UniqueName: \"kubernetes.io/projected/867fd7cc-485b-4458-929f-11af201bdc4b-kube-api-access-992vx\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.144806 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.144577    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/867fd7cc-485b-4458-929f-11af201bdc4b-istio-podinfo\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.144806 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.144616    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-istio-envoy\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.144806 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.144674    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-istio-data\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.144806 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.144704    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-workload-certs\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.144806 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.144749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/867fd7cc-485b-4458-929f-11af201bdc4b-istio-token\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.144806 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.144779    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/867fd7cc-485b-4458-929f-11af201bdc4b-istiod-ca-cert\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.145038 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.144813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-workload-socket\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.245596 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.245491    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-istio-envoy\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.245752 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.245634    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-istio-data\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.245752 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.245669    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-workload-certs\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.245752 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.245706    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/867fd7cc-485b-4458-929f-11af201bdc4b-istio-token\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.245934 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.245824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/867fd7cc-485b-4458-929f-11af201bdc4b-istiod-ca-cert\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.245934 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.245873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-workload-socket\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.246070 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.245982    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-credential-socket\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.246070 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.246007    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-992vx\" (UniqueName: \"kubernetes.io/projected/867fd7cc-485b-4458-929f-11af201bdc4b-kube-api-access-992vx\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.246070 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.246021    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-istio-data\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.246070 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.246035    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/867fd7cc-485b-4458-929f-11af201bdc4b-istio-podinfo\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.246070 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.246051    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-workload-certs\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.246322 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.246254    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-workload-socket\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.246482 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.246462    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-credential-socket\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.246622 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.246602    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/867fd7cc-485b-4458-929f-11af201bdc4b-istiod-ca-cert\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.247819 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.247795    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-istio-envoy\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.248431 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.248410    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/867fd7cc-485b-4458-929f-11af201bdc4b-istio-podinfo\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.254901 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.254861    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/867fd7cc-485b-4458-929f-11af201bdc4b-istio-token\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.255655 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.255636    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-992vx\" (UniqueName: \"kubernetes.io/projected/867fd7cc-485b-4458-929f-11af201bdc4b-kube-api-access-992vx\") pod \"e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") " pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.288308 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.288278    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:12.568000 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.567975    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"]
Sep 08 14:34:12.569887 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:34:12.569854    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867fd7cc_485b_4458_929f_11af201bdc4b.slice/crio-a45a996fbea88bd1c5dbc859e252668b81ca1e46ace465b0b3a61ae2ab1ed2e5 WatchSource:0}: Error finding container a45a996fbea88bd1c5dbc859e252668b81ca1e46ace465b0b3a61ae2ab1ed2e5: Status 404 returned error can't find the container with id a45a996fbea88bd1c5dbc859e252668b81ca1e46ace465b0b3a61ae2ab1ed2e5
Sep 08 14:34:12.572458 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.572426    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:34:12.572571 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.572490    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:34:12.572571 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.572551    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:34:12.934062 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.934030    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l" event={"ID":"867fd7cc-485b-4458-929f-11af201bdc4b","Type":"ContainerStarted","Data":"d8e392c8065bea37bf3f712edbf38629de1ea8a689ddd5bf2307172c5c016bdc"}
Sep 08 14:34:12.934223 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.934079    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l" event={"ID":"867fd7cc-485b-4458-929f-11af201bdc4b","Type":"ContainerStarted","Data":"a45a996fbea88bd1c5dbc859e252668b81ca1e46ace465b0b3a61ae2ab1ed2e5"}
Sep 08 14:34:12.958974 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:12.958923    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l" podStartSLOduration=1.958906753 podStartE2EDuration="1.958906753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:12.956953345 +0000 UTC m=+1054.352902790" watchObservedRunningTime="2026-09-08 14:34:12.958906753 +0000 UTC m=+1054.354856184"
Sep 08 14:34:13.288547 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:13.288436    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:13.289728 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:13.289698    2564 patch_prober.go:28] interesting pod/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 08 14:34:13.289855 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:13.289750    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l" podUID="867fd7cc-485b-4458-929f-11af201bdc4b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 08 14:34:14.292888 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:14.292855    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:14.943585 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:14.943554    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:14.944423 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:14.944403    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:24.291399 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.291362    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"]
Sep 08 14:34:24.294928 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.294902    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"
Sep 08 14:34:24.297622 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.297597    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a8fb2c38\""
Sep 08 14:34:24.307064 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.307036    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"]
Sep 08 14:34:24.321085 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.321052    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"]
Sep 08 14:34:24.324816 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.324798    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"
Sep 08 14:34:24.327097 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.327077    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a8fb2c38-dockercfg-cl6bg\""
Sep 08 14:34:24.334293 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.334265    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"]
Sep 08 14:34:24.362394 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.362366    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bda2b02-3a46-4fcf-83ee-0600b03974e4-plugins-config-volume\") pod \"payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns\" (UID: \"9bda2b02-3a46-4fcf-83ee-0600b03974e4\") " pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"
Sep 08 14:34:24.362569 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.362409    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4t5g\" (UniqueName: \"kubernetes.io/projected/9bda2b02-3a46-4fcf-83ee-0600b03974e4-kube-api-access-c4t5g\") pod \"payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns\" (UID: \"9bda2b02-3a46-4fcf-83ee-0600b03974e4\") " pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"
Sep 08 14:34:24.362569 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.362432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6rfx\" (UniqueName: \"kubernetes.io/projected/0249995d-3e4f-4a39-8b18-d0cf6f6ccfae-kube-api-access-s6rfx\") pod \"payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5\" (UID: \"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"
Sep 08 14:34:24.362569 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.362530    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0249995d-3e4f-4a39-8b18-d0cf6f6ccfae-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5\" (UID: \"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"
Sep 08 14:34:24.463354 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.463316    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bda2b02-3a46-4fcf-83ee-0600b03974e4-plugins-config-volume\") pod \"payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns\" (UID: \"9bda2b02-3a46-4fcf-83ee-0600b03974e4\") " pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"
Sep 08 14:34:24.463561 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.463362    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4t5g\" (UniqueName: \"kubernetes.io/projected/9bda2b02-3a46-4fcf-83ee-0600b03974e4-kube-api-access-c4t5g\") pod \"payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns\" (UID: \"9bda2b02-3a46-4fcf-83ee-0600b03974e4\") " pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"
Sep 08 14:34:24.463638 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.463556    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6rfx\" (UniqueName: \"kubernetes.io/projected/0249995d-3e4f-4a39-8b18-d0cf6f6ccfae-kube-api-access-s6rfx\") pod \"payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5\" (UID: \"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"
Sep 08 14:34:24.463701 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.463658    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0249995d-3e4f-4a39-8b18-d0cf6f6ccfae-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5\" (UID: \"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"
Sep 08 14:34:24.464071 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.464048    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bda2b02-3a46-4fcf-83ee-0600b03974e4-plugins-config-volume\") pod \"payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns\" (UID: \"9bda2b02-3a46-4fcf-83ee-0600b03974e4\") " pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"
Sep 08 14:34:24.464346 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.464325    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0249995d-3e4f-4a39-8b18-d0cf6f6ccfae-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5\" (UID: \"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"
Sep 08 14:34:24.473378 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.473358    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6rfx\" (UniqueName: \"kubernetes.io/projected/0249995d-3e4f-4a39-8b18-d0cf6f6ccfae-kube-api-access-s6rfx\") pod \"payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5\" (UID: \"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"
Sep 08 14:34:24.473476 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.473396    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4t5g\" (UniqueName: \"kubernetes.io/projected/9bda2b02-3a46-4fcf-83ee-0600b03974e4-kube-api-access-c4t5g\") pod \"payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns\" (UID: \"9bda2b02-3a46-4fcf-83ee-0600b03974e4\") " pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"
Sep 08 14:34:24.607830 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.607803    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"
Sep 08 14:34:24.634981 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.634948    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"
Sep 08 14:34:24.884731 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.884700    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"]
Sep 08 14:34:24.886015 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:34:24.885989    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0249995d_3e4f_4a39_8b18_d0cf6f6ccfae.slice/crio-c07516b7ef349001f2a496d54a6242afcd1dc89a30dfae4288847bf7c2af67aa WatchSource:0}: Error finding container c07516b7ef349001f2a496d54a6242afcd1dc89a30dfae4288847bf7c2af67aa: Status 404 returned error can't find the container with id c07516b7ef349001f2a496d54a6242afcd1dc89a30dfae4288847bf7c2af67aa
Sep 08 14:34:24.919028 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.919003    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"]
Sep 08 14:34:24.921653 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:34:24.921623    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bda2b02_3a46_4fcf_83ee_0600b03974e4.slice/crio-9fc88dde803ca78d4fd3a269e49bc54e643bef1382bee8488f737db4687ddf65 WatchSource:0}: Error finding container 9fc88dde803ca78d4fd3a269e49bc54e643bef1382bee8488f737db4687ddf65: Status 404 returned error can't find the container with id 9fc88dde803ca78d4fd3a269e49bc54e643bef1382bee8488f737db4687ddf65
Sep 08 14:34:24.995590 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.995444    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns" event={"ID":"9bda2b02-3a46-4fcf-83ee-0600b03974e4","Type":"ContainerStarted","Data":"eb78509638670756c0f66b979fb7b34a07a2959f6b19ffe4cd24e7d732562762"}
Sep 08 14:34:24.995590 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.995530    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"
Sep 08 14:34:24.995590 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.995558    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns" event={"ID":"9bda2b02-3a46-4fcf-83ee-0600b03974e4","Type":"ContainerStarted","Data":"9fc88dde803ca78d4fd3a269e49bc54e643bef1382bee8488f737db4687ddf65"}
Sep 08 14:34:24.997940 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.997889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5" event={"ID":"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae","Type":"ContainerStarted","Data":"b14bc18a334092c7c0fceee2414f2fa43e703f7354cd1c864f4a257059137dc0"}
Sep 08 14:34:24.997940 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.997945    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5" event={"ID":"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae","Type":"ContainerStarted","Data":"c07516b7ef349001f2a496d54a6242afcd1dc89a30dfae4288847bf7c2af67aa"}
Sep 08 14:34:24.998158 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:24.997974    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"
Sep 08 14:34:25.012967 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:25.012920    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns" podStartSLOduration=1.01290504 podStartE2EDuration="1.01290504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:25.011630055 +0000 UTC m=+1066.407579488" watchObservedRunningTime="2026-09-08 14:34:25.01290504 +0000 UTC m=+1066.408854470"
Sep 08 14:34:25.029275 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:25.029227    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5" podStartSLOduration=1.029212849 podStartE2EDuration="1.029212849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:25.028263655 +0000 UTC m=+1066.424213085" watchObservedRunningTime="2026-09-08 14:34:25.029212849 +0000 UTC m=+1066.425162281"
Sep 08 14:34:36.005610 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:36.005524    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"
Sep 08 14:34:36.005610 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:36.005601    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"
Sep 08 14:34:39.948652 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:39.948615    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"]
Sep 08 14:34:48.449324 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:48.449286    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k"]
Sep 08 14:34:48.454240 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:48.454221    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k"
Sep 08 14:34:48.457155 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:48.457132    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:34:48.458458 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:48.458445    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:34:48.465896 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:48.465875    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k"]
Sep 08 14:34:48.580708 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:48.580675    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42e4f6d0-6379-4215-bf33-3ef9a0ed9fea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k\" (UID: \"42e4f6d0-6379-4215-bf33-3ef9a0ed9fea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k"
Sep 08 14:34:48.682014 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:48.681973    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42e4f6d0-6379-4215-bf33-3ef9a0ed9fea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k\" (UID: \"42e4f6d0-6379-4215-bf33-3ef9a0ed9fea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k"
Sep 08 14:34:48.682623 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:48.682603    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42e4f6d0-6379-4215-bf33-3ef9a0ed9fea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k\" (UID: \"42e4f6d0-6379-4215-bf33-3ef9a0ed9fea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k"
Sep 08 14:34:48.764202 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:48.764111    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k"
Sep 08 14:34:49.034949 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:49.034872    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k"]
Sep 08 14:34:49.037736 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:34:49.037711    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e4f6d0_6379_4215_bf33_3ef9a0ed9fea.slice/crio-4177c4fa4cce0d757f0d6ce4e6df555e2c6c8f72d5f137d155ece5b4eb62f6d6 WatchSource:0}: Error finding container 4177c4fa4cce0d757f0d6ce4e6df555e2c6c8f72d5f137d155ece5b4eb62f6d6: Status 404 returned error can't find the container with id 4177c4fa4cce0d757f0d6ce4e6df555e2c6c8f72d5f137d155ece5b4eb62f6d6
Sep 08 14:34:49.133757 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:49.133727    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k" event={"ID":"42e4f6d0-6379-4215-bf33-3ef9a0ed9fea","Type":"ContainerStarted","Data":"4177c4fa4cce0d757f0d6ce4e6df555e2c6c8f72d5f137d155ece5b4eb62f6d6"}
Sep 08 14:34:49.284314 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:49.284283    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"]
Sep 08 14:34:49.284752 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:49.284722    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l" podUID="867fd7cc-485b-4458-929f-11af201bdc4b" containerName="istio-proxy" containerID="cri-o://d8e392c8065bea37bf3f712edbf38629de1ea8a689ddd5bf2307172c5c016bdc" gracePeriod=30
Sep 08 14:34:50.140152 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:50.140121    2564 generic.go:356] "Generic (PLEG): container finished" podID="42e4f6d0-6379-4215-bf33-3ef9a0ed9fea" containerID="9ca44ee0b761c24fb47fa6ee162f1efcbb7e408b1fbf64202eca326e2976406b" exitCode=0
Sep 08 14:34:50.140515 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:50.140182    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k" event={"ID":"42e4f6d0-6379-4215-bf33-3ef9a0ed9fea","Type":"ContainerDied","Data":"9ca44ee0b761c24fb47fa6ee162f1efcbb7e408b1fbf64202eca326e2976406b"}
Sep 08 14:34:51.282052 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:51.282028    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k"
Sep 08 14:34:51.408141 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:51.408057    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42e4f6d0-6379-4215-bf33-3ef9a0ed9fea-maas-api-service-ca\") pod \"42e4f6d0-6379-4215-bf33-3ef9a0ed9fea\" (UID: \"42e4f6d0-6379-4215-bf33-3ef9a0ed9fea\") "
Sep 08 14:34:51.408401 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:51.408378    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42e4f6d0-6379-4215-bf33-3ef9a0ed9fea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "42e4f6d0-6379-4215-bf33-3ef9a0ed9fea" (UID: "42e4f6d0-6379-4215-bf33-3ef9a0ed9fea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:34:51.509149 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:51.509118    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42e4f6d0-6379-4215-bf33-3ef9a0ed9fea-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:52.151699 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:52.151661    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k" event={"ID":"42e4f6d0-6379-4215-bf33-3ef9a0ed9fea","Type":"ContainerDied","Data":"4177c4fa4cce0d757f0d6ce4e6df555e2c6c8f72d5f137d155ece5b4eb62f6d6"}
Sep 08 14:34:52.151909 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:52.151713    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4177c4fa4cce0d757f0d6ce4e6df555e2c6c8f72d5f137d155ece5b4eb62f6d6"
Sep 08 14:34:52.151909 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:52.151680    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k"
Sep 08 14:34:54.530157 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.530134    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:54.638017 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.637990    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-992vx\" (UniqueName: \"kubernetes.io/projected/867fd7cc-485b-4458-929f-11af201bdc4b-kube-api-access-992vx\") pod \"867fd7cc-485b-4458-929f-11af201bdc4b\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") "
Sep 08 14:34:54.638181 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638043    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-workload-certs\") pod \"867fd7cc-485b-4458-929f-11af201bdc4b\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") "
Sep 08 14:34:54.638181 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638119    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/867fd7cc-485b-4458-929f-11af201bdc4b-istio-podinfo\") pod \"867fd7cc-485b-4458-929f-11af201bdc4b\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") "
Sep 08 14:34:54.638181 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638145    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/867fd7cc-485b-4458-929f-11af201bdc4b-istio-token\") pod \"867fd7cc-485b-4458-929f-11af201bdc4b\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") "
Sep 08 14:34:54.638181 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638176    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/867fd7cc-485b-4458-929f-11af201bdc4b-istiod-ca-cert\") pod \"867fd7cc-485b-4458-929f-11af201bdc4b\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") "
Sep 08 14:34:54.638357 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638208    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-workload-socket\") pod \"867fd7cc-485b-4458-929f-11af201bdc4b\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") "
Sep 08 14:34:54.638357 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638227    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-istio-data\") pod \"867fd7cc-485b-4458-929f-11af201bdc4b\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") "
Sep 08 14:34:54.638357 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638271    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-credential-socket\") pod \"867fd7cc-485b-4458-929f-11af201bdc4b\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") "
Sep 08 14:34:54.638357 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638297    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-istio-envoy\") pod \"867fd7cc-485b-4458-929f-11af201bdc4b\" (UID: \"867fd7cc-485b-4458-929f-11af201bdc4b\") "
Sep 08 14:34:54.638594 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638395    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "867fd7cc-485b-4458-929f-11af201bdc4b" (UID: "867fd7cc-485b-4458-929f-11af201bdc4b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:34:54.638594 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638589    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-workload-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:54.638702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638590    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-istio-data" (OuterVolumeSpecName: "istio-data") pod "867fd7cc-485b-4458-929f-11af201bdc4b" (UID: "867fd7cc-485b-4458-929f-11af201bdc4b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:34:54.638702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638616    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "867fd7cc-485b-4458-929f-11af201bdc4b" (UID: "867fd7cc-485b-4458-929f-11af201bdc4b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:34:54.638702 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638669    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "867fd7cc-485b-4458-929f-11af201bdc4b" (UID: "867fd7cc-485b-4458-929f-11af201bdc4b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:34:54.638862 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.638823    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/867fd7cc-485b-4458-929f-11af201bdc4b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "867fd7cc-485b-4458-929f-11af201bdc4b" (UID: "867fd7cc-485b-4458-929f-11af201bdc4b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:34:54.640590 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.640564    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "867fd7cc-485b-4458-929f-11af201bdc4b" (UID: "867fd7cc-485b-4458-929f-11af201bdc4b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:34:54.640706 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.640696    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/867fd7cc-485b-4458-929f-11af201bdc4b-kube-api-access-992vx" (OuterVolumeSpecName: "kube-api-access-992vx") pod "867fd7cc-485b-4458-929f-11af201bdc4b" (UID: "867fd7cc-485b-4458-929f-11af201bdc4b"). InnerVolumeSpecName "kube-api-access-992vx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:34:54.640772 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.640714    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/867fd7cc-485b-4458-929f-11af201bdc4b-istio-token" (OuterVolumeSpecName: "istio-token") pod "867fd7cc-485b-4458-929f-11af201bdc4b" (UID: "867fd7cc-485b-4458-929f-11af201bdc4b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:34:54.640829 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.640763    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/867fd7cc-485b-4458-929f-11af201bdc4b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "867fd7cc-485b-4458-929f-11af201bdc4b" (UID: "867fd7cc-485b-4458-929f-11af201bdc4b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:34:54.739730 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.739700    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-credential-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:54.739730 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.739725    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-istio-envoy\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:54.739730 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.739734    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-992vx\" (UniqueName: \"kubernetes.io/projected/867fd7cc-485b-4458-929f-11af201bdc4b-kube-api-access-992vx\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:54.739946 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.739742    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/867fd7cc-485b-4458-929f-11af201bdc4b-istio-podinfo\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:54.739946 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.739750    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/867fd7cc-485b-4458-929f-11af201bdc4b-istio-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:54.739946 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.739757    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/867fd7cc-485b-4458-929f-11af201bdc4b-istiod-ca-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:54.739946 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.739765    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-workload-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:54.739946 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.739773    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/867fd7cc-485b-4458-929f-11af201bdc4b-istio-data\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:54.967301 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:54.967225    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s" podUID="d036e31f-20ad-426e-9e3d-1031d9b130c5" containerName="main" containerID="cri-o://6667638a4152dec964359e51e40b5a2bfd54f09af637b0554e871e877a3390d1" gracePeriod=45
Sep 08 14:34:55.093801 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.093769    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl"]
Sep 08 14:34:55.094164 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.094148    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="867fd7cc-485b-4458-929f-11af201bdc4b" containerName="istio-proxy"
Sep 08 14:34:55.094232 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.094166    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="867fd7cc-485b-4458-929f-11af201bdc4b" containerName="istio-proxy"
Sep 08 14:34:55.094232 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.094182    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42e4f6d0-6379-4215-bf33-3ef9a0ed9fea" containerName="revoke-keys"
Sep 08 14:34:55.094232 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.094188    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="42e4f6d0-6379-4215-bf33-3ef9a0ed9fea" containerName="revoke-keys"
Sep 08 14:34:55.094383 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.094250    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="42e4f6d0-6379-4215-bf33-3ef9a0ed9fea" containerName="revoke-keys"
Sep 08 14:34:55.094383 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.094262    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="867fd7cc-485b-4458-929f-11af201bdc4b" containerName="istio-proxy"
Sep 08 14:34:55.097147 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.097127    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl"
Sep 08 14:34:55.099873 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.099850    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:34:55.100021 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.099896    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:34:55.105948 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.105881    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl"]
Sep 08 14:34:55.170145 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.170112    2564 generic.go:356] "Generic (PLEG): container finished" podID="d036e31f-20ad-426e-9e3d-1031d9b130c5" containerID="6667638a4152dec964359e51e40b5a2bfd54f09af637b0554e871e877a3390d1" exitCode=0
Sep 08 14:34:55.170354 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.170326    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s" event={"ID":"d036e31f-20ad-426e-9e3d-1031d9b130c5","Type":"ContainerDied","Data":"6667638a4152dec964359e51e40b5a2bfd54f09af637b0554e871e877a3390d1"}
Sep 08 14:34:55.171827 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.171772    2564 generic.go:356] "Generic (PLEG): container finished" podID="867fd7cc-485b-4458-929f-11af201bdc4b" containerID="d8e392c8065bea37bf3f712edbf38629de1ea8a689ddd5bf2307172c5c016bdc" exitCode=0
Sep 08 14:34:55.171827 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.171810    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l" event={"ID":"867fd7cc-485b-4458-929f-11af201bdc4b","Type":"ContainerDied","Data":"d8e392c8065bea37bf3f712edbf38629de1ea8a689ddd5bf2307172c5c016bdc"}
Sep 08 14:34:55.171998 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.171866    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l" event={"ID":"867fd7cc-485b-4458-929f-11af201bdc4b","Type":"ContainerDied","Data":"a45a996fbea88bd1c5dbc859e252668b81ca1e46ace465b0b3a61ae2ab1ed2e5"}
Sep 08 14:34:55.171998 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.171888    2564 scope.go:117] "RemoveContainer" containerID="d8e392c8065bea37bf3f712edbf38629de1ea8a689ddd5bf2307172c5c016bdc"
Sep 08 14:34:55.171998 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.171822    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"
Sep 08 14:34:55.188478 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.188461    2564 scope.go:117] "RemoveContainer" containerID="d8e392c8065bea37bf3f712edbf38629de1ea8a689ddd5bf2307172c5c016bdc"
Sep 08 14:34:55.188771 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:34:55.188749    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8e392c8065bea37bf3f712edbf38629de1ea8a689ddd5bf2307172c5c016bdc\": container with ID starting with d8e392c8065bea37bf3f712edbf38629de1ea8a689ddd5bf2307172c5c016bdc not found: ID does not exist" containerID="d8e392c8065bea37bf3f712edbf38629de1ea8a689ddd5bf2307172c5c016bdc"
Sep 08 14:34:55.188832 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.188778    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8e392c8065bea37bf3f712edbf38629de1ea8a689ddd5bf2307172c5c016bdc"} err="failed to get container status \"d8e392c8065bea37bf3f712edbf38629de1ea8a689ddd5bf2307172c5c016bdc\": rpc error: code = NotFound desc = could not find container \"d8e392c8065bea37bf3f712edbf38629de1ea8a689ddd5bf2307172c5c016bdc\": container with ID starting with d8e392c8065bea37bf3f712edbf38629de1ea8a689ddd5bf2307172c5c016bdc not found: ID does not exist"
Sep 08 14:34:55.198207 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.198182    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"]
Sep 08 14:34:55.203398 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.203377    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-a76115-openshift-default-76ffb6f9db-t9f4l"]
Sep 08 14:34:55.219227 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.219180    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:34:55.243386 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.243365    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc3b791-bf11-446c-a03d-ec41c9d8e1b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl\" (UID: \"1dc3b791-bf11-446c-a03d-ec41c9d8e1b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl"
Sep 08 14:34:55.344443 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.344414    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-model-cache\") pod \"d036e31f-20ad-426e-9e3d-1031d9b130c5\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") "
Sep 08 14:34:55.344620 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.344519    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-tmp-dir\") pod \"d036e31f-20ad-426e-9e3d-1031d9b130c5\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") "
Sep 08 14:34:55.344620 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.344548    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-home\") pod \"d036e31f-20ad-426e-9e3d-1031d9b130c5\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") "
Sep 08 14:34:55.344620 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.344598    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d036e31f-20ad-426e-9e3d-1031d9b130c5-tls-certs\") pod \"d036e31f-20ad-426e-9e3d-1031d9b130c5\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") "
Sep 08 14:34:55.344777 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.344635    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7k58\" (UniqueName: \"kubernetes.io/projected/d036e31f-20ad-426e-9e3d-1031d9b130c5-kube-api-access-t7k58\") pod \"d036e31f-20ad-426e-9e3d-1031d9b130c5\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") "
Sep 08 14:34:55.344777 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.344673    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-dshm\") pod \"d036e31f-20ad-426e-9e3d-1031d9b130c5\" (UID: \"d036e31f-20ad-426e-9e3d-1031d9b130c5\") "
Sep 08 14:34:55.344777 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.344714    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-model-cache" (OuterVolumeSpecName: "model-cache") pod "d036e31f-20ad-426e-9e3d-1031d9b130c5" (UID: "d036e31f-20ad-426e-9e3d-1031d9b130c5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:34:55.344921 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.344819    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc3b791-bf11-446c-a03d-ec41c9d8e1b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl\" (UID: \"1dc3b791-bf11-446c-a03d-ec41c9d8e1b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl"
Sep 08 14:34:55.344921 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.344803    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d036e31f-20ad-426e-9e3d-1031d9b130c5" (UID: "d036e31f-20ad-426e-9e3d-1031d9b130c5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:34:55.344921 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.344823    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-home" (OuterVolumeSpecName: "home") pod "d036e31f-20ad-426e-9e3d-1031d9b130c5" (UID: "d036e31f-20ad-426e-9e3d-1031d9b130c5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:34:55.345066 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.345049    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-home\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:55.345112 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.345071    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-model-cache\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:55.345112 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.345086    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-tmp-dir\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:55.345391 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.345373    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc3b791-bf11-446c-a03d-ec41c9d8e1b9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl\" (UID: \"1dc3b791-bf11-446c-a03d-ec41c9d8e1b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl"
Sep 08 14:34:55.346886 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.346863    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d036e31f-20ad-426e-9e3d-1031d9b130c5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d036e31f-20ad-426e-9e3d-1031d9b130c5" (UID: "d036e31f-20ad-426e-9e3d-1031d9b130c5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:34:55.347130 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.347101    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-dshm" (OuterVolumeSpecName: "dshm") pod "d036e31f-20ad-426e-9e3d-1031d9b130c5" (UID: "d036e31f-20ad-426e-9e3d-1031d9b130c5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:34:55.347130 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.347116    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d036e31f-20ad-426e-9e3d-1031d9b130c5-kube-api-access-t7k58" (OuterVolumeSpecName: "kube-api-access-t7k58") pod "d036e31f-20ad-426e-9e3d-1031d9b130c5" (UID: "d036e31f-20ad-426e-9e3d-1031d9b130c5"). InnerVolumeSpecName "kube-api-access-t7k58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:34:55.410828 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.410798    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl"
Sep 08 14:34:55.446026 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.445995    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d036e31f-20ad-426e-9e3d-1031d9b130c5-tls-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:55.446026 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.446023    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7k58\" (UniqueName: \"kubernetes.io/projected/d036e31f-20ad-426e-9e3d-1031d9b130c5-kube-api-access-t7k58\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:55.446190 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.446034    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d036e31f-20ad-426e-9e3d-1031d9b130c5-dshm\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:55.679237 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:55.679212    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl"]
Sep 08 14:34:55.681139 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:34:55.681110    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc3b791_bf11_446c_a03d_ec41c9d8e1b9.slice/crio-65468fd9187c9f49f129f370c6d13e82586b92215ab9e43e755e042a10de9910 WatchSource:0}: Error finding container 65468fd9187c9f49f129f370c6d13e82586b92215ab9e43e755e042a10de9910: Status 404 returned error can't find the container with id 65468fd9187c9f49f129f370c6d13e82586b92215ab9e43e755e042a10de9910
Sep 08 14:34:56.178683 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:56.178650    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl" event={"ID":"1dc3b791-bf11-446c-a03d-ec41c9d8e1b9","Type":"ContainerStarted","Data":"7130362c5057d040f51f8af039eee487c3d2c146b1530d13c1fb5c8810961d84"}
Sep 08 14:34:56.178883 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:56.178703    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl" event={"ID":"1dc3b791-bf11-446c-a03d-ec41c9d8e1b9","Type":"ContainerStarted","Data":"65468fd9187c9f49f129f370c6d13e82586b92215ab9e43e755e042a10de9910"}
Sep 08 14:34:56.180773 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:56.180754    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"
Sep 08 14:34:56.180889 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:56.180754    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s" event={"ID":"d036e31f-20ad-426e-9e3d-1031d9b130c5","Type":"ContainerDied","Data":"49eabf2d8a42215b4b121826b2226f747b63d045daae7029972eaa3e38b2b0c7"}
Sep 08 14:34:56.180952 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:56.180899    2564 scope.go:117] "RemoveContainer" containerID="6667638a4152dec964359e51e40b5a2bfd54f09af637b0554e871e877a3390d1"
Sep 08 14:34:56.193932 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:56.193654    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl" podStartSLOduration=1.193638955 podStartE2EDuration="1.193638955s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:34:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:34:56.192977607 +0000 UTC m=+1097.588927036" watchObservedRunningTime="2026-09-08 14:34:56.193638955 +0000 UTC m=+1097.589588387"
Sep 08 14:34:56.211789 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:56.211762    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"]
Sep 08 14:34:56.216233 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:56.216211    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-75b8cd/test-model-75b8cd-kserve-84f7c88cd7-4df5s"]
Sep 08 14:34:57.186296 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:57.186261    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="867fd7cc-485b-4458-929f-11af201bdc4b" path="/var/lib/kubelet/pods/867fd7cc-485b-4458-929f-11af201bdc4b/volumes"
Sep 08 14:34:57.186774 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:57.186756    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d036e31f-20ad-426e-9e3d-1031d9b130c5" path="/var/lib/kubelet/pods/d036e31f-20ad-426e-9e3d-1031d9b130c5/volumes"
Sep 08 14:34:57.187520 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:57.187483    2564 generic.go:356] "Generic (PLEG): container finished" podID="1dc3b791-bf11-446c-a03d-ec41c9d8e1b9" containerID="7130362c5057d040f51f8af039eee487c3d2c146b1530d13c1fb5c8810961d84" exitCode=0
Sep 08 14:34:57.187612 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:57.187562    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl" event={"ID":"1dc3b791-bf11-446c-a03d-ec41c9d8e1b9","Type":"ContainerDied","Data":"7130362c5057d040f51f8af039eee487c3d2c146b1530d13c1fb5c8810961d84"}
Sep 08 14:34:58.327453 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:58.327427    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl"
Sep 08 14:34:58.369897 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:58.369871    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc3b791-bf11-446c-a03d-ec41c9d8e1b9-maas-api-service-ca\") pod \"1dc3b791-bf11-446c-a03d-ec41c9d8e1b9\" (UID: \"1dc3b791-bf11-446c-a03d-ec41c9d8e1b9\") "
Sep 08 14:34:58.370208 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:58.370187    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dc3b791-bf11-446c-a03d-ec41c9d8e1b9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1dc3b791-bf11-446c-a03d-ec41c9d8e1b9" (UID: "1dc3b791-bf11-446c-a03d-ec41c9d8e1b9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:34:58.471306 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:58.471244    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1dc3b791-bf11-446c-a03d-ec41c9d8e1b9-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:34:59.204597 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:59.204556    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl" event={"ID":"1dc3b791-bf11-446c-a03d-ec41c9d8e1b9","Type":"ContainerDied","Data":"65468fd9187c9f49f129f370c6d13e82586b92215ab9e43e755e042a10de9910"}
Sep 08 14:34:59.204760 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:59.204624    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65468fd9187c9f49f129f370c6d13e82586b92215ab9e43e755e042a10de9910"
Sep 08 14:34:59.205082 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:59.205057    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl"
Sep 08 14:34:59.454195 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:59.454119    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k"]
Sep 08 14:34:59.457993 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:34:59.457964    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-75b8cd-khg5k"]
Sep 08 14:35:01.185543 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:01.185492    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42e4f6d0-6379-4215-bf33-3ef9a0ed9fea" path="/var/lib/kubelet/pods/42e4f6d0-6379-4215-bf33-3ef9a0ed9fea/volumes"
Sep 08 14:35:06.016018 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.015983    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"]
Sep 08 14:35:06.016469 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.016183    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns" podUID="9bda2b02-3a46-4fcf-83ee-0600b03974e4" containerName="payload-processing" containerID="cri-o://eb78509638670756c0f66b979fb7b34a07a2959f6b19ffe4cd24e7d732562762" gracePeriod=30
Sep 08 14:35:06.020868 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.020844    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"]
Sep 08 14:35:06.021221 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.021196    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5" podUID="0249995d-3e4f-4a39-8b18-d0cf6f6ccfae" containerName="payload-pre-processing" containerID="cri-o://b14bc18a334092c7c0fceee2414f2fa43e703f7354cd1c864f4a257059137dc0" gracePeriod=30
Sep 08 14:35:06.187329 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.187295    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl"]
Sep 08 14:35:06.191737 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.191701    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-a8fb2c38-rp6vl"]
Sep 08 14:35:06.242306 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.242271    2564 generic.go:356] "Generic (PLEG): container finished" podID="9bda2b02-3a46-4fcf-83ee-0600b03974e4" containerID="eb78509638670756c0f66b979fb7b34a07a2959f6b19ffe4cd24e7d732562762" exitCode=0
Sep 08 14:35:06.242456 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.242337    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns" event={"ID":"9bda2b02-3a46-4fcf-83ee-0600b03974e4","Type":"ContainerDied","Data":"eb78509638670756c0f66b979fb7b34a07a2959f6b19ffe4cd24e7d732562762"}
Sep 08 14:35:06.244252 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.244228    2564 generic.go:356] "Generic (PLEG): container finished" podID="0249995d-3e4f-4a39-8b18-d0cf6f6ccfae" containerID="b14bc18a334092c7c0fceee2414f2fa43e703f7354cd1c864f4a257059137dc0" exitCode=0
Sep 08 14:35:06.244378 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.244295    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5" event={"ID":"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae","Type":"ContainerDied","Data":"b14bc18a334092c7c0fceee2414f2fa43e703f7354cd1c864f4a257059137dc0"}
Sep 08 14:35:06.286939 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.286923    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"
Sep 08 14:35:06.288821 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.288804    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"
Sep 08 14:35:06.342138 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.342103    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6rfx\" (UniqueName: \"kubernetes.io/projected/0249995d-3e4f-4a39-8b18-d0cf6f6ccfae-kube-api-access-s6rfx\") pod \"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae\" (UID: \"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae\") "
Sep 08 14:35:06.342302 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.342171    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4t5g\" (UniqueName: \"kubernetes.io/projected/9bda2b02-3a46-4fcf-83ee-0600b03974e4-kube-api-access-c4t5g\") pod \"9bda2b02-3a46-4fcf-83ee-0600b03974e4\" (UID: \"9bda2b02-3a46-4fcf-83ee-0600b03974e4\") "
Sep 08 14:35:06.342302 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.342246    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bda2b02-3a46-4fcf-83ee-0600b03974e4-plugins-config-volume\") pod \"9bda2b02-3a46-4fcf-83ee-0600b03974e4\" (UID: \"9bda2b02-3a46-4fcf-83ee-0600b03974e4\") "
Sep 08 14:35:06.342302 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.342290    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0249995d-3e4f-4a39-8b18-d0cf6f6ccfae-plugins-config-volume\") pod \"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae\" (UID: \"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae\") "
Sep 08 14:35:06.342967 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.342935    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0249995d-3e4f-4a39-8b18-d0cf6f6ccfae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0249995d-3e4f-4a39-8b18-d0cf6f6ccfae" (UID: "0249995d-3e4f-4a39-8b18-d0cf6f6ccfae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:35:06.343286 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.343216    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bda2b02-3a46-4fcf-83ee-0600b03974e4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9bda2b02-3a46-4fcf-83ee-0600b03974e4" (UID: "9bda2b02-3a46-4fcf-83ee-0600b03974e4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:35:06.345175 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.345146    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0249995d-3e4f-4a39-8b18-d0cf6f6ccfae-kube-api-access-s6rfx" (OuterVolumeSpecName: "kube-api-access-s6rfx") pod "0249995d-3e4f-4a39-8b18-d0cf6f6ccfae" (UID: "0249995d-3e4f-4a39-8b18-d0cf6f6ccfae"). InnerVolumeSpecName "kube-api-access-s6rfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:35:06.345374 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.345353    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bda2b02-3a46-4fcf-83ee-0600b03974e4-kube-api-access-c4t5g" (OuterVolumeSpecName: "kube-api-access-c4t5g") pod "9bda2b02-3a46-4fcf-83ee-0600b03974e4" (UID: "9bda2b02-3a46-4fcf-83ee-0600b03974e4"). InnerVolumeSpecName "kube-api-access-c4t5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:35:06.443829 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.443796    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bda2b02-3a46-4fcf-83ee-0600b03974e4-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:06.443829 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.443823    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0249995d-3e4f-4a39-8b18-d0cf6f6ccfae-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:06.443829 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.443832    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6rfx\" (UniqueName: \"kubernetes.io/projected/0249995d-3e4f-4a39-8b18-d0cf6f6ccfae-kube-api-access-s6rfx\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:06.444047 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:06.443840    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4t5g\" (UniqueName: \"kubernetes.io/projected/9bda2b02-3a46-4fcf-83ee-0600b03974e4-kube-api-access-c4t5g\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:07.186333 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.186302    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dc3b791-bf11-446c-a03d-ec41c9d8e1b9" path="/var/lib/kubelet/pods/1dc3b791-bf11-446c-a03d-ec41c9d8e1b9/volumes"
Sep 08 14:35:07.212654 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.212622    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"]
Sep 08 14:35:07.212911 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.212859    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy" containerID="cri-o://5110363202e669f293a54ecd246e5da72eb59cfaffe0393984e6ec6c09bd784a" gracePeriod=30
Sep 08 14:35:07.250944 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.250911    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"
Sep 08 14:35:07.250944 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.250938    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns" event={"ID":"9bda2b02-3a46-4fcf-83ee-0600b03974e4","Type":"ContainerDied","Data":"9fc88dde803ca78d4fd3a269e49bc54e643bef1382bee8488f737db4687ddf65"}
Sep 08 14:35:07.251171 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.250998    2564 scope.go:117] "RemoveContainer" containerID="eb78509638670756c0f66b979fb7b34a07a2959f6b19ffe4cd24e7d732562762"
Sep 08 14:35:07.252587 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.252556    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5" event={"ID":"0249995d-3e4f-4a39-8b18-d0cf6f6ccfae","Type":"ContainerDied","Data":"c07516b7ef349001f2a496d54a6242afcd1dc89a30dfae4288847bf7c2af67aa"}
Sep 08 14:35:07.252683 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.252594    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"
Sep 08 14:35:07.259721 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.259697    2564 scope.go:117] "RemoveContainer" containerID="b14bc18a334092c7c0fceee2414f2fa43e703f7354cd1c864f4a257059137dc0"
Sep 08 14:35:07.271122 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.271100    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"]
Sep 08 14:35:07.278238 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.278215    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a8fb2c38-8fdc64c94-x2ln5"]
Sep 08 14:35:07.290339 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.290315    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"]
Sep 08 14:35:07.295640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.295617    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-a8fb2c38-85d694cf7-22rns"]
Sep 08 14:35:07.598357 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.598328    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s"]
Sep 08 14:35:07.598707 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.598690    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bda2b02-3a46-4fcf-83ee-0600b03974e4" containerName="payload-processing"
Sep 08 14:35:07.598782 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.598709    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bda2b02-3a46-4fcf-83ee-0600b03974e4" containerName="payload-processing"
Sep 08 14:35:07.598782 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.598720    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d036e31f-20ad-426e-9e3d-1031d9b130c5" containerName="main"
Sep 08 14:35:07.598782 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.598726    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d036e31f-20ad-426e-9e3d-1031d9b130c5" containerName="main"
Sep 08 14:35:07.598782 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.598733    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0249995d-3e4f-4a39-8b18-d0cf6f6ccfae" containerName="payload-pre-processing"
Sep 08 14:35:07.598782 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.598741    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0249995d-3e4f-4a39-8b18-d0cf6f6ccfae" containerName="payload-pre-processing"
Sep 08 14:35:07.598782 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.598746    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dc3b791-bf11-446c-a03d-ec41c9d8e1b9" containerName="revoke-keys"
Sep 08 14:35:07.598782 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.598751    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dc3b791-bf11-446c-a03d-ec41c9d8e1b9" containerName="revoke-keys"
Sep 08 14:35:07.599116 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.598814    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dc3b791-bf11-446c-a03d-ec41c9d8e1b9" containerName="revoke-keys"
Sep 08 14:35:07.599116 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.598820    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bda2b02-3a46-4fcf-83ee-0600b03974e4" containerName="payload-processing"
Sep 08 14:35:07.599116 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.598827    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0249995d-3e4f-4a39-8b18-d0cf6f6ccfae" containerName="payload-pre-processing"
Sep 08 14:35:07.599116 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.598832    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d036e31f-20ad-426e-9e3d-1031d9b130c5" containerName="main"
Sep 08 14:35:07.603233 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.603212    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s"
Sep 08 14:35:07.605602 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.605582    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:35:07.605712 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.605623    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:35:07.609285 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.609259    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s"]
Sep 08 14:35:07.654805 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.654776    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3cb8d6b-6026-4d38-8a22-e8321961384f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s\" (UID: \"a3cb8d6b-6026-4d38-8a22-e8321961384f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s"
Sep 08 14:35:07.755465 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.755435    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3cb8d6b-6026-4d38-8a22-e8321961384f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s\" (UID: \"a3cb8d6b-6026-4d38-8a22-e8321961384f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s"
Sep 08 14:35:07.756067 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.756046    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3cb8d6b-6026-4d38-8a22-e8321961384f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s\" (UID: \"a3cb8d6b-6026-4d38-8a22-e8321961384f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s"
Sep 08 14:35:07.915352 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:07.915273    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s"
Sep 08 14:35:08.183646 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:08.183443    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s"]
Sep 08 14:35:08.185747 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:35:08.185715    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3cb8d6b_6026_4d38_8a22_e8321961384f.slice/crio-d7dd463245d9f812e3a4f5404be5b4aeb9f88fd205add4930e49d7656ac4055d WatchSource:0}: Error finding container d7dd463245d9f812e3a4f5404be5b4aeb9f88fd205add4930e49d7656ac4055d: Status 404 returned error can't find the container with id d7dd463245d9f812e3a4f5404be5b4aeb9f88fd205add4930e49d7656ac4055d
Sep 08 14:35:08.262179 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:08.262148    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s" event={"ID":"a3cb8d6b-6026-4d38-8a22-e8321961384f","Type":"ContainerStarted","Data":"d7dd463245d9f812e3a4f5404be5b4aeb9f88fd205add4930e49d7656ac4055d"}
Sep 08 14:35:09.186075 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:09.186043    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0249995d-3e4f-4a39-8b18-d0cf6f6ccfae" path="/var/lib/kubelet/pods/0249995d-3e4f-4a39-8b18-d0cf6f6ccfae/volumes"
Sep 08 14:35:09.186424 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:09.186408    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bda2b02-3a46-4fcf-83ee-0600b03974e4" path="/var/lib/kubelet/pods/9bda2b02-3a46-4fcf-83ee-0600b03974e4/volumes"
Sep 08 14:35:09.268529 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:09.268489    2564 generic.go:356] "Generic (PLEG): container finished" podID="a3cb8d6b-6026-4d38-8a22-e8321961384f" containerID="095656982bd44a2c5e5f465c5e5d171a041d7b00d5ae0a6925ec4bf1c6e7247d" exitCode=0
Sep 08 14:35:09.268852 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:09.268549    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s" event={"ID":"a3cb8d6b-6026-4d38-8a22-e8321961384f","Type":"ContainerDied","Data":"095656982bd44a2c5e5f465c5e5d171a041d7b00d5ae0a6925ec4bf1c6e7247d"}
Sep 08 14:35:10.414800 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:10.414780    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s"
Sep 08 14:35:10.480734 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:10.480711    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3cb8d6b-6026-4d38-8a22-e8321961384f-maas-api-service-ca\") pod \"a3cb8d6b-6026-4d38-8a22-e8321961384f\" (UID: \"a3cb8d6b-6026-4d38-8a22-e8321961384f\") "
Sep 08 14:35:10.481086 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:10.481067    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3cb8d6b-6026-4d38-8a22-e8321961384f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a3cb8d6b-6026-4d38-8a22-e8321961384f" (UID: "a3cb8d6b-6026-4d38-8a22-e8321961384f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:35:10.581970 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:10.581950    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a3cb8d6b-6026-4d38-8a22-e8321961384f-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:11.279821 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:11.279792    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s"
Sep 08 14:35:11.279994 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:11.279823    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s" event={"ID":"a3cb8d6b-6026-4d38-8a22-e8321961384f","Type":"ContainerDied","Data":"d7dd463245d9f812e3a4f5404be5b4aeb9f88fd205add4930e49d7656ac4055d"}
Sep 08 14:35:11.279994 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:11.279873    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7dd463245d9f812e3a4f5404be5b4aeb9f88fd205add4930e49d7656ac4055d"
Sep 08 14:35:11.439433 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:11.439398    2564 patch_prober.go:28] interesting pod/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:35:11.439795 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:11.439465    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:35:12.462109 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.462080    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:35:12.496420 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496344    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-workload-certs\") pod \"ada11f62-4f21-4cd1-9d4d-79311cf25553\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") "
Sep 08 14:35:12.496420 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496402    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-data\") pod \"ada11f62-4f21-4cd1-9d4d-79311cf25553\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") "
Sep 08 14:35:12.496639 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496443    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-workload-socket\") pod \"ada11f62-4f21-4cd1-9d4d-79311cf25553\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") "
Sep 08 14:35:12.496639 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496522    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-credential-socket\") pod \"ada11f62-4f21-4cd1-9d4d-79311cf25553\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") "
Sep 08 14:35:12.496639 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496559    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-envoy\") pod \"ada11f62-4f21-4cd1-9d4d-79311cf25553\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") "
Sep 08 14:35:12.496639 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496596    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxb2z\" (UniqueName: \"kubernetes.io/projected/ada11f62-4f21-4cd1-9d4d-79311cf25553-kube-api-access-gxb2z\") pod \"ada11f62-4f21-4cd1-9d4d-79311cf25553\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") "
Sep 08 14:35:12.496639 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496623    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ada11f62-4f21-4cd1-9d4d-79311cf25553-istiod-ca-cert\") pod \"ada11f62-4f21-4cd1-9d4d-79311cf25553\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") "
Sep 08 14:35:12.496639 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496638    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-podinfo\") pod \"ada11f62-4f21-4cd1-9d4d-79311cf25553\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") "
Sep 08 14:35:12.496937 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496638    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ada11f62-4f21-4cd1-9d4d-79311cf25553" (UID: "ada11f62-4f21-4cd1-9d4d-79311cf25553"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:35:12.496937 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496667    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-token\") pod \"ada11f62-4f21-4cd1-9d4d-79311cf25553\" (UID: \"ada11f62-4f21-4cd1-9d4d-79311cf25553\") "
Sep 08 14:35:12.496937 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496741    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-data" (OuterVolumeSpecName: "istio-data") pod "ada11f62-4f21-4cd1-9d4d-79311cf25553" (UID: "ada11f62-4f21-4cd1-9d4d-79311cf25553"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:35:12.496937 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496852    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ada11f62-4f21-4cd1-9d4d-79311cf25553" (UID: "ada11f62-4f21-4cd1-9d4d-79311cf25553"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:35:12.497142 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496945    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-workload-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:12.497142 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496962    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-workload-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:12.497142 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.496975    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-data\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:12.497301 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.497274    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ada11f62-4f21-4cd1-9d4d-79311cf25553-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ada11f62-4f21-4cd1-9d4d-79311cf25553" (UID: "ada11f62-4f21-4cd1-9d4d-79311cf25553"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:35:12.497526 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.497490    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ada11f62-4f21-4cd1-9d4d-79311cf25553" (UID: "ada11f62-4f21-4cd1-9d4d-79311cf25553"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:35:12.498936 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.498909    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ada11f62-4f21-4cd1-9d4d-79311cf25553-kube-api-access-gxb2z" (OuterVolumeSpecName: "kube-api-access-gxb2z") pod "ada11f62-4f21-4cd1-9d4d-79311cf25553" (UID: "ada11f62-4f21-4cd1-9d4d-79311cf25553"). InnerVolumeSpecName "kube-api-access-gxb2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:35:12.499361 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.499339    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-token" (OuterVolumeSpecName: "istio-token") pod "ada11f62-4f21-4cd1-9d4d-79311cf25553" (UID: "ada11f62-4f21-4cd1-9d4d-79311cf25553"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:35:12.499445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.499369    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ada11f62-4f21-4cd1-9d4d-79311cf25553" (UID: "ada11f62-4f21-4cd1-9d4d-79311cf25553"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:35:12.499445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.499378    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ada11f62-4f21-4cd1-9d4d-79311cf25553" (UID: "ada11f62-4f21-4cd1-9d4d-79311cf25553"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:35:12.597804 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.597772    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-credential-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:12.597804 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.597807    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-envoy\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:12.597948 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.597821    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxb2z\" (UniqueName: \"kubernetes.io/projected/ada11f62-4f21-4cd1-9d4d-79311cf25553-kube-api-access-gxb2z\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:12.597948 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.597832    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ada11f62-4f21-4cd1-9d4d-79311cf25553-istiod-ca-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:12.597948 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.597843    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-podinfo\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:12.597948 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:12.597853    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ada11f62-4f21-4cd1-9d4d-79311cf25553-istio-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:13.291463 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:13.291433    2564 generic.go:356] "Generic (PLEG): container finished" podID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerID="5110363202e669f293a54ecd246e5da72eb59cfaffe0393984e6ec6c09bd784a" exitCode=0
Sep 08 14:35:13.291623 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:13.291479    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"
Sep 08 14:35:13.291623 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:13.291534    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" event={"ID":"ada11f62-4f21-4cd1-9d4d-79311cf25553","Type":"ContainerDied","Data":"5110363202e669f293a54ecd246e5da72eb59cfaffe0393984e6ec6c09bd784a"}
Sep 08 14:35:13.291623 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:13.291600    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9" event={"ID":"ada11f62-4f21-4cd1-9d4d-79311cf25553","Type":"ContainerDied","Data":"aa9ce1ed57ddccc5d593a186a9c58e7d2760f29f5063c141072a38078d6e5567"}
Sep 08 14:35:13.291770 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:13.291628    2564 scope.go:117] "RemoveContainer" containerID="5110363202e669f293a54ecd246e5da72eb59cfaffe0393984e6ec6c09bd784a"
Sep 08 14:35:13.300285 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:13.300266    2564 scope.go:117] "RemoveContainer" containerID="ca6c5c6aa867026c877914a84dace2df3a8cb5561677df20b2b4631452664ae4"
Sep 08 14:35:13.309422 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:13.309395    2564 scope.go:117] "RemoveContainer" containerID="5110363202e669f293a54ecd246e5da72eb59cfaffe0393984e6ec6c09bd784a"
Sep 08 14:35:13.309722 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:35:13.309704    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5110363202e669f293a54ecd246e5da72eb59cfaffe0393984e6ec6c09bd784a\": container with ID starting with 5110363202e669f293a54ecd246e5da72eb59cfaffe0393984e6ec6c09bd784a not found: ID does not exist" containerID="5110363202e669f293a54ecd246e5da72eb59cfaffe0393984e6ec6c09bd784a"
Sep 08 14:35:13.309806 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:13.309736    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5110363202e669f293a54ecd246e5da72eb59cfaffe0393984e6ec6c09bd784a"} err="failed to get container status \"5110363202e669f293a54ecd246e5da72eb59cfaffe0393984e6ec6c09bd784a\": rpc error: code = NotFound desc = could not find container \"5110363202e669f293a54ecd246e5da72eb59cfaffe0393984e6ec6c09bd784a\": container with ID starting with 5110363202e669f293a54ecd246e5da72eb59cfaffe0393984e6ec6c09bd784a not found: ID does not exist"
Sep 08 14:35:13.309806 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:13.309762    2564 scope.go:117] "RemoveContainer" containerID="ca6c5c6aa867026c877914a84dace2df3a8cb5561677df20b2b4631452664ae4"
Sep 08 14:35:13.310003 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:35:13.309986    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca6c5c6aa867026c877914a84dace2df3a8cb5561677df20b2b4631452664ae4\": container with ID starting with ca6c5c6aa867026c877914a84dace2df3a8cb5561677df20b2b4631452664ae4 not found: ID does not exist" containerID="ca6c5c6aa867026c877914a84dace2df3a8cb5561677df20b2b4631452664ae4"
Sep 08 14:35:13.310045 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:13.310010    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca6c5c6aa867026c877914a84dace2df3a8cb5561677df20b2b4631452664ae4"} err="failed to get container status \"ca6c5c6aa867026c877914a84dace2df3a8cb5561677df20b2b4631452664ae4\": rpc error: code = NotFound desc = could not find container \"ca6c5c6aa867026c877914a84dace2df3a8cb5561677df20b2b4631452664ae4\": container with ID starting with ca6c5c6aa867026c877914a84dace2df3a8cb5561677df20b2b4631452664ae4 not found: ID does not exist"
Sep 08 14:35:13.313528 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:13.313484    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"]
Sep 08 14:35:13.315321 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:13.315299    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-75b8cd-openshift-default-6d58d88876-8k8q9"]
Sep 08 14:35:15.185180 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:15.185149    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" path="/var/lib/kubelet/pods/ada11f62-4f21-4cd1-9d4d-79311cf25553/volumes"
Sep 08 14:35:18.355890 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:18.355858    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s"]
Sep 08 14:35:18.359086 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:18.359061    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2a2de3-mcb8s"]
Sep 08 14:35:19.186297 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:19.186264    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3cb8d6b-6026-4d38-8a22-e8321961384f" path="/var/lib/kubelet/pods/a3cb8d6b-6026-4d38-8a22-e8321961384f/volumes"
Sep 08 14:35:25.013891 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.013855    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"]
Sep 08 14:35:25.014376 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.014053    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" containerName="istio-proxy" containerID="cri-o://097e5182cb5c84e7204919f9876e925e859dc96e1f546be483473a61d128b2e2" gracePeriod=30
Sep 08 14:35:25.876608 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.876576    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"]
Sep 08 14:35:25.876942 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.876924    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy"
Sep 08 14:35:25.876942 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.876941    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy"
Sep 08 14:35:25.877127 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.876956    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy"
Sep 08 14:35:25.877127 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.876964    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy"
Sep 08 14:35:25.877127 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.876981    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3cb8d6b-6026-4d38-8a22-e8321961384f" containerName="revoke-keys"
Sep 08 14:35:25.877127 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.876987    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3cb8d6b-6026-4d38-8a22-e8321961384f" containerName="revoke-keys"
Sep 08 14:35:25.877127 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.877039    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy"
Sep 08 14:35:25.877127 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.877049    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3cb8d6b-6026-4d38-8a22-e8321961384f" containerName="revoke-keys"
Sep 08 14:35:25.877127 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.877055    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ada11f62-4f21-4cd1-9d4d-79311cf25553" containerName="istio-proxy"
Sep 08 14:35:25.881629 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.881606    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:25.884037 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.884018    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-780944-openshift-default-dockercfg-8vm6f\""
Sep 08 14:35:25.891113 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:25.891092    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"]
Sep 08 14:35:26.013788 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.013756    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istiod-ca-cert\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.013982 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.013798    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-workload-certs\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.013982 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.013824    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-envoy\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.013982 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.013883    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpk5l\" (UniqueName: \"kubernetes.io/projected/eb42c5ac-6835-42c9-92eb-0d815baa67a5-kube-api-access-kpk5l\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.013982 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.013928    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-data\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.013982 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.013954    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-podinfo\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.014540 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.013983    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-workload-socket\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.014540 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.014026    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-credential-socket\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.014540 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.014069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-token\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.114605 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.114569    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-credential-socket\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.114766 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.114616    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-token\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.114814 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.114756    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istiod-ca-cert\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.114856 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.114824    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-workload-certs\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.114904 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.114858    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-envoy\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.114904 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.114891    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpk5l\" (UniqueName: \"kubernetes.io/projected/eb42c5ac-6835-42c9-92eb-0d815baa67a5-kube-api-access-kpk5l\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.115002 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.114928    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-data\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.115002 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.114963    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-podinfo\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.115002 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.114997    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-workload-socket\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.115148 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.114998    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-credential-socket\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.115226 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.115203    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-workload-certs\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.115384 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.115360    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-data\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.115463 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.115399    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-workload-socket\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.115519 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.115459    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istiod-ca-cert\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.117318 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.117287    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-envoy\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.117318 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.117291    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-podinfo\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.122476 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.122445    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpk5l\" (UniqueName: \"kubernetes.io/projected/eb42c5ac-6835-42c9-92eb-0d815baa67a5-kube-api-access-kpk5l\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.122622 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.122594    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-token\") pod \"e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") " pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.194095 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.194014    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:26.364077 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.364038    2564 patch_prober.go:28] interesting pod/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:35:26.364231 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.364103    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:35:26.472983 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.472949    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"]
Sep 08 14:35:26.474253 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:35:26.474229    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb42c5ac_6835_42c9_92eb_0d815baa67a5.slice/crio-be48848b70de93013c5f4e5a6334433f5b3d4f6c8afbb5cf19733c337df9743d WatchSource:0}: Error finding container be48848b70de93013c5f4e5a6334433f5b3d4f6c8afbb5cf19733c337df9743d: Status 404 returned error can't find the container with id be48848b70de93013c5f4e5a6334433f5b3d4f6c8afbb5cf19733c337df9743d
Sep 08 14:35:26.476555 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.476520    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:35:26.476623 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.476605    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:35:26.476666 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:26.476647    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:35:27.364454 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:27.364423    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" event={"ID":"eb42c5ac-6835-42c9-92eb-0d815baa67a5","Type":"ContainerStarted","Data":"e12693f38b290e3c73ff9513f0214cc282011ef2cf2c85b9c2074c5b8e6aed31"}
Sep 08 14:35:27.364850 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:27.364475    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" event={"ID":"eb42c5ac-6835-42c9-92eb-0d815baa67a5","Type":"ContainerStarted","Data":"be48848b70de93013c5f4e5a6334433f5b3d4f6c8afbb5cf19733c337df9743d"}
Sep 08 14:35:27.388620 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:27.388574    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" podStartSLOduration=2.388559207 podStartE2EDuration="2.388559207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:27.386126744 +0000 UTC m=+1128.782076207" watchObservedRunningTime="2026-09-08 14:35:27.388559207 +0000 UTC m=+1128.784508694"
Sep 08 14:35:28.194660 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:28.194628    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:28.200344 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:28.200316    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:28.369787 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:28.369749    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:28.375823 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:28.375796    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:30.254119 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.254095    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:35:30.348847 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.348819    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7865121e-40c0-4632-ad14-53b1b87af64d-istiod-ca-cert\") pod \"7865121e-40c0-4632-ad14-53b1b87af64d\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") "
Sep 08 14:35:30.348994 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.348864    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-workload-socket\") pod \"7865121e-40c0-4632-ad14-53b1b87af64d\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") "
Sep 08 14:35:30.348994 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.348898    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-istio-data\") pod \"7865121e-40c0-4632-ad14-53b1b87af64d\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") "
Sep 08 14:35:30.348994 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.348917    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-workload-certs\") pod \"7865121e-40c0-4632-ad14-53b1b87af64d\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") "
Sep 08 14:35:30.348994 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.348932    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7865121e-40c0-4632-ad14-53b1b87af64d-istio-podinfo\") pod \"7865121e-40c0-4632-ad14-53b1b87af64d\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") "
Sep 08 14:35:30.348994 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.348957    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-istio-envoy\") pod \"7865121e-40c0-4632-ad14-53b1b87af64d\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") "
Sep 08 14:35:30.348994 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.348981    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-credential-socket\") pod \"7865121e-40c0-4632-ad14-53b1b87af64d\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") "
Sep 08 14:35:30.349296 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.349033    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcrzn\" (UniqueName: \"kubernetes.io/projected/7865121e-40c0-4632-ad14-53b1b87af64d-kube-api-access-gcrzn\") pod \"7865121e-40c0-4632-ad14-53b1b87af64d\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") "
Sep 08 14:35:30.349296 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.349060    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7865121e-40c0-4632-ad14-53b1b87af64d-istio-token\") pod \"7865121e-40c0-4632-ad14-53b1b87af64d\" (UID: \"7865121e-40c0-4632-ad14-53b1b87af64d\") "
Sep 08 14:35:30.349296 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.349235    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-istio-data" (OuterVolumeSpecName: "istio-data") pod "7865121e-40c0-4632-ad14-53b1b87af64d" (UID: "7865121e-40c0-4632-ad14-53b1b87af64d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:35:30.349296 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.349247    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7865121e-40c0-4632-ad14-53b1b87af64d" (UID: "7865121e-40c0-4632-ad14-53b1b87af64d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:35:30.349466 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.349261    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7865121e-40c0-4632-ad14-53b1b87af64d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7865121e-40c0-4632-ad14-53b1b87af64d" (UID: "7865121e-40c0-4632-ad14-53b1b87af64d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:35:30.349466 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.349341    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7865121e-40c0-4632-ad14-53b1b87af64d" (UID: "7865121e-40c0-4632-ad14-53b1b87af64d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:35:30.349595 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.349573    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7865121e-40c0-4632-ad14-53b1b87af64d" (UID: "7865121e-40c0-4632-ad14-53b1b87af64d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:35:30.351372 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.351341    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7865121e-40c0-4632-ad14-53b1b87af64d" (UID: "7865121e-40c0-4632-ad14-53b1b87af64d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:35:30.351475 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.351377    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7865121e-40c0-4632-ad14-53b1b87af64d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7865121e-40c0-4632-ad14-53b1b87af64d" (UID: "7865121e-40c0-4632-ad14-53b1b87af64d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:35:30.351475 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.351424    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7865121e-40c0-4632-ad14-53b1b87af64d-istio-token" (OuterVolumeSpecName: "istio-token") pod "7865121e-40c0-4632-ad14-53b1b87af64d" (UID: "7865121e-40c0-4632-ad14-53b1b87af64d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:35:30.351475 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.351424    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7865121e-40c0-4632-ad14-53b1b87af64d-kube-api-access-gcrzn" (OuterVolumeSpecName: "kube-api-access-gcrzn") pod "7865121e-40c0-4632-ad14-53b1b87af64d" (UID: "7865121e-40c0-4632-ad14-53b1b87af64d"). InnerVolumeSpecName "kube-api-access-gcrzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:35:30.380452 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.380429    2564 generic.go:356] "Generic (PLEG): container finished" podID="7865121e-40c0-4632-ad14-53b1b87af64d" containerID="097e5182cb5c84e7204919f9876e925e859dc96e1f546be483473a61d128b2e2" exitCode=0
Sep 08 14:35:30.380563 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.380480    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"
Sep 08 14:35:30.380563 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.380522    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" event={"ID":"7865121e-40c0-4632-ad14-53b1b87af64d","Type":"ContainerDied","Data":"097e5182cb5c84e7204919f9876e925e859dc96e1f546be483473a61d128b2e2"}
Sep 08 14:35:30.380665 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.380573    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b" event={"ID":"7865121e-40c0-4632-ad14-53b1b87af64d","Type":"ContainerDied","Data":"2ab7ea7ec9be7cf0d117c9f4fa76a2d1c5ec54683ecbe9e64addd6a2282a9aec"}
Sep 08 14:35:30.380665 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.380597    2564 scope.go:117] "RemoveContainer" containerID="097e5182cb5c84e7204919f9876e925e859dc96e1f546be483473a61d128b2e2"
Sep 08 14:35:30.389071 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.389055    2564 scope.go:117] "RemoveContainer" containerID="ab02f0d6d1e53f3c843125cac3cde7039c48c6bb74f9cd332e7bc5c85695c38f"
Sep 08 14:35:30.396991 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.396972    2564 scope.go:117] "RemoveContainer" containerID="097e5182cb5c84e7204919f9876e925e859dc96e1f546be483473a61d128b2e2"
Sep 08 14:35:30.397299 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:35:30.397279    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"097e5182cb5c84e7204919f9876e925e859dc96e1f546be483473a61d128b2e2\": container with ID starting with 097e5182cb5c84e7204919f9876e925e859dc96e1f546be483473a61d128b2e2 not found: ID does not exist" containerID="097e5182cb5c84e7204919f9876e925e859dc96e1f546be483473a61d128b2e2"
Sep 08 14:35:30.397365 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.397305    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"097e5182cb5c84e7204919f9876e925e859dc96e1f546be483473a61d128b2e2"} err="failed to get container status \"097e5182cb5c84e7204919f9876e925e859dc96e1f546be483473a61d128b2e2\": rpc error: code = NotFound desc = could not find container \"097e5182cb5c84e7204919f9876e925e859dc96e1f546be483473a61d128b2e2\": container with ID starting with 097e5182cb5c84e7204919f9876e925e859dc96e1f546be483473a61d128b2e2 not found: ID does not exist"
Sep 08 14:35:30.397365 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.397323    2564 scope.go:117] "RemoveContainer" containerID="ab02f0d6d1e53f3c843125cac3cde7039c48c6bb74f9cd332e7bc5c85695c38f"
Sep 08 14:35:30.397603 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:35:30.397587    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab02f0d6d1e53f3c843125cac3cde7039c48c6bb74f9cd332e7bc5c85695c38f\": container with ID starting with ab02f0d6d1e53f3c843125cac3cde7039c48c6bb74f9cd332e7bc5c85695c38f not found: ID does not exist" containerID="ab02f0d6d1e53f3c843125cac3cde7039c48c6bb74f9cd332e7bc5c85695c38f"
Sep 08 14:35:30.397704 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.397609    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab02f0d6d1e53f3c843125cac3cde7039c48c6bb74f9cd332e7bc5c85695c38f"} err="failed to get container status \"ab02f0d6d1e53f3c843125cac3cde7039c48c6bb74f9cd332e7bc5c85695c38f\": rpc error: code = NotFound desc = could not find container \"ab02f0d6d1e53f3c843125cac3cde7039c48c6bb74f9cd332e7bc5c85695c38f\": container with ID starting with ab02f0d6d1e53f3c843125cac3cde7039c48c6bb74f9cd332e7bc5c85695c38f not found: ID does not exist"
Sep 08 14:35:30.404655 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.404628    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"]
Sep 08 14:35:30.405894 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.405870    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-2a2de3-openshift-default-74b8bb4598-n725b"]
Sep 08 14:35:30.449804 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.449767    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-workload-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:30.449804 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.449793    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-istio-data\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:30.449952 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.449808    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-workload-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:30.449952 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.449821    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7865121e-40c0-4632-ad14-53b1b87af64d-istio-podinfo\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:30.449952 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.449833    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-istio-envoy\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:30.449952 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.449845    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7865121e-40c0-4632-ad14-53b1b87af64d-credential-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:30.449952 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.449858    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcrzn\" (UniqueName: \"kubernetes.io/projected/7865121e-40c0-4632-ad14-53b1b87af64d-kube-api-access-gcrzn\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:30.449952 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.449871    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7865121e-40c0-4632-ad14-53b1b87af64d-istio-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:30.449952 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:30.449883    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7865121e-40c0-4632-ad14-53b1b87af64d-istiod-ca-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:35:31.185873 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.185844    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" path="/var/lib/kubelet/pods/7865121e-40c0-4632-ad14-53b1b87af64d/volumes"
Sep 08 14:35:31.303950 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.303916    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"]
Sep 08 14:35:31.304306 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.304247    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" containerName="istio-proxy"
Sep 08 14:35:31.304306 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.304259    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" containerName="istio-proxy"
Sep 08 14:35:31.304306 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.304277    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" containerName="istio-proxy"
Sep 08 14:35:31.304306 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.304282    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" containerName="istio-proxy"
Sep 08 14:35:31.304469 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.304336    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" containerName="istio-proxy"
Sep 08 14:35:31.304469 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.304346    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7865121e-40c0-4632-ad14-53b1b87af64d" containerName="istio-proxy"
Sep 08 14:35:31.308669 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.308650    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"
Sep 08 14:35:31.310860 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.310840    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-780944\""
Sep 08 14:35:31.318412 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.318388    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"]
Sep 08 14:35:31.340867 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.340844    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"]
Sep 08 14:35:31.344164 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.344145    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"
Sep 08 14:35:31.346328 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.346305    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-780944-dockercfg-zmnm8\""
Sep 08 14:35:31.357414 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.357393    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"]
Sep 08 14:35:31.457920 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.457839    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwk45\" (UniqueName: \"kubernetes.io/projected/0157a639-00f2-4c2f-af08-0c4310b19a63-kube-api-access-cwk45\") pod \"payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g\" (UID: \"0157a639-00f2-4c2f-af08-0c4310b19a63\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"
Sep 08 14:35:31.457920 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.457902    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwm42\" (UniqueName: \"kubernetes.io/projected/a6bcda92-b6ee-4dc8-8724-f50fd2c170c0-kube-api-access-fwm42\") pod \"payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f\" (UID: \"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"
Sep 08 14:35:31.458131 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.457942    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0157a639-00f2-4c2f-af08-0c4310b19a63-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g\" (UID: \"0157a639-00f2-4c2f-af08-0c4310b19a63\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"
Sep 08 14:35:31.458131 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.458014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6bcda92-b6ee-4dc8-8724-f50fd2c170c0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f\" (UID: \"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"
Sep 08 14:35:31.558691 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.558661    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwk45\" (UniqueName: \"kubernetes.io/projected/0157a639-00f2-4c2f-af08-0c4310b19a63-kube-api-access-cwk45\") pod \"payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g\" (UID: \"0157a639-00f2-4c2f-af08-0c4310b19a63\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"
Sep 08 14:35:31.558871 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.558721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwm42\" (UniqueName: \"kubernetes.io/projected/a6bcda92-b6ee-4dc8-8724-f50fd2c170c0-kube-api-access-fwm42\") pod \"payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f\" (UID: \"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"
Sep 08 14:35:31.558871 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.558750    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0157a639-00f2-4c2f-af08-0c4310b19a63-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g\" (UID: \"0157a639-00f2-4c2f-af08-0c4310b19a63\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"
Sep 08 14:35:31.558871 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.558784    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6bcda92-b6ee-4dc8-8724-f50fd2c170c0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f\" (UID: \"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"
Sep 08 14:35:31.559435 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.559415    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0157a639-00f2-4c2f-af08-0c4310b19a63-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g\" (UID: \"0157a639-00f2-4c2f-af08-0c4310b19a63\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"
Sep 08 14:35:31.559518 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.559475    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6bcda92-b6ee-4dc8-8724-f50fd2c170c0-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f\" (UID: \"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"
Sep 08 14:35:31.573156 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.573134    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwk45\" (UniqueName: \"kubernetes.io/projected/0157a639-00f2-4c2f-af08-0c4310b19a63-kube-api-access-cwk45\") pod \"payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g\" (UID: \"0157a639-00f2-4c2f-af08-0c4310b19a63\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"
Sep 08 14:35:31.573295 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.573280    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwm42\" (UniqueName: \"kubernetes.io/projected/a6bcda92-b6ee-4dc8-8724-f50fd2c170c0-kube-api-access-fwm42\") pod \"payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f\" (UID: \"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"
Sep 08 14:35:31.619554 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.619523    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"
Sep 08 14:35:31.652999 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.652974    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"
Sep 08 14:35:31.893210 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.893187    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"]
Sep 08 14:35:31.896079 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:35:31.896048    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0157a639_00f2_4c2f_af08_0c4310b19a63.slice/crio-78e9985dcde3726f38b8dd6d210d000822684ee9964572fede0a8a6433d52d52 WatchSource:0}: Error finding container 78e9985dcde3726f38b8dd6d210d000822684ee9964572fede0a8a6433d52d52: Status 404 returned error can't find the container with id 78e9985dcde3726f38b8dd6d210d000822684ee9964572fede0a8a6433d52d52
Sep 08 14:35:31.937547 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:31.937519    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"]
Sep 08 14:35:31.940637 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:35:31.940611    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6bcda92_b6ee_4dc8_8724_f50fd2c170c0.slice/crio-fe72ca626fc1f5edc7e4b7224aaa2f4c5b61d99ed57e4cecbb11a3bab25b270b WatchSource:0}: Error finding container fe72ca626fc1f5edc7e4b7224aaa2f4c5b61d99ed57e4cecbb11a3bab25b270b: Status 404 returned error can't find the container with id fe72ca626fc1f5edc7e4b7224aaa2f4c5b61d99ed57e4cecbb11a3bab25b270b
Sep 08 14:35:32.397302 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:32.397266    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f" event={"ID":"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0","Type":"ContainerStarted","Data":"272d0b74598ec71968d6c72a9f9c6d3e747f34272fe5c4f2775aed87cc8c60ab"}
Sep 08 14:35:32.397882 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:32.397854    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f" event={"ID":"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0","Type":"ContainerStarted","Data":"fe72ca626fc1f5edc7e4b7224aaa2f4c5b61d99ed57e4cecbb11a3bab25b270b"}
Sep 08 14:35:32.398150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:32.397907    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"
Sep 08 14:35:32.399293 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:32.399263    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g" event={"ID":"0157a639-00f2-4c2f-af08-0c4310b19a63","Type":"ContainerStarted","Data":"983b9fb57e02eed87fb13beaaf814dbcc1268d00b692743953edf05adaa3895a"}
Sep 08 14:35:32.399420 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:32.399318    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g" event={"ID":"0157a639-00f2-4c2f-af08-0c4310b19a63","Type":"ContainerStarted","Data":"78e9985dcde3726f38b8dd6d210d000822684ee9964572fede0a8a6433d52d52"}
Sep 08 14:35:32.399420 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:32.399361    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"
Sep 08 14:35:32.416098 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:32.416056    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f" podStartSLOduration=1.4160414989999999 podStartE2EDuration="1.416041499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:32.415212996 +0000 UTC m=+1133.811162427" watchObservedRunningTime="2026-09-08 14:35:32.416041499 +0000 UTC m=+1133.811990922"
Sep 08 14:35:32.431709 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:32.431663    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g" podStartSLOduration=1.431650211 podStartE2EDuration="1.431650211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:32.429543614 +0000 UTC m=+1133.825493041" watchObservedRunningTime="2026-09-08 14:35:32.431650211 +0000 UTC m=+1133.827599642"
Sep 08 14:35:34.192043 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:34.192012    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"]
Sep 08 14:35:34.195534 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:34.195487    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"
Sep 08 14:35:34.197907 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:34.197879    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-23a1d4\""
Sep 08 14:35:34.198138 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:34.198119    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-23a1d4-dockercfg-xwvg9\""
Sep 08 14:35:34.204900 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:34.204874    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"]
Sep 08 14:35:34.286301 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:34.286263    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trmc6\" (UniqueName: \"kubernetes.io/projected/d059a633-ef23-4f70-bbe8-6189cbf0dee5-kube-api-access-trmc6\") pod \"payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg\" (UID: \"d059a633-ef23-4f70-bbe8-6189cbf0dee5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"
Sep 08 14:35:34.286463 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:34.286328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d059a633-ef23-4f70-bbe8-6189cbf0dee5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg\" (UID: \"d059a633-ef23-4f70-bbe8-6189cbf0dee5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"
Sep 08 14:35:34.386804 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:34.386776    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d059a633-ef23-4f70-bbe8-6189cbf0dee5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg\" (UID: \"d059a633-ef23-4f70-bbe8-6189cbf0dee5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"
Sep 08 14:35:34.386956 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:34.386863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trmc6\" (UniqueName: \"kubernetes.io/projected/d059a633-ef23-4f70-bbe8-6189cbf0dee5-kube-api-access-trmc6\") pod \"payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg\" (UID: \"d059a633-ef23-4f70-bbe8-6189cbf0dee5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"
Sep 08 14:35:34.387471 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:34.387452    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d059a633-ef23-4f70-bbe8-6189cbf0dee5-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg\" (UID: \"d059a633-ef23-4f70-bbe8-6189cbf0dee5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"
Sep 08 14:35:34.395587 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:34.395557    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trmc6\" (UniqueName: \"kubernetes.io/projected/d059a633-ef23-4f70-bbe8-6189cbf0dee5-kube-api-access-trmc6\") pod \"payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg\" (UID: \"d059a633-ef23-4f70-bbe8-6189cbf0dee5\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"
Sep 08 14:35:34.509268 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:34.509177    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"
Sep 08 14:35:34.781599 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:34.781545    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"]
Sep 08 14:35:34.784079 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:35:34.784053    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd059a633_ef23_4f70_bbe8_6189cbf0dee5.slice/crio-64106ae9973e90f50e08d77d49bf359683ec1c2ceb3ff77a8eaa7e6c85cc388b WatchSource:0}: Error finding container 64106ae9973e90f50e08d77d49bf359683ec1c2ceb3ff77a8eaa7e6c85cc388b: Status 404 returned error can't find the container with id 64106ae9973e90f50e08d77d49bf359683ec1c2ceb3ff77a8eaa7e6c85cc388b
Sep 08 14:35:35.422281 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:35.422243    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg" event={"ID":"d059a633-ef23-4f70-bbe8-6189cbf0dee5","Type":"ContainerStarted","Data":"0223311da1e3545954340481b53313daf71611d984f0272e4b4049425ce171f2"}
Sep 08 14:35:35.422789 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:35.422310    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg" event={"ID":"d059a633-ef23-4f70-bbe8-6189cbf0dee5","Type":"ContainerStarted","Data":"64106ae9973e90f50e08d77d49bf359683ec1c2ceb3ff77a8eaa7e6c85cc388b"}
Sep 08 14:35:35.423124 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:35.423099    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"
Sep 08 14:35:35.440264 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:35.440222    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg" podStartSLOduration=1.440207279 podStartE2EDuration="1.440207279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:35.439467231 +0000 UTC m=+1136.835416661" watchObservedRunningTime="2026-09-08 14:35:35.440207279 +0000 UTC m=+1136.836156692"
Sep 08 14:35:43.371207 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:43.371176    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 14:35:43.371625 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:43.371228    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 14:35:43.408213 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:43.408185    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"
Sep 08 14:35:43.465418 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:43.465388    2564 generic.go:356] "Generic (PLEG): container finished" podID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerID="e12693f38b290e3c73ff9513f0214cc282011ef2cf2c85b9c2074c5b8e6aed31" exitCode=0
Sep 08 14:35:43.465578 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:43.465454    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" event={"ID":"eb42c5ac-6835-42c9-92eb-0d815baa67a5","Type":"ContainerDied","Data":"e12693f38b290e3c73ff9513f0214cc282011ef2cf2c85b9c2074c5b8e6aed31"}
Sep 08 14:35:43.465833 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:43.465820    2564 scope.go:117] "RemoveContainer" containerID="e12693f38b290e3c73ff9513f0214cc282011ef2cf2c85b9c2074c5b8e6aed31"
Sep 08 14:35:43.466839 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:43.466808    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:35:43.466905 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:43.466878    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:35:43.466954 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:43.466940    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:35:44.415729 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:44.415688    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"
Sep 08 14:35:44.473292 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:44.473252    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" event={"ID":"eb42c5ac-6835-42c9-92eb-0d815baa67a5","Type":"ContainerStarted","Data":"a27ebccf86ce3a2b4e5427b1c9a1d5ca2ab795c4d04403affa7e1863fff0d329"}
Sep 08 14:35:45.194586 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:45.194487    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:45.194886 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:45.194861    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 14:35:45.195063 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:45.195036    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 14:35:46.194991 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:46.194951    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 14:35:46.195617 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:46.195576    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 14:35:47.194554 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:47.194488    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 14:35:47.194758 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:47.194577    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 14:35:47.436184 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:47.436152    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"
Sep 08 14:35:48.195095 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:48.195056    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 14:35:48.195311 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:48.195125    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 14:35:49.397866 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:49.397833    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:49.398417 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:49.398397    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:49.399213 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:49.399191    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:35:57.265346 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.265307    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"]
Sep 08 14:35:57.269277 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.269255    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.271708 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.271689    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-34656b-openshift-default-dockercfg-7nk55\""
Sep 08 14:35:57.279919 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.279889    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"]
Sep 08 14:35:57.304200 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.304174    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istiod-ca-cert\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.304326 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.304224    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-data\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.304326 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.304261    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf957\" (UniqueName: \"kubernetes.io/projected/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-kube-api-access-tf957\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.304326 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.304298    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-token\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.304521 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.304338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-workload-socket\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.304521 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.304388    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-podinfo\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.304521 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.304422    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-credential-socket\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.304521 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.304447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-workload-certs\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.304731 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.304545    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-envoy\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.405544 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.405479    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-credential-socket\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.405544 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.405544    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-workload-certs\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.405816 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.405573    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-envoy\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.405816 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.405694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istiod-ca-cert\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.405816 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.405736    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-data\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.405966 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.405873    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf957\" (UniqueName: \"kubernetes.io/projected/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-kube-api-access-tf957\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.405966 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.405914    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-credential-socket\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.405966 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.405925    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-workload-certs\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.405966 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.405934    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-token\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.406175 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.405979    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-workload-socket\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.406175 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.406015    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-data\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.406175 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.406039    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-podinfo\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.406377 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.406244    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-workload-socket\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.406487 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.406465    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istiod-ca-cert\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.407853 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.407835    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-envoy\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.408322 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.408306    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-podinfo\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.415806 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.415784    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-token\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.416101 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.416084    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf957\" (UniqueName: \"kubernetes.io/projected/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-kube-api-access-tf957\") pod \"e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") " pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.581211 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.581182    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:57.858929 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.858897    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"]
Sep 08 14:35:57.860912 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:35:57.860885    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfecc843e_e7f8_48c7_a2cd_f2b9d7344e4a.slice/crio-d302afe71892d4e1b8fa8b3d928c761b4585c0a6146e40b8fa9cc72dbb80c9c1 WatchSource:0}: Error finding container d302afe71892d4e1b8fa8b3d928c761b4585c0a6146e40b8fa9cc72dbb80c9c1: Status 404 returned error can't find the container with id d302afe71892d4e1b8fa8b3d928c761b4585c0a6146e40b8fa9cc72dbb80c9c1
Sep 08 14:35:57.863074 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.863037    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:35:57.863190 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.863117    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:35:57.863190 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:57.863160    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:35:58.547069 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:58.547035    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" event={"ID":"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a","Type":"ContainerStarted","Data":"b9135c35827d48407383510119d34be2e46034536ce497648cde7d72495b977c"}
Sep 08 14:35:58.547482 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:58.547088    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" event={"ID":"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a","Type":"ContainerStarted","Data":"d302afe71892d4e1b8fa8b3d928c761b4585c0a6146e40b8fa9cc72dbb80c9c1"}
Sep 08 14:35:58.570889 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:58.570833    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" podStartSLOduration=1.570816657 podStartE2EDuration="1.570816657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:35:58.569019086 +0000 UTC m=+1159.964968516" watchObservedRunningTime="2026-09-08 14:35:58.570816657 +0000 UTC m=+1159.966766087"
Sep 08 14:35:58.581750 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:58.581726    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:58.586921 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:58.586898    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:59.551952 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.551923    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:59.552836 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.552816    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:35:59.609704 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.609640    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"]
Sep 08 14:35:59.613267 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.613243    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"
Sep 08 14:35:59.615774 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.615749    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-017dbd-dockercfg-njktf\""
Sep 08 14:35:59.615932 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.615787    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-017dbd\""
Sep 08 14:35:59.623766 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.623727    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"]
Sep 08 14:35:59.728047 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.728013    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gfqb\" (UniqueName: \"kubernetes.io/projected/01aff066-92e2-4578-8242-2c1b53da0f26-kube-api-access-5gfqb\") pod \"payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx\" (UID: \"01aff066-92e2-4578-8242-2c1b53da0f26\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"
Sep 08 14:35:59.728211 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.728065    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01aff066-92e2-4578-8242-2c1b53da0f26-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx\" (UID: \"01aff066-92e2-4578-8242-2c1b53da0f26\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"
Sep 08 14:35:59.828851 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.828825    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gfqb\" (UniqueName: \"kubernetes.io/projected/01aff066-92e2-4578-8242-2c1b53da0f26-kube-api-access-5gfqb\") pod \"payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx\" (UID: \"01aff066-92e2-4578-8242-2c1b53da0f26\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"
Sep 08 14:35:59.828993 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.828868    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01aff066-92e2-4578-8242-2c1b53da0f26-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx\" (UID: \"01aff066-92e2-4578-8242-2c1b53da0f26\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"
Sep 08 14:35:59.829686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.829659    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01aff066-92e2-4578-8242-2c1b53da0f26-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx\" (UID: \"01aff066-92e2-4578-8242-2c1b53da0f26\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"
Sep 08 14:35:59.837811 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.837787    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gfqb\" (UniqueName: \"kubernetes.io/projected/01aff066-92e2-4578-8242-2c1b53da0f26-kube-api-access-5gfqb\") pod \"payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx\" (UID: \"01aff066-92e2-4578-8242-2c1b53da0f26\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"
Sep 08 14:35:59.925936 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:35:59.925908    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"
Sep 08 14:36:00.199106 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:00.199079    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"]
Sep 08 14:36:00.200884 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:36:00.200851    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01aff066_92e2_4578_8242_2c1b53da0f26.slice/crio-8f98674b3e2f6ec668619f2dad003d799ecf4807970df176bce570249be9a7d8 WatchSource:0}: Error finding container 8f98674b3e2f6ec668619f2dad003d799ecf4807970df176bce570249be9a7d8: Status 404 returned error can't find the container with id 8f98674b3e2f6ec668619f2dad003d799ecf4807970df176bce570249be9a7d8
Sep 08 14:36:00.558788 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:00.558695    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx" event={"ID":"01aff066-92e2-4578-8242-2c1b53da0f26","Type":"ContainerStarted","Data":"9763a0f7b6b067a96b7ec46d9dda99492b73003d6b2068c0575bb0cdef610b27"}
Sep 08 14:36:00.558788 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:00.558756    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx" event={"ID":"01aff066-92e2-4578-8242-2c1b53da0f26","Type":"ContainerStarted","Data":"8f98674b3e2f6ec668619f2dad003d799ecf4807970df176bce570249be9a7d8"}
Sep 08 14:36:00.559170 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:00.558939    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"
Sep 08 14:36:00.578791 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:00.578734    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx" podStartSLOduration=1.5787148869999998 podStartE2EDuration="1.578714887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:35:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:36:00.576859672 +0000 UTC m=+1161.972809102" watchObservedRunningTime="2026-09-08 14:36:00.578714887 +0000 UTC m=+1161.974664319"
Sep 08 14:36:02.509798 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:02.509723    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"]
Sep 08 14:36:02.513349 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:02.513330    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"
Sep 08 14:36:02.515828 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:02.515802    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-34656b\""
Sep 08 14:36:02.515964 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:02.515808    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-34656b-dockercfg-hdkgv\""
Sep 08 14:36:02.523731 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:02.523709    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"]
Sep 08 14:36:02.558947 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:02.558919    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6d5x\" (UniqueName: \"kubernetes.io/projected/bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2-kube-api-access-k6d5x\") pod \"payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m\" (UID: \"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"
Sep 08 14:36:02.559080 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:02.558957    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m\" (UID: \"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"
Sep 08 14:36:02.659937 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:02.659894    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6d5x\" (UniqueName: \"kubernetes.io/projected/bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2-kube-api-access-k6d5x\") pod \"payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m\" (UID: \"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"
Sep 08 14:36:02.660101 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:02.659950    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m\" (UID: \"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"
Sep 08 14:36:02.660771 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:02.660752    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m\" (UID: \"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"
Sep 08 14:36:02.668493 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:02.668469    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6d5x\" (UniqueName: \"kubernetes.io/projected/bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2-kube-api-access-k6d5x\") pod \"payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m\" (UID: \"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"
Sep 08 14:36:02.823975 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:02.823879    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"
Sep 08 14:36:03.091660 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:03.091630    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"]
Sep 08 14:36:03.095295 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:36:03.095267    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf48a0b3_9c6e_4b58_a27e_27c6026fb5b2.slice/crio-b4ff4682e685f0a1d7fbfbaecaef4bcc016360448d277c1c59f961edadd57d11 WatchSource:0}: Error finding container b4ff4682e685f0a1d7fbfbaecaef4bcc016360448d277c1c59f961edadd57d11: Status 404 returned error can't find the container with id b4ff4682e685f0a1d7fbfbaecaef4bcc016360448d277c1c59f961edadd57d11
Sep 08 14:36:03.574824 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:03.574738    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m" event={"ID":"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2","Type":"ContainerStarted","Data":"c36ad68ad8e42e54bbcd29536ee3f03a24e5108f7f198442421d4bd971b82d46"}
Sep 08 14:36:03.574824 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:03.574792    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m" event={"ID":"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2","Type":"ContainerStarted","Data":"b4ff4682e685f0a1d7fbfbaecaef4bcc016360448d277c1c59f961edadd57d11"}
Sep 08 14:36:03.575188 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:03.574844    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"
Sep 08 14:36:03.591193 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:03.591145    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m" podStartSLOduration=1.5911303509999999 podStartE2EDuration="1.591130351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:36:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:36:03.58973935 +0000 UTC m=+1164.985688776" watchObservedRunningTime="2026-09-08 14:36:03.591130351 +0000 UTC m=+1164.987079782"
Sep 08 14:36:11.565161 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:11.565130    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"
Sep 08 14:36:14.582518 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:14.582462    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"
Sep 08 14:36:15.450685 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:15.450292    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": read tcp 10.134.0.2:55336->10.134.0.56:15021: read: connection reset by peer" start-of-body=
Sep 08 14:36:15.450685 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:15.450352    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": read tcp 10.134.0.2:55336->10.134.0.56:15021: read: connection reset by peer"
Sep 08 14:36:15.652799 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:15.652729    2564 generic.go:356] "Generic (PLEG): container finished" podID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerID="b9135c35827d48407383510119d34be2e46034536ce497648cde7d72495b977c" exitCode=0
Sep 08 14:36:15.653154 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:15.652803    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" event={"ID":"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a","Type":"ContainerDied","Data":"b9135c35827d48407383510119d34be2e46034536ce497648cde7d72495b977c"}
Sep 08 14:36:15.653249 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:15.653196    2564 scope.go:117] "RemoveContainer" containerID="b9135c35827d48407383510119d34be2e46034536ce497648cde7d72495b977c"
Sep 08 14:36:15.654242 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:15.654215    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:36:15.654306 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:15.654282    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:36:15.654345 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:15.654328    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:36:16.659521 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:16.659468    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" event={"ID":"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a","Type":"ContainerStarted","Data":"fd4cb673f940cdfac6cda60c8298b049202ee0bce24092753fc6b7d3b2d5a77b"}
Sep 08 14:36:17.581907 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:17.581868    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:36:17.582103 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:17.582082    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 14:36:17.582180 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:17.582135    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 14:36:18.581651 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:18.581615    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 14:36:18.582065 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:18.581691    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 14:36:19.582254 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:19.582218    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 14:36:19.582668 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:19.582276    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 14:36:20.581804 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:20.581766    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 14:36:20.581980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:20.581827    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 14:36:21.592059 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:21.592024    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:36:21.592569 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:21.592441    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:36:21.593162 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:21.593140    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:36:39.745398 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.745359    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"]
Sep 08 14:36:39.748442 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.748424    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"
Sep 08 14:36:39.750773 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.750751    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-afb814fe-dockercfg-gzlfb\""
Sep 08 14:36:39.750899 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.750750    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-afb814fe\""
Sep 08 14:36:39.758047 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.758019    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"]
Sep 08 14:36:39.777150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.777126    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"]
Sep 08 14:36:39.780529 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.780491    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"
Sep 08 14:36:39.790341 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.790317    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"]
Sep 08 14:36:39.806290 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.806252    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/657219c6-578b-45ea-88c2-ff6b6488d936-plugins-config-volume\") pod \"payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k\" (UID: \"657219c6-578b-45ea-88c2-ff6b6488d936\") " pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"
Sep 08 14:36:39.806290 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.806309    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnwvv\" (UniqueName: \"kubernetes.io/projected/cdfcdf98-07ab-4288-a28c-c1088611d9d3-kube-api-access-mnwvv\") pod \"payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq\" (UID: \"cdfcdf98-07ab-4288-a28c-c1088611d9d3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"
Sep 08 14:36:39.806465 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.806329    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9pw5\" (UniqueName: \"kubernetes.io/projected/657219c6-578b-45ea-88c2-ff6b6488d936-kube-api-access-j9pw5\") pod \"payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k\" (UID: \"657219c6-578b-45ea-88c2-ff6b6488d936\") " pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"
Sep 08 14:36:39.806465 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.806404    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdfcdf98-07ab-4288-a28c-c1088611d9d3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq\" (UID: \"cdfcdf98-07ab-4288-a28c-c1088611d9d3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"
Sep 08 14:36:39.907959 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.907859    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdfcdf98-07ab-4288-a28c-c1088611d9d3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq\" (UID: \"cdfcdf98-07ab-4288-a28c-c1088611d9d3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"
Sep 08 14:36:39.908148 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.908019    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/657219c6-578b-45ea-88c2-ff6b6488d936-plugins-config-volume\") pod \"payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k\" (UID: \"657219c6-578b-45ea-88c2-ff6b6488d936\") " pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"
Sep 08 14:36:39.908148 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.908071    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnwvv\" (UniqueName: \"kubernetes.io/projected/cdfcdf98-07ab-4288-a28c-c1088611d9d3-kube-api-access-mnwvv\") pod \"payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq\" (UID: \"cdfcdf98-07ab-4288-a28c-c1088611d9d3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"
Sep 08 14:36:39.908148 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.908101    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pw5\" (UniqueName: \"kubernetes.io/projected/657219c6-578b-45ea-88c2-ff6b6488d936-kube-api-access-j9pw5\") pod \"payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k\" (UID: \"657219c6-578b-45ea-88c2-ff6b6488d936\") " pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"
Sep 08 14:36:39.908901 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.908870    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdfcdf98-07ab-4288-a28c-c1088611d9d3-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq\" (UID: \"cdfcdf98-07ab-4288-a28c-c1088611d9d3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"
Sep 08 14:36:39.909010 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.908927    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/657219c6-578b-45ea-88c2-ff6b6488d936-plugins-config-volume\") pod \"payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k\" (UID: \"657219c6-578b-45ea-88c2-ff6b6488d936\") " pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"
Sep 08 14:36:39.918772 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.918750    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9pw5\" (UniqueName: \"kubernetes.io/projected/657219c6-578b-45ea-88c2-ff6b6488d936-kube-api-access-j9pw5\") pod \"payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k\" (UID: \"657219c6-578b-45ea-88c2-ff6b6488d936\") " pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"
Sep 08 14:36:39.918860 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:39.918752    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnwvv\" (UniqueName: \"kubernetes.io/projected/cdfcdf98-07ab-4288-a28c-c1088611d9d3-kube-api-access-mnwvv\") pod \"payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq\" (UID: \"cdfcdf98-07ab-4288-a28c-c1088611d9d3\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"
Sep 08 14:36:40.059347 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:40.059269    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"
Sep 08 14:36:40.092418 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:40.092389    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"
Sep 08 14:36:40.333821 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:40.333791    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"]
Sep 08 14:36:40.336715 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:36:40.336691    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdfcdf98_07ab_4288_a28c_c1088611d9d3.slice/crio-1e96bed9a70fa57125cd2b653dae39970df6fe5545708cb697185df73a29c978 WatchSource:0}: Error finding container 1e96bed9a70fa57125cd2b653dae39970df6fe5545708cb697185df73a29c978: Status 404 returned error can't find the container with id 1e96bed9a70fa57125cd2b653dae39970df6fe5545708cb697185df73a29c978
Sep 08 14:36:40.373447 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:40.373424    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"]
Sep 08 14:36:40.374914 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:36:40.374888    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod657219c6_578b_45ea_88c2_ff6b6488d936.slice/crio-e24a0220e36e19d393ca8652bb66c85ab4e14272c5eeb7a5e6573d81ae1acda1 WatchSource:0}: Error finding container e24a0220e36e19d393ca8652bb66c85ab4e14272c5eeb7a5e6573d81ae1acda1: Status 404 returned error can't find the container with id e24a0220e36e19d393ca8652bb66c85ab4e14272c5eeb7a5e6573d81ae1acda1
Sep 08 14:36:40.802971 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:40.802889    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq" event={"ID":"cdfcdf98-07ab-4288-a28c-c1088611d9d3","Type":"ContainerStarted","Data":"de4626638b5c70ab41e1e0ac6be9b71b9677629c56cc5e8716c738360d23cffd"}
Sep 08 14:36:40.803559 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:40.803533    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"
Sep 08 14:36:40.803694 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:40.803571    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq" event={"ID":"cdfcdf98-07ab-4288-a28c-c1088611d9d3","Type":"ContainerStarted","Data":"1e96bed9a70fa57125cd2b653dae39970df6fe5545708cb697185df73a29c978"}
Sep 08 14:36:40.804796 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:40.804772    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k" event={"ID":"657219c6-578b-45ea-88c2-ff6b6488d936","Type":"ContainerStarted","Data":"a550c7e4f8470845e3d2b476279b2c09010289959077844d81986d4539a8791d"}
Sep 08 14:36:40.804898 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:40.804817    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"
Sep 08 14:36:40.804898 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:40.804834    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k" event={"ID":"657219c6-578b-45ea-88c2-ff6b6488d936","Type":"ContainerStarted","Data":"e24a0220e36e19d393ca8652bb66c85ab4e14272c5eeb7a5e6573d81ae1acda1"}
Sep 08 14:36:40.835589 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:40.835544    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq" podStartSLOduration=1.835526648 podStartE2EDuration="1.835526648s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:36:40.818881794 +0000 UTC m=+1202.214831227" watchObservedRunningTime="2026-09-08 14:36:40.835526648 +0000 UTC m=+1202.231476079"
Sep 08 14:36:40.836300 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:40.836276    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k" podStartSLOduration=1.836269189 podStartE2EDuration="1.836269189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:36:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:36:40.833755986 +0000 UTC m=+1202.229705419" watchObservedRunningTime="2026-09-08 14:36:40.836269189 +0000 UTC m=+1202.232218611"
Sep 08 14:36:51.813745 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:51.813714    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"
Sep 08 14:36:51.814325 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:36:51.813786    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"
Sep 08 14:37:12.651145 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.651109    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"]
Sep 08 14:37:12.654510 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.654484    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.657916 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.657897    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-afb814fe\"/\"default-dockercfg-k6znw\""
Sep 08 14:37:12.658021 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.657914    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-afb814fe\"/\"e2e-lifecycle-model-afb814fe-kserve-self-signed-certs\""
Sep 08 14:37:12.658021 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.657900    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-afb814fe\"/\"openshift-service-ca.crt\""
Sep 08 14:37:12.658124 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.658031    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-afb814fe\"/\"kube-root-ca.crt\""
Sep 08 14:37:12.672930 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.672903    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"]
Sep 08 14:37:12.720075 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.720043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-tmp-dir\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.720243 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.720094    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-dshm\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.720243 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.720128    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-model-cache\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.720243 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.720191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f36f624f-aedc-4394-b08b-653ca22467ed-tls-certs\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.720243 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.720241    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-home\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.720424 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.720269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxsrt\" (UniqueName: \"kubernetes.io/projected/f36f624f-aedc-4394-b08b-653ca22467ed-kube-api-access-fxsrt\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.821551 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.821515    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-model-cache\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.821732 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.821583    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f36f624f-aedc-4394-b08b-653ca22467ed-tls-certs\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.821732 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.821619    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-home\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.821732 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.821636    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxsrt\" (UniqueName: \"kubernetes.io/projected/f36f624f-aedc-4394-b08b-653ca22467ed-kube-api-access-fxsrt\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.821732 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.821668    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-tmp-dir\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.821732 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.821692    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-dshm\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.822064 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.821844    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-model-cache\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.822064 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.821939    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-home\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.822159 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.822073    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-tmp-dir\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.823833 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.823809    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-dshm\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.824143 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.824123    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f36f624f-aedc-4394-b08b-653ca22467ed-tls-certs\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.829857 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.829836    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxsrt\" (UniqueName: \"kubernetes.io/projected/f36f624f-aedc-4394-b08b-653ca22467ed-kube-api-access-fxsrt\") pod \"e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") " pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:12.965189 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:12.965097    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:13.243878 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:13.243857    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"]
Sep 08 14:37:13.245897 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:37:13.245869    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf36f624f_aedc_4394_b08b_653ca22467ed.slice/crio-cb5ad82dbeb9a776c51188189c629fc2c116b3851e1d8dfbcd7303cde720e3c1 WatchSource:0}: Error finding container cb5ad82dbeb9a776c51188189c629fc2c116b3851e1d8dfbcd7303cde720e3c1: Status 404 returned error can't find the container with id cb5ad82dbeb9a776c51188189c629fc2c116b3851e1d8dfbcd7303cde720e3c1
Sep 08 14:37:13.988414 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:13.988372    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb" event={"ID":"f36f624f-aedc-4394-b08b-653ca22467ed","Type":"ContainerStarted","Data":"fc3b2ab1bcc100c4884d4504f462d66f85c4fa4ac376e14cb8e126ea9dfec9a6"}
Sep 08 14:37:13.988414 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:13.988419    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb" event={"ID":"f36f624f-aedc-4394-b08b-653ca22467ed","Type":"ContainerStarted","Data":"cb5ad82dbeb9a776c51188189c629fc2c116b3851e1d8dfbcd7303cde720e3c1"}
Sep 08 14:37:14.005366 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:14.005305    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb" podStartSLOduration=2.005284687 podStartE2EDuration="2.005284687s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:37:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:37:14.004560446 +0000 UTC m=+1235.400509878" watchObservedRunningTime="2026-09-08 14:37:14.005284687 +0000 UTC m=+1235.401234121"
Sep 08 14:37:22.965957 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:22.965913    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:22.966566 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:22.965979    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:22.978868 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:22.978845    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:23.050255 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:23.050223    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:37:37.557620 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:37.557527    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l"]
Sep 08 14:37:37.561318 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:37.561296    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l"
Sep 08 14:37:37.563866 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:37.563847    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:37:37.563965 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:37.563849    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:37:37.568150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:37.568127    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l"]
Sep 08 14:37:37.627631 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:37.627588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3575a9b-c913-432a-9e12-ec50eaaf5312-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l\" (UID: \"b3575a9b-c913-432a-9e12-ec50eaaf5312\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l"
Sep 08 14:37:37.728165 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:37.728127    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3575a9b-c913-432a-9e12-ec50eaaf5312-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l\" (UID: \"b3575a9b-c913-432a-9e12-ec50eaaf5312\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l"
Sep 08 14:37:37.728840 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:37.728817    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3575a9b-c913-432a-9e12-ec50eaaf5312-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l\" (UID: \"b3575a9b-c913-432a-9e12-ec50eaaf5312\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l"
Sep 08 14:37:37.874802 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:37.874770    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l"
Sep 08 14:37:38.145096 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:38.145065    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l"]
Sep 08 14:37:38.146928 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:37:38.146904    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3575a9b_c913_432a_9e12_ec50eaaf5312.slice/crio-82ab071da13bdbfe4206fbcdea4ec77a32a711a8b6ca55725fb40bf1ffe62a32 WatchSource:0}: Error finding container 82ab071da13bdbfe4206fbcdea4ec77a32a711a8b6ca55725fb40bf1ffe62a32: Status 404 returned error can't find the container with id 82ab071da13bdbfe4206fbcdea4ec77a32a711a8b6ca55725fb40bf1ffe62a32
Sep 08 14:37:39.115777 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:39.115738    2564 scope.go:117] "RemoveContainer" containerID="e644ca315d29f78377241e0b39271d601770f41afb58fb0ecc1ecdec3f5518fb"
Sep 08 14:37:39.125730 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:39.125699    2564 generic.go:356] "Generic (PLEG): container finished" podID="b3575a9b-c913-432a-9e12-ec50eaaf5312" containerID="41af2fe146f9e0c154ac601722d5af839f50c0e11d61ed367c4811f00ae1c9ea" exitCode=0
Sep 08 14:37:39.125875 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:39.125781    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l" event={"ID":"b3575a9b-c913-432a-9e12-ec50eaaf5312","Type":"ContainerDied","Data":"41af2fe146f9e0c154ac601722d5af839f50c0e11d61ed367c4811f00ae1c9ea"}
Sep 08 14:37:39.125875 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:39.125830    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l" event={"ID":"b3575a9b-c913-432a-9e12-ec50eaaf5312","Type":"ContainerStarted","Data":"82ab071da13bdbfe4206fbcdea4ec77a32a711a8b6ca55725fb40bf1ffe62a32"}
Sep 08 14:37:39.143606 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:39.141410    2564 scope.go:117] "RemoveContainer" containerID="ea746a0e831d40385479e0e4a87f36db3ed698608d71e6bbfa901021c68d09b2"
Sep 08 14:37:40.270339 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:40.270313    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l"
Sep 08 14:37:40.353277 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:40.353247    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3575a9b-c913-432a-9e12-ec50eaaf5312-maas-api-service-ca\") pod \"b3575a9b-c913-432a-9e12-ec50eaaf5312\" (UID: \"b3575a9b-c913-432a-9e12-ec50eaaf5312\") "
Sep 08 14:37:40.353665 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:40.353643    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3575a9b-c913-432a-9e12-ec50eaaf5312-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b3575a9b-c913-432a-9e12-ec50eaaf5312" (UID: "b3575a9b-c913-432a-9e12-ec50eaaf5312"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:37:40.455172 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:40.455084    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3575a9b-c913-432a-9e12-ec50eaaf5312-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:37:41.137953 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:41.137925    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l"
Sep 08 14:37:41.138125 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:41.137963    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l" event={"ID":"b3575a9b-c913-432a-9e12-ec50eaaf5312","Type":"ContainerDied","Data":"82ab071da13bdbfe4206fbcdea4ec77a32a711a8b6ca55725fb40bf1ffe62a32"}
Sep 08 14:37:41.138125 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:41.138006    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82ab071da13bdbfe4206fbcdea4ec77a32a711a8b6ca55725fb40bf1ffe62a32"
Sep 08 14:37:53.253617 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.253582    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"]
Sep 08 14:37:53.254064 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.253797    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k" podUID="657219c6-578b-45ea-88c2-ff6b6488d936" containerName="payload-processing" containerID="cri-o://a550c7e4f8470845e3d2b476279b2c09010289959077844d81986d4539a8791d" gracePeriod=30
Sep 08 14:37:53.261728 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.261527    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"]
Sep 08 14:37:53.261800 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.261744    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq" podUID="cdfcdf98-07ab-4288-a28c-c1088611d9d3" containerName="payload-pre-processing" containerID="cri-o://de4626638b5c70ab41e1e0ac6be9b71b9677629c56cc5e8716c738360d23cffd" gracePeriod=30
Sep 08 14:37:53.437777 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.437278    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l"]
Sep 08 14:37:53.440295 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.440270    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-afb814fe-h5p5l"]
Sep 08 14:37:53.546417 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.546392    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"
Sep 08 14:37:53.549353 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.549331    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"
Sep 08 14:37:53.682932 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.682894    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9pw5\" (UniqueName: \"kubernetes.io/projected/657219c6-578b-45ea-88c2-ff6b6488d936-kube-api-access-j9pw5\") pod \"657219c6-578b-45ea-88c2-ff6b6488d936\" (UID: \"657219c6-578b-45ea-88c2-ff6b6488d936\") "
Sep 08 14:37:53.682932 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.682933    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdfcdf98-07ab-4288-a28c-c1088611d9d3-plugins-config-volume\") pod \"cdfcdf98-07ab-4288-a28c-c1088611d9d3\" (UID: \"cdfcdf98-07ab-4288-a28c-c1088611d9d3\") "
Sep 08 14:37:53.683157 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.682953    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnwvv\" (UniqueName: \"kubernetes.io/projected/cdfcdf98-07ab-4288-a28c-c1088611d9d3-kube-api-access-mnwvv\") pod \"cdfcdf98-07ab-4288-a28c-c1088611d9d3\" (UID: \"cdfcdf98-07ab-4288-a28c-c1088611d9d3\") "
Sep 08 14:37:53.683157 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.682999    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/657219c6-578b-45ea-88c2-ff6b6488d936-plugins-config-volume\") pod \"657219c6-578b-45ea-88c2-ff6b6488d936\" (UID: \"657219c6-578b-45ea-88c2-ff6b6488d936\") "
Sep 08 14:37:53.683454 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.683426    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/657219c6-578b-45ea-88c2-ff6b6488d936-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "657219c6-578b-45ea-88c2-ff6b6488d936" (UID: "657219c6-578b-45ea-88c2-ff6b6488d936"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:37:53.683585 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.683457    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdfcdf98-07ab-4288-a28c-c1088611d9d3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cdfcdf98-07ab-4288-a28c-c1088611d9d3" (UID: "cdfcdf98-07ab-4288-a28c-c1088611d9d3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:37:53.685140 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.685113    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/657219c6-578b-45ea-88c2-ff6b6488d936-kube-api-access-j9pw5" (OuterVolumeSpecName: "kube-api-access-j9pw5") pod "657219c6-578b-45ea-88c2-ff6b6488d936" (UID: "657219c6-578b-45ea-88c2-ff6b6488d936"). InnerVolumeSpecName "kube-api-access-j9pw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:37:53.685191 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.685137    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdfcdf98-07ab-4288-a28c-c1088611d9d3-kube-api-access-mnwvv" (OuterVolumeSpecName: "kube-api-access-mnwvv") pod "cdfcdf98-07ab-4288-a28c-c1088611d9d3" (UID: "cdfcdf98-07ab-4288-a28c-c1088611d9d3"). InnerVolumeSpecName "kube-api-access-mnwvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:37:53.783939 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.783836    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9pw5\" (UniqueName: \"kubernetes.io/projected/657219c6-578b-45ea-88c2-ff6b6488d936-kube-api-access-j9pw5\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:37:53.783939 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.783871    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdfcdf98-07ab-4288-a28c-c1088611d9d3-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:37:53.783939 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.783880    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnwvv\" (UniqueName: \"kubernetes.io/projected/cdfcdf98-07ab-4288-a28c-c1088611d9d3-kube-api-access-mnwvv\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:37:53.783939 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:53.783889    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/657219c6-578b-45ea-88c2-ff6b6488d936-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:37:54.209971 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.209940    2564 generic.go:356] "Generic (PLEG): container finished" podID="cdfcdf98-07ab-4288-a28c-c1088611d9d3" containerID="de4626638b5c70ab41e1e0ac6be9b71b9677629c56cc5e8716c738360d23cffd" exitCode=0
Sep 08 14:37:54.210273 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.209999    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"
Sep 08 14:37:54.210273 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.210021    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq" event={"ID":"cdfcdf98-07ab-4288-a28c-c1088611d9d3","Type":"ContainerDied","Data":"de4626638b5c70ab41e1e0ac6be9b71b9677629c56cc5e8716c738360d23cffd"}
Sep 08 14:37:54.210273 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.210082    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq" event={"ID":"cdfcdf98-07ab-4288-a28c-c1088611d9d3","Type":"ContainerDied","Data":"1e96bed9a70fa57125cd2b653dae39970df6fe5545708cb697185df73a29c978"}
Sep 08 14:37:54.210273 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.210105    2564 scope.go:117] "RemoveContainer" containerID="de4626638b5c70ab41e1e0ac6be9b71b9677629c56cc5e8716c738360d23cffd"
Sep 08 14:37:54.211431 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.211405    2564 generic.go:356] "Generic (PLEG): container finished" podID="657219c6-578b-45ea-88c2-ff6b6488d936" containerID="a550c7e4f8470845e3d2b476279b2c09010289959077844d81986d4539a8791d" exitCode=0
Sep 08 14:37:54.211578 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.211434    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k" event={"ID":"657219c6-578b-45ea-88c2-ff6b6488d936","Type":"ContainerDied","Data":"a550c7e4f8470845e3d2b476279b2c09010289959077844d81986d4539a8791d"}
Sep 08 14:37:54.211578 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.211470    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"
Sep 08 14:37:54.211578 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.211483    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k" event={"ID":"657219c6-578b-45ea-88c2-ff6b6488d936","Type":"ContainerDied","Data":"e24a0220e36e19d393ca8652bb66c85ab4e14272c5eeb7a5e6573d81ae1acda1"}
Sep 08 14:37:54.219469 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.219273    2564 scope.go:117] "RemoveContainer" containerID="de4626638b5c70ab41e1e0ac6be9b71b9677629c56cc5e8716c738360d23cffd"
Sep 08 14:37:54.219688 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:37:54.219665    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de4626638b5c70ab41e1e0ac6be9b71b9677629c56cc5e8716c738360d23cffd\": container with ID starting with de4626638b5c70ab41e1e0ac6be9b71b9677629c56cc5e8716c738360d23cffd not found: ID does not exist" containerID="de4626638b5c70ab41e1e0ac6be9b71b9677629c56cc5e8716c738360d23cffd"
Sep 08 14:37:54.219731 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.219696    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de4626638b5c70ab41e1e0ac6be9b71b9677629c56cc5e8716c738360d23cffd"} err="failed to get container status \"de4626638b5c70ab41e1e0ac6be9b71b9677629c56cc5e8716c738360d23cffd\": rpc error: code = NotFound desc = could not find container \"de4626638b5c70ab41e1e0ac6be9b71b9677629c56cc5e8716c738360d23cffd\": container with ID starting with de4626638b5c70ab41e1e0ac6be9b71b9677629c56cc5e8716c738360d23cffd not found: ID does not exist"
Sep 08 14:37:54.219731 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.219713    2564 scope.go:117] "RemoveContainer" containerID="a550c7e4f8470845e3d2b476279b2c09010289959077844d81986d4539a8791d"
Sep 08 14:37:54.228284 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.228265    2564 scope.go:117] "RemoveContainer" containerID="a550c7e4f8470845e3d2b476279b2c09010289959077844d81986d4539a8791d"
Sep 08 14:37:54.228624 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:37:54.228601    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a550c7e4f8470845e3d2b476279b2c09010289959077844d81986d4539a8791d\": container with ID starting with a550c7e4f8470845e3d2b476279b2c09010289959077844d81986d4539a8791d not found: ID does not exist" containerID="a550c7e4f8470845e3d2b476279b2c09010289959077844d81986d4539a8791d"
Sep 08 14:37:54.228725 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.228630    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a550c7e4f8470845e3d2b476279b2c09010289959077844d81986d4539a8791d"} err="failed to get container status \"a550c7e4f8470845e3d2b476279b2c09010289959077844d81986d4539a8791d\": rpc error: code = NotFound desc = could not find container \"a550c7e4f8470845e3d2b476279b2c09010289959077844d81986d4539a8791d\": container with ID starting with a550c7e4f8470845e3d2b476279b2c09010289959077844d81986d4539a8791d not found: ID does not exist"
Sep 08 14:37:54.237856 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.237825    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"]
Sep 08 14:37:54.243647 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.243623    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-afb814fe-577b65dbdb-mz7fq"]
Sep 08 14:37:54.253977 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.253950    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"]
Sep 08 14:37:54.258267 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:54.258243    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-afb814fe-5f8bc568b5-nsq6k"]
Sep 08 14:37:55.187410 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:55.187372    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="657219c6-578b-45ea-88c2-ff6b6488d936" path="/var/lib/kubelet/pods/657219c6-578b-45ea-88c2-ff6b6488d936/volumes"
Sep 08 14:37:55.187762 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:55.187746    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3575a9b-c913-432a-9e12-ec50eaaf5312" path="/var/lib/kubelet/pods/b3575a9b-c913-432a-9e12-ec50eaaf5312/volumes"
Sep 08 14:37:55.188085 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:37:55.188072    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdfcdf98-07ab-4288-a28c-c1088611d9d3" path="/var/lib/kubelet/pods/cdfcdf98-07ab-4288-a28c-c1088611d9d3/volumes"
Sep 08 14:38:02.039323 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:02.039285    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"]
Sep 08 14:38:17.059642 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.059598    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb" podUID="f36f624f-aedc-4394-b08b-653ca22467ed" containerName="main" containerID="cri-o://fc3b2ab1bcc100c4884d4504f462d66f85c4fa4ac376e14cb8e126ea9dfec9a6" gracePeriod=45
Sep 08 14:38:17.307569 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.307538    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:38:17.336581 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.336551    2564 generic.go:356] "Generic (PLEG): container finished" podID="f36f624f-aedc-4394-b08b-653ca22467ed" containerID="fc3b2ab1bcc100c4884d4504f462d66f85c4fa4ac376e14cb8e126ea9dfec9a6" exitCode=0
Sep 08 14:38:17.336757 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.336590    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"
Sep 08 14:38:17.336757 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.336622    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb" event={"ID":"f36f624f-aedc-4394-b08b-653ca22467ed","Type":"ContainerDied","Data":"fc3b2ab1bcc100c4884d4504f462d66f85c4fa4ac376e14cb8e126ea9dfec9a6"}
Sep 08 14:38:17.336757 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.336670    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb" event={"ID":"f36f624f-aedc-4394-b08b-653ca22467ed","Type":"ContainerDied","Data":"cb5ad82dbeb9a776c51188189c629fc2c116b3851e1d8dfbcd7303cde720e3c1"}
Sep 08 14:38:17.336757 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.336693    2564 scope.go:117] "RemoveContainer" containerID="fc3b2ab1bcc100c4884d4504f462d66f85c4fa4ac376e14cb8e126ea9dfec9a6"
Sep 08 14:38:17.347252 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.347230    2564 scope.go:117] "RemoveContainer" containerID="fc3b2ab1bcc100c4884d4504f462d66f85c4fa4ac376e14cb8e126ea9dfec9a6"
Sep 08 14:38:17.347619 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:38:17.347591    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc3b2ab1bcc100c4884d4504f462d66f85c4fa4ac376e14cb8e126ea9dfec9a6\": container with ID starting with fc3b2ab1bcc100c4884d4504f462d66f85c4fa4ac376e14cb8e126ea9dfec9a6 not found: ID does not exist" containerID="fc3b2ab1bcc100c4884d4504f462d66f85c4fa4ac376e14cb8e126ea9dfec9a6"
Sep 08 14:38:17.347706 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.347630    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc3b2ab1bcc100c4884d4504f462d66f85c4fa4ac376e14cb8e126ea9dfec9a6"} err="failed to get container status \"fc3b2ab1bcc100c4884d4504f462d66f85c4fa4ac376e14cb8e126ea9dfec9a6\": rpc error: code = NotFound desc = could not find container \"fc3b2ab1bcc100c4884d4504f462d66f85c4fa4ac376e14cb8e126ea9dfec9a6\": container with ID starting with fc3b2ab1bcc100c4884d4504f462d66f85c4fa4ac376e14cb8e126ea9dfec9a6 not found: ID does not exist"
Sep 08 14:38:17.397482 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.397447    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxsrt\" (UniqueName: \"kubernetes.io/projected/f36f624f-aedc-4394-b08b-653ca22467ed-kube-api-access-fxsrt\") pod \"f36f624f-aedc-4394-b08b-653ca22467ed\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") "
Sep 08 14:38:17.397654 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.397538    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-model-cache\") pod \"f36f624f-aedc-4394-b08b-653ca22467ed\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") "
Sep 08 14:38:17.397654 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.397601    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-dshm\") pod \"f36f624f-aedc-4394-b08b-653ca22467ed\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") "
Sep 08 14:38:17.397654 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.397633    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f36f624f-aedc-4394-b08b-653ca22467ed-tls-certs\") pod \"f36f624f-aedc-4394-b08b-653ca22467ed\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") "
Sep 08 14:38:17.397829 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.397670    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-home\") pod \"f36f624f-aedc-4394-b08b-653ca22467ed\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") "
Sep 08 14:38:17.397829 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.397705    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-tmp-dir\") pod \"f36f624f-aedc-4394-b08b-653ca22467ed\" (UID: \"f36f624f-aedc-4394-b08b-653ca22467ed\") "
Sep 08 14:38:17.397944 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.397846    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-model-cache" (OuterVolumeSpecName: "model-cache") pod "f36f624f-aedc-4394-b08b-653ca22467ed" (UID: "f36f624f-aedc-4394-b08b-653ca22467ed"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:38:17.398026 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.398005    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-model-cache\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:38:17.398146 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.398126    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-home" (OuterVolumeSpecName: "home") pod "f36f624f-aedc-4394-b08b-653ca22467ed" (UID: "f36f624f-aedc-4394-b08b-653ca22467ed"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:38:17.398217 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.398173    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f36f624f-aedc-4394-b08b-653ca22467ed" (UID: "f36f624f-aedc-4394-b08b-653ca22467ed"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:38:17.399822 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.399791    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f36f624f-aedc-4394-b08b-653ca22467ed-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f36f624f-aedc-4394-b08b-653ca22467ed" (UID: "f36f624f-aedc-4394-b08b-653ca22467ed"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:38:17.399822 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.399814    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f36f624f-aedc-4394-b08b-653ca22467ed-kube-api-access-fxsrt" (OuterVolumeSpecName: "kube-api-access-fxsrt") pod "f36f624f-aedc-4394-b08b-653ca22467ed" (UID: "f36f624f-aedc-4394-b08b-653ca22467ed"). InnerVolumeSpecName "kube-api-access-fxsrt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:38:17.400006 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.399938    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-dshm" (OuterVolumeSpecName: "dshm") pod "f36f624f-aedc-4394-b08b-653ca22467ed" (UID: "f36f624f-aedc-4394-b08b-653ca22467ed"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:38:17.499533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.499427    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-dshm\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:38:17.499533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.499453    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f36f624f-aedc-4394-b08b-653ca22467ed-tls-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:38:17.499533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.499464    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-home\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:38:17.499533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.499471    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f36f624f-aedc-4394-b08b-653ca22467ed-tmp-dir\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:38:17.499533 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.499481    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxsrt\" (UniqueName: \"kubernetes.io/projected/f36f624f-aedc-4394-b08b-653ca22467ed-kube-api-access-fxsrt\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:38:17.662455 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.662420    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"]
Sep 08 14:38:17.665294 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:17.665266    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-afb814fe/e2e-lifecycle-model-afb814fe-kserve-f9d9d6ff-fnlhb"]
Sep 08 14:38:19.185627 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:19.185595    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f36f624f-aedc-4394-b08b-653ca22467ed" path="/var/lib/kubelet/pods/f36f624f-aedc-4394-b08b-653ca22467ed/volumes"
Sep 08 14:38:39.176467 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:39.176435    2564 scope.go:117] "RemoveContainer" containerID="9f3ef4816f93171265d3219e610c5a6fe6fd624ff3da7fdf03f83c08714213af"
Sep 08 14:38:39.185607 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:39.185588    2564 scope.go:117] "RemoveContainer" containerID="6fad50a1a32d109e21a9e406fd5920c3b03acbbaa923adfc357502d7e754a2f3"
Sep 08 14:38:39.193316 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:38:39.193293    2564 scope.go:117] "RemoveContainer" containerID="3d82b827d5f2892e88dbc39456622325748dae7ddaa38a557e068c4e73b3db78"
Sep 08 14:39:45.782600 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.782566    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"]
Sep 08 14:39:45.783003 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.782916    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3575a9b-c913-432a-9e12-ec50eaaf5312" containerName="revoke-keys"
Sep 08 14:39:45.783003 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.782928    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3575a9b-c913-432a-9e12-ec50eaaf5312" containerName="revoke-keys"
Sep 08 14:39:45.783003 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.782945    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f36f624f-aedc-4394-b08b-653ca22467ed" containerName="main"
Sep 08 14:39:45.783003 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.782951    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f36f624f-aedc-4394-b08b-653ca22467ed" containerName="main"
Sep 08 14:39:45.783003 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.782968    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdfcdf98-07ab-4288-a28c-c1088611d9d3" containerName="payload-pre-processing"
Sep 08 14:39:45.783003 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.782973    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdfcdf98-07ab-4288-a28c-c1088611d9d3" containerName="payload-pre-processing"
Sep 08 14:39:45.783003 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.782982    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="657219c6-578b-45ea-88c2-ff6b6488d936" containerName="payload-processing"
Sep 08 14:39:45.783003 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.782987    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="657219c6-578b-45ea-88c2-ff6b6488d936" containerName="payload-processing"
Sep 08 14:39:45.783257 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.783038    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdfcdf98-07ab-4288-a28c-c1088611d9d3" containerName="payload-pre-processing"
Sep 08 14:39:45.783257 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.783047    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3575a9b-c913-432a-9e12-ec50eaaf5312" containerName="revoke-keys"
Sep 08 14:39:45.783257 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.783053    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="657219c6-578b-45ea-88c2-ff6b6488d936" containerName="payload-processing"
Sep 08 14:39:45.783257 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.783061    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f36f624f-aedc-4394-b08b-653ca22467ed" containerName="main"
Sep 08 14:39:45.785989 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.785973    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"
Sep 08 14:39:45.788232 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.788206    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-0fd47b-dockercfg-4fj9l\""
Sep 08 14:39:45.788377 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.788277    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-0fd47b\""
Sep 08 14:39:45.796454 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.796429    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"]
Sep 08 14:39:45.810161 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.810126    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/514f93ab-b4c8-44b9-a8bb-3453da336ec6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5\" (UID: \"514f93ab-b4c8-44b9-a8bb-3453da336ec6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"
Sep 08 14:39:45.810273 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.810205    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvc4k\" (UniqueName: \"kubernetes.io/projected/514f93ab-b4c8-44b9-a8bb-3453da336ec6-kube-api-access-qvc4k\") pod \"payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5\" (UID: \"514f93ab-b4c8-44b9-a8bb-3453da336ec6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"
Sep 08 14:39:45.815763 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.815742    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"]
Sep 08 14:39:45.819644 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.819626    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"
Sep 08 14:39:45.829105 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.829084    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"]
Sep 08 14:39:45.911595 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.911552    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mlzs\" (UniqueName: \"kubernetes.io/projected/287688df-3ccf-4f4a-9541-4c8cd53cac66-kube-api-access-4mlzs\") pod \"payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl\" (UID: \"287688df-3ccf-4f4a-9541-4c8cd53cac66\") " pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"
Sep 08 14:39:45.911784 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.911602    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/514f93ab-b4c8-44b9-a8bb-3453da336ec6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5\" (UID: \"514f93ab-b4c8-44b9-a8bb-3453da336ec6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"
Sep 08 14:39:45.911784 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.911661    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/287688df-3ccf-4f4a-9541-4c8cd53cac66-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl\" (UID: \"287688df-3ccf-4f4a-9541-4c8cd53cac66\") " pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"
Sep 08 14:39:45.911784 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.911687    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvc4k\" (UniqueName: \"kubernetes.io/projected/514f93ab-b4c8-44b9-a8bb-3453da336ec6-kube-api-access-qvc4k\") pod \"payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5\" (UID: \"514f93ab-b4c8-44b9-a8bb-3453da336ec6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"
Sep 08 14:39:45.912685 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.912644    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/514f93ab-b4c8-44b9-a8bb-3453da336ec6-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5\" (UID: \"514f93ab-b4c8-44b9-a8bb-3453da336ec6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"
Sep 08 14:39:45.922955 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:45.922917    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvc4k\" (UniqueName: \"kubernetes.io/projected/514f93ab-b4c8-44b9-a8bb-3453da336ec6-kube-api-access-qvc4k\") pod \"payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5\" (UID: \"514f93ab-b4c8-44b9-a8bb-3453da336ec6\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"
Sep 08 14:39:46.012722 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.012694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mlzs\" (UniqueName: \"kubernetes.io/projected/287688df-3ccf-4f4a-9541-4c8cd53cac66-kube-api-access-4mlzs\") pod \"payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl\" (UID: \"287688df-3ccf-4f4a-9541-4c8cd53cac66\") " pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"
Sep 08 14:39:46.012883 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.012749    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/287688df-3ccf-4f4a-9541-4c8cd53cac66-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl\" (UID: \"287688df-3ccf-4f4a-9541-4c8cd53cac66\") " pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"
Sep 08 14:39:46.013540 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.013491    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/287688df-3ccf-4f4a-9541-4c8cd53cac66-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl\" (UID: \"287688df-3ccf-4f4a-9541-4c8cd53cac66\") " pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"
Sep 08 14:39:46.024671 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.024649    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mlzs\" (UniqueName: \"kubernetes.io/projected/287688df-3ccf-4f4a-9541-4c8cd53cac66-kube-api-access-4mlzs\") pod \"payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl\" (UID: \"287688df-3ccf-4f4a-9541-4c8cd53cac66\") " pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"
Sep 08 14:39:46.099300 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.099264    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"
Sep 08 14:39:46.131709 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.131679    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"
Sep 08 14:39:46.373006 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.372976    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"]
Sep 08 14:39:46.375441 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:39:46.375404    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod514f93ab_b4c8_44b9_a8bb_3453da336ec6.slice/crio-ba3ed6c7b45f3146efce3a09f0950d775dbaad2c5d52922c976a316ea8dc9fff WatchSource:0}: Error finding container ba3ed6c7b45f3146efce3a09f0950d775dbaad2c5d52922c976a316ea8dc9fff: Status 404 returned error can't find the container with id ba3ed6c7b45f3146efce3a09f0950d775dbaad2c5d52922c976a316ea8dc9fff
Sep 08 14:39:46.415610 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.415587    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"]
Sep 08 14:39:46.417864 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:39:46.417836    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod287688df_3ccf_4f4a_9541_4c8cd53cac66.slice/crio-48414cc03bd72ba119ef7a28b02abc46e2d46ef14b32e4e44609cc726be8f0d4 WatchSource:0}: Error finding container 48414cc03bd72ba119ef7a28b02abc46e2d46ef14b32e4e44609cc726be8f0d4: Status 404 returned error can't find the container with id 48414cc03bd72ba119ef7a28b02abc46e2d46ef14b32e4e44609cc726be8f0d4
Sep 08 14:39:46.809069 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.808964    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5" event={"ID":"514f93ab-b4c8-44b9-a8bb-3453da336ec6","Type":"ContainerStarted","Data":"c836e4be705f5689dc8c24b8fa33ffb5f62e65faa72e05ace137c28c0460b56f"}
Sep 08 14:39:46.809069 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.809032    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"
Sep 08 14:39:46.809069 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.809055    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5" event={"ID":"514f93ab-b4c8-44b9-a8bb-3453da336ec6","Type":"ContainerStarted","Data":"ba3ed6c7b45f3146efce3a09f0950d775dbaad2c5d52922c976a316ea8dc9fff"}
Sep 08 14:39:46.810728 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.810704    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl" event={"ID":"287688df-3ccf-4f4a-9541-4c8cd53cac66","Type":"ContainerStarted","Data":"fb10ba6ab14e78893dea86a2b410fdf22fa2fe2e9174ddf1154785aaeb85b302"}
Sep 08 14:39:46.810866 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.810749    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl" event={"ID":"287688df-3ccf-4f4a-9541-4c8cd53cac66","Type":"ContainerStarted","Data":"48414cc03bd72ba119ef7a28b02abc46e2d46ef14b32e4e44609cc726be8f0d4"}
Sep 08 14:39:46.810866 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.810836    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"
Sep 08 14:39:46.828571 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.828515    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5" podStartSLOduration=1.828488078 podStartE2EDuration="1.828488078s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:39:46.825768815 +0000 UTC m=+1388.221718249" watchObservedRunningTime="2026-09-08 14:39:46.828488078 +0000 UTC m=+1388.224437511"
Sep 08 14:39:46.842946 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:46.842901    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl" podStartSLOduration=1.842882625 podStartE2EDuration="1.842882625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:39:46.840051892 +0000 UTC m=+1388.236001316" watchObservedRunningTime="2026-09-08 14:39:46.842882625 +0000 UTC m=+1388.238832059"
Sep 08 14:39:57.818010 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:57.817980    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"
Sep 08 14:39:57.818627 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:39:57.818056    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"
Sep 08 14:40:09.840734 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:09.840699    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"]
Sep 08 14:40:09.844609 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:09.844578    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:09.847280 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:09.847250    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-41e512-openshift-default-dockercfg-pp4zv\""
Sep 08 14:40:09.855948 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:09.855921    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"]
Sep 08 14:40:09.933830 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:09.933800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6eff3dbf-8976-4504-82e3-0da418bb7290-istiod-ca-cert\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:09.933978 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:09.933872    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-envoy\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:09.933978 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:09.933905    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-workload-certs\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:09.933978 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:09.933923    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-podinfo\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:09.934085 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:09.933976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z87hn\" (UniqueName: \"kubernetes.io/projected/6eff3dbf-8976-4504-82e3-0da418bb7290-kube-api-access-z87hn\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:09.934085 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:09.934031    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-credential-socket\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:09.934085 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:09.934050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-data\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:09.934085 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:09.934064    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-token\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:09.934212 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:09.934088    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-workload-socket\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.035190 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.035158    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-workload-socket\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.035363 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.035220    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6eff3dbf-8976-4504-82e3-0da418bb7290-istiod-ca-cert\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.035363 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.035266    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-envoy\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.035363 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.035297    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-workload-certs\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.035363 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.035334    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-podinfo\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.035363 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.035356    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z87hn\" (UniqueName: \"kubernetes.io/projected/6eff3dbf-8976-4504-82e3-0da418bb7290-kube-api-access-z87hn\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.035692 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.035383    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-credential-socket\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.035692 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.035398    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-data\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.035692 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.035421    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-token\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.035692 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.035629    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-workload-socket\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.035860 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.035720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-workload-certs\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.035860 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.035820    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-data\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.036030 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.036003    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-credential-socket\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.036132 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.036090    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6eff3dbf-8976-4504-82e3-0da418bb7290-istiod-ca-cert\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.037706 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.037688    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-envoy\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.037918 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.037902    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-podinfo\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.043886 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.043867    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z87hn\" (UniqueName: \"kubernetes.io/projected/6eff3dbf-8976-4504-82e3-0da418bb7290-kube-api-access-z87hn\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.043886 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.043878    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-token\") pod \"e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") " pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.158426 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.158347    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:10.434031 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.433841    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"]
Sep 08 14:40:10.436797 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:40:10.436768    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eff3dbf_8976_4504_82e3_0da418bb7290.slice/crio-ba1e6d9cf0e1e6aafedaf9c98ee4a8c9b64fa63fd865d5bf96c612a4fb92d628 WatchSource:0}: Error finding container ba1e6d9cf0e1e6aafedaf9c98ee4a8c9b64fa63fd865d5bf96c612a4fb92d628: Status 404 returned error can't find the container with id ba1e6d9cf0e1e6aafedaf9c98ee4a8c9b64fa63fd865d5bf96c612a4fb92d628
Sep 08 14:40:10.439132 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.439090    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:40:10.439225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.439182    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:40:10.439269 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.439225    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:40:10.946214 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.946172    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl" event={"ID":"6eff3dbf-8976-4504-82e3-0da418bb7290","Type":"ContainerStarted","Data":"2c319062d50abe424152864844d3b9903108ee0070968d14adaa5bd03300bd49"}
Sep 08 14:40:10.946619 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.946226    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl" event={"ID":"6eff3dbf-8976-4504-82e3-0da418bb7290","Type":"ContainerStarted","Data":"ba1e6d9cf0e1e6aafedaf9c98ee4a8c9b64fa63fd865d5bf96c612a4fb92d628"}
Sep 08 14:40:10.968534 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:10.968463    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl" podStartSLOduration=1.968445673 podStartE2EDuration="1.968445673s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:40:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:40:10.966262475 +0000 UTC m=+1412.362211918" watchObservedRunningTime="2026-09-08 14:40:10.968445673 +0000 UTC m=+1412.364395103"
Sep 08 14:40:11.158847 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:11.158816    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:11.164000 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:11.163975    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:11.952055 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:11.952014    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:11.953129 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:11.953111    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:33.071950 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:33.071919    2564 generic.go:356] "Generic (PLEG): container finished" podID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerID="2c319062d50abe424152864844d3b9903108ee0070968d14adaa5bd03300bd49" exitCode=0
Sep 08 14:40:33.072374 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:33.071970    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl" event={"ID":"6eff3dbf-8976-4504-82e3-0da418bb7290","Type":"ContainerDied","Data":"2c319062d50abe424152864844d3b9903108ee0070968d14adaa5bd03300bd49"}
Sep 08 14:40:33.072374 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:33.072345    2564 scope.go:117] "RemoveContainer" containerID="2c319062d50abe424152864844d3b9903108ee0070968d14adaa5bd03300bd49"
Sep 08 14:40:33.073369 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:33.073340    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:40:33.073448 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:33.073405    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:40:33.073448 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:33.073434    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:40:34.079568 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:34.079530    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl" event={"ID":"6eff3dbf-8976-4504-82e3-0da418bb7290","Type":"ContainerStarted","Data":"794c2d4e601ca9d0e47871a95172dd3671bbbe368761253ac8ed9025c654d338"}
Sep 08 14:40:34.159135 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:34.159106    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:34.159313 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:34.159239    2564 patch_prober.go:28] interesting pod/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 14:40:34.159313 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:34.159297    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl" podUID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 14:40:35.159152 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:35.159113    2564 patch_prober.go:28] interesting pod/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 14:40:35.159582 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:35.159171    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl" podUID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 14:40:36.159392 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:36.159347    2564 patch_prober.go:28] interesting pod/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 14:40:36.159817 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:36.159413    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl" podUID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 14:40:37.158757 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:37.158725    2564 patch_prober.go:28] interesting pod/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 14:40:37.158929 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:37.158778    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl" podUID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 14:40:38.159439 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:38.159392    2564 patch_prober.go:28] interesting pod/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 14:40:38.159837 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:38.159468    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl" podUID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 14:40:39.239199 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:39.239168    2564 scope.go:117] "RemoveContainer" containerID="2f0324df448c6c9f88e935c23c271f93b63f8d96759ad77e550c5cc62bc6be73"
Sep 08 14:40:39.379008 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:39.378976    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:39.379356 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:39.379328    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:39.380223 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:39.380203    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:40:41.152105 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:41.152071    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp"]
Sep 08 14:40:41.155449 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:41.155430    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp"
Sep 08 14:40:41.157644 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:41.157627    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:40:41.157737 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:41.157694    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:40:41.162210 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:41.162187    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp"]
Sep 08 14:40:41.252517 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:41.252464    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e192511-605a-4a01-8114-2c71a9d7e387-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0fd47b-25clp\" (UID: \"3e192511-605a-4a01-8114-2c71a9d7e387\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp"
Sep 08 14:40:41.354248 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:41.354212    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e192511-605a-4a01-8114-2c71a9d7e387-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0fd47b-25clp\" (UID: \"3e192511-605a-4a01-8114-2c71a9d7e387\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp"
Sep 08 14:40:41.354827 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:41.354797    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e192511-605a-4a01-8114-2c71a9d7e387-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0fd47b-25clp\" (UID: \"3e192511-605a-4a01-8114-2c71a9d7e387\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp"
Sep 08 14:40:41.466983 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:41.466905    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp"
Sep 08 14:40:41.739279 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:41.739254    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp"]
Sep 08 14:40:41.741212 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:40:41.741172    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e192511_605a_4a01_8114_2c71a9d7e387.slice/crio-e2e624817e8d638557cf8be5bb0d78be5dd3707e0f8f65b101a5ebe444700a1f WatchSource:0}: Error finding container e2e624817e8d638557cf8be5bb0d78be5dd3707e0f8f65b101a5ebe444700a1f: Status 404 returned error can't find the container with id e2e624817e8d638557cf8be5bb0d78be5dd3707e0f8f65b101a5ebe444700a1f
Sep 08 14:40:42.140411 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:42.140377    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp" event={"ID":"3e192511-605a-4a01-8114-2c71a9d7e387","Type":"ContainerStarted","Data":"baeccde1c7d6ae2001668cba203d06316d91254788fb95c238940ed725ef43c0"}
Sep 08 14:40:42.140614 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:42.140454    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp" event={"ID":"3e192511-605a-4a01-8114-2c71a9d7e387","Type":"ContainerStarted","Data":"e2e624817e8d638557cf8be5bb0d78be5dd3707e0f8f65b101a5ebe444700a1f"}
Sep 08 14:40:42.156889 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:42.156847    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp" podStartSLOduration=1.156831894 podStartE2EDuration="1.156831894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:40:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:40:42.155038792 +0000 UTC m=+1443.550988225" watchObservedRunningTime="2026-09-08 14:40:42.156831894 +0000 UTC m=+1443.552781326"
Sep 08 14:40:43.146649 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:43.146619    2564 generic.go:356] "Generic (PLEG): container finished" podID="3e192511-605a-4a01-8114-2c71a9d7e387" containerID="baeccde1c7d6ae2001668cba203d06316d91254788fb95c238940ed725ef43c0" exitCode=0
Sep 08 14:40:43.146830 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:43.146728    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp" event={"ID":"3e192511-605a-4a01-8114-2c71a9d7e387","Type":"ContainerDied","Data":"baeccde1c7d6ae2001668cba203d06316d91254788fb95c238940ed725ef43c0"}
Sep 08 14:40:44.289753 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:44.289726    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp"
Sep 08 14:40:44.385343 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:44.385305    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e192511-605a-4a01-8114-2c71a9d7e387-maas-api-service-ca\") pod \"3e192511-605a-4a01-8114-2c71a9d7e387\" (UID: \"3e192511-605a-4a01-8114-2c71a9d7e387\") "
Sep 08 14:40:44.385703 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:44.385678    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e192511-605a-4a01-8114-2c71a9d7e387-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3e192511-605a-4a01-8114-2c71a9d7e387" (UID: "3e192511-605a-4a01-8114-2c71a9d7e387"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:40:44.486968 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:44.486876    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e192511-605a-4a01-8114-2c71a9d7e387-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:40:45.158535 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:45.158506    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp"
Sep 08 14:40:45.158720 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:45.158546    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp" event={"ID":"3e192511-605a-4a01-8114-2c71a9d7e387","Type":"ContainerDied","Data":"e2e624817e8d638557cf8be5bb0d78be5dd3707e0f8f65b101a5ebe444700a1f"}
Sep 08 14:40:45.158720 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:45.158603    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2e624817e8d638557cf8be5bb0d78be5dd3707e0f8f65b101a5ebe444700a1f"
Sep 08 14:40:56.719700 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:56.719653    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"]
Sep 08 14:40:56.720203 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:56.719922    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl" podUID="287688df-3ccf-4f4a-9541-4c8cd53cac66" containerName="payload-processing" containerID="cri-o://fb10ba6ab14e78893dea86a2b410fdf22fa2fe2e9174ddf1154785aaeb85b302" gracePeriod=30
Sep 08 14:40:56.725217 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:56.724650    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"]
Sep 08 14:40:56.725334 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:56.725250    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5" podUID="514f93ab-b4c8-44b9-a8bb-3453da336ec6" containerName="payload-pre-processing" containerID="cri-o://c836e4be705f5689dc8c24b8fa33ffb5f62e65faa72e05ace137c28c0460b56f" gracePeriod=30
Sep 08 14:40:56.900574 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:56.900531    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp"]
Sep 08 14:40:56.902816 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:56.902795    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0fd47b-25clp"]
Sep 08 14:40:57.006447 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.006357    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"
Sep 08 14:40:57.009364 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.009346    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"
Sep 08 14:40:57.186633 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.186602    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e192511-605a-4a01-8114-2c71a9d7e387" path="/var/lib/kubelet/pods/3e192511-605a-4a01-8114-2c71a9d7e387/volumes"
Sep 08 14:40:57.204209 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.204184    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/287688df-3ccf-4f4a-9541-4c8cd53cac66-plugins-config-volume\") pod \"287688df-3ccf-4f4a-9541-4c8cd53cac66\" (UID: \"287688df-3ccf-4f4a-9541-4c8cd53cac66\") "
Sep 08 14:40:57.204364 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.204236    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvc4k\" (UniqueName: \"kubernetes.io/projected/514f93ab-b4c8-44b9-a8bb-3453da336ec6-kube-api-access-qvc4k\") pod \"514f93ab-b4c8-44b9-a8bb-3453da336ec6\" (UID: \"514f93ab-b4c8-44b9-a8bb-3453da336ec6\") "
Sep 08 14:40:57.204364 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.204289    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/514f93ab-b4c8-44b9-a8bb-3453da336ec6-plugins-config-volume\") pod \"514f93ab-b4c8-44b9-a8bb-3453da336ec6\" (UID: \"514f93ab-b4c8-44b9-a8bb-3453da336ec6\") "
Sep 08 14:40:57.204364 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.204316    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4mlzs\" (UniqueName: \"kubernetes.io/projected/287688df-3ccf-4f4a-9541-4c8cd53cac66-kube-api-access-4mlzs\") pod \"287688df-3ccf-4f4a-9541-4c8cd53cac66\" (UID: \"287688df-3ccf-4f4a-9541-4c8cd53cac66\") "
Sep 08 14:40:57.204652 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.204623    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/287688df-3ccf-4f4a-9541-4c8cd53cac66-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "287688df-3ccf-4f4a-9541-4c8cd53cac66" (UID: "287688df-3ccf-4f4a-9541-4c8cd53cac66"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:40:57.204652 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.204640    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/514f93ab-b4c8-44b9-a8bb-3453da336ec6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "514f93ab-b4c8-44b9-a8bb-3453da336ec6" (UID: "514f93ab-b4c8-44b9-a8bb-3453da336ec6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:40:57.206344 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.206316    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/514f93ab-b4c8-44b9-a8bb-3453da336ec6-kube-api-access-qvc4k" (OuterVolumeSpecName: "kube-api-access-qvc4k") pod "514f93ab-b4c8-44b9-a8bb-3453da336ec6" (UID: "514f93ab-b4c8-44b9-a8bb-3453da336ec6"). InnerVolumeSpecName "kube-api-access-qvc4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:40:57.206431 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.206412    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/287688df-3ccf-4f4a-9541-4c8cd53cac66-kube-api-access-4mlzs" (OuterVolumeSpecName: "kube-api-access-4mlzs") pod "287688df-3ccf-4f4a-9541-4c8cd53cac66" (UID: "287688df-3ccf-4f4a-9541-4c8cd53cac66"). InnerVolumeSpecName "kube-api-access-4mlzs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:40:57.222103 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.222076    2564 generic.go:356] "Generic (PLEG): container finished" podID="287688df-3ccf-4f4a-9541-4c8cd53cac66" containerID="fb10ba6ab14e78893dea86a2b410fdf22fa2fe2e9174ddf1154785aaeb85b302" exitCode=0
Sep 08 14:40:57.222216 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.222120    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"
Sep 08 14:40:57.222216 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.222154    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl" event={"ID":"287688df-3ccf-4f4a-9541-4c8cd53cac66","Type":"ContainerDied","Data":"fb10ba6ab14e78893dea86a2b410fdf22fa2fe2e9174ddf1154785aaeb85b302"}
Sep 08 14:40:57.222216 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.222204    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl" event={"ID":"287688df-3ccf-4f4a-9541-4c8cd53cac66","Type":"ContainerDied","Data":"48414cc03bd72ba119ef7a28b02abc46e2d46ef14b32e4e44609cc726be8f0d4"}
Sep 08 14:40:57.222348 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.222226    2564 scope.go:117] "RemoveContainer" containerID="fb10ba6ab14e78893dea86a2b410fdf22fa2fe2e9174ddf1154785aaeb85b302"
Sep 08 14:40:57.223545 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.223523    2564 generic.go:356] "Generic (PLEG): container finished" podID="514f93ab-b4c8-44b9-a8bb-3453da336ec6" containerID="c836e4be705f5689dc8c24b8fa33ffb5f62e65faa72e05ace137c28c0460b56f" exitCode=0
Sep 08 14:40:57.223680 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.223571    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"
Sep 08 14:40:57.223680 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.223583    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5" event={"ID":"514f93ab-b4c8-44b9-a8bb-3453da336ec6","Type":"ContainerDied","Data":"c836e4be705f5689dc8c24b8fa33ffb5f62e65faa72e05ace137c28c0460b56f"}
Sep 08 14:40:57.223680 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.223616    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5" event={"ID":"514f93ab-b4c8-44b9-a8bb-3453da336ec6","Type":"ContainerDied","Data":"ba3ed6c7b45f3146efce3a09f0950d775dbaad2c5d52922c976a316ea8dc9fff"}
Sep 08 14:40:57.230935 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.230916    2564 scope.go:117] "RemoveContainer" containerID="fb10ba6ab14e78893dea86a2b410fdf22fa2fe2e9174ddf1154785aaeb85b302"
Sep 08 14:40:57.231219 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:40:57.231191    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb10ba6ab14e78893dea86a2b410fdf22fa2fe2e9174ddf1154785aaeb85b302\": container with ID starting with fb10ba6ab14e78893dea86a2b410fdf22fa2fe2e9174ddf1154785aaeb85b302 not found: ID does not exist" containerID="fb10ba6ab14e78893dea86a2b410fdf22fa2fe2e9174ddf1154785aaeb85b302"
Sep 08 14:40:57.231287 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.231232    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb10ba6ab14e78893dea86a2b410fdf22fa2fe2e9174ddf1154785aaeb85b302"} err="failed to get container status \"fb10ba6ab14e78893dea86a2b410fdf22fa2fe2e9174ddf1154785aaeb85b302\": rpc error: code = NotFound desc = could not find container \"fb10ba6ab14e78893dea86a2b410fdf22fa2fe2e9174ddf1154785aaeb85b302\": container with ID starting with fb10ba6ab14e78893dea86a2b410fdf22fa2fe2e9174ddf1154785aaeb85b302 not found: ID does not exist"
Sep 08 14:40:57.231287 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.231255    2564 scope.go:117] "RemoveContainer" containerID="c836e4be705f5689dc8c24b8fa33ffb5f62e65faa72e05ace137c28c0460b56f"
Sep 08 14:40:57.239662 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.239646    2564 scope.go:117] "RemoveContainer" containerID="c836e4be705f5689dc8c24b8fa33ffb5f62e65faa72e05ace137c28c0460b56f"
Sep 08 14:40:57.239924 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:40:57.239907    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c836e4be705f5689dc8c24b8fa33ffb5f62e65faa72e05ace137c28c0460b56f\": container with ID starting with c836e4be705f5689dc8c24b8fa33ffb5f62e65faa72e05ace137c28c0460b56f not found: ID does not exist" containerID="c836e4be705f5689dc8c24b8fa33ffb5f62e65faa72e05ace137c28c0460b56f"
Sep 08 14:40:57.239968 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.239930    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c836e4be705f5689dc8c24b8fa33ffb5f62e65faa72e05ace137c28c0460b56f"} err="failed to get container status \"c836e4be705f5689dc8c24b8fa33ffb5f62e65faa72e05ace137c28c0460b56f\": rpc error: code = NotFound desc = could not find container \"c836e4be705f5689dc8c24b8fa33ffb5f62e65faa72e05ace137c28c0460b56f\": container with ID starting with c836e4be705f5689dc8c24b8fa33ffb5f62e65faa72e05ace137c28c0460b56f not found: ID does not exist"
Sep 08 14:40:57.248673 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.248650    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"]
Sep 08 14:40:57.254942 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.254923    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-0fd47b-7cf8b5c8f4-fhjv5"]
Sep 08 14:40:57.265798 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.265762    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"]
Sep 08 14:40:57.268160 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.268140    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0fd47b-c54f45b4f-bndnl"]
Sep 08 14:40:57.305612 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.305574    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/287688df-3ccf-4f4a-9541-4c8cd53cac66-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:40:57.305612 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.305612    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvc4k\" (UniqueName: \"kubernetes.io/projected/514f93ab-b4c8-44b9-a8bb-3453da336ec6-kube-api-access-qvc4k\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:40:57.305750 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.305627    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/514f93ab-b4c8-44b9-a8bb-3453da336ec6-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:40:57.305750 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:57.305642    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4mlzs\" (UniqueName: \"kubernetes.io/projected/287688df-3ccf-4f4a-9541-4c8cd53cac66-kube-api-access-4mlzs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:40:59.187116 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:59.187073    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="287688df-3ccf-4f4a-9541-4c8cd53cac66" path="/var/lib/kubelet/pods/287688df-3ccf-4f4a-9541-4c8cd53cac66/volumes"
Sep 08 14:40:59.187664 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:40:59.187643    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="514f93ab-b4c8-44b9-a8bb-3453da336ec6" path="/var/lib/kubelet/pods/514f93ab-b4c8-44b9-a8bb-3453da336ec6/volumes"
Sep 08 14:41:03.819139 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.819097    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv"]
Sep 08 14:41:03.819768 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.819707    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="514f93ab-b4c8-44b9-a8bb-3453da336ec6" containerName="payload-pre-processing"
Sep 08 14:41:03.819768 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.819730    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="514f93ab-b4c8-44b9-a8bb-3453da336ec6" containerName="payload-pre-processing"
Sep 08 14:41:03.819768 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.819743    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e192511-605a-4a01-8114-2c71a9d7e387" containerName="revoke-keys"
Sep 08 14:41:03.819768 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.819752    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e192511-605a-4a01-8114-2c71a9d7e387" containerName="revoke-keys"
Sep 08 14:41:03.819768 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.819770    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="287688df-3ccf-4f4a-9541-4c8cd53cac66" containerName="payload-processing"
Sep 08 14:41:03.820044 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.819779    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="287688df-3ccf-4f4a-9541-4c8cd53cac66" containerName="payload-processing"
Sep 08 14:41:03.820044 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.819890    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="514f93ab-b4c8-44b9-a8bb-3453da336ec6" containerName="payload-pre-processing"
Sep 08 14:41:03.820044 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.819912    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e192511-605a-4a01-8114-2c71a9d7e387" containerName="revoke-keys"
Sep 08 14:41:03.820044 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.819927    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="287688df-3ccf-4f4a-9541-4c8cd53cac66" containerName="payload-processing"
Sep 08 14:41:03.824567 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.824546    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv"
Sep 08 14:41:03.827318 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.827290    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:41:03.827441 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.827331    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:41:03.829167 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.829145    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv"]
Sep 08 14:41:03.861429 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.861395    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27969a83-5655-44cf-976f-48af04b6c398-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-41e512-xp8rv\" (UID: \"27969a83-5655-44cf-976f-48af04b6c398\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv"
Sep 08 14:41:03.962116 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.962069    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27969a83-5655-44cf-976f-48af04b6c398-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-41e512-xp8rv\" (UID: \"27969a83-5655-44cf-976f-48af04b6c398\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv"
Sep 08 14:41:03.962718 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:03.962700    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27969a83-5655-44cf-976f-48af04b6c398-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-41e512-xp8rv\" (UID: \"27969a83-5655-44cf-976f-48af04b6c398\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv"
Sep 08 14:41:04.136408 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.136371    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv"
Sep 08 14:41:04.406364 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.406284    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv"]
Sep 08 14:41:04.409705 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:41:04.409643    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27969a83_5655_44cf_976f_48af04b6c398.slice/crio-a50eb316059d06ac9e242beaf81606ee30158422f8c7167724a2dda649509bb5 WatchSource:0}: Error finding container a50eb316059d06ac9e242beaf81606ee30158422f8c7167724a2dda649509bb5: Status 404 returned error can't find the container with id a50eb316059d06ac9e242beaf81606ee30158422f8c7167724a2dda649509bb5
Sep 08 14:41:04.799361 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.799327    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"]
Sep 08 14:41:04.803024 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.803002    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.806608 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.806582    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-017dbd\"/\"kube-root-ca.crt\""
Sep 08 14:41:04.806733 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.806699    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-017dbd\"/\"default-dockercfg-frkbm\""
Sep 08 14:41:04.807816 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.807799    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-017dbd\"/\"openshift-service-ca.crt\""
Sep 08 14:41:04.807882 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.807836    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-017dbd\"/\"rate-test-model-017dbd-kserve-self-signed-certs\""
Sep 08 14:41:04.818172 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.818146    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"]
Sep 08 14:41:04.871618 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.871585    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-model-cache\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.871973 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.871634    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-dshm\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.871973 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.871661    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-home\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.871973 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.871693    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv8mb\" (UniqueName: \"kubernetes.io/projected/3e96d60f-ff45-4fed-b343-61f3e8983875-kube-api-access-qv8mb\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.871973 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.871717    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96d60f-ff45-4fed-b343-61f3e8983875-tls-certs\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.871973 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.871781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-tmp-dir\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.972808 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.972725    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96d60f-ff45-4fed-b343-61f3e8983875-tls-certs\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.972808 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.972782    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-tmp-dir\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.973006 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.972863    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-model-cache\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.973006 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.972912    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-dshm\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.973006 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.972940    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-home\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.973150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.973089    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv8mb\" (UniqueName: \"kubernetes.io/projected/3e96d60f-ff45-4fed-b343-61f3e8983875-kube-api-access-qv8mb\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.973297 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.973270    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-tmp-dir\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.973297 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.973289    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-model-cache\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.973416 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.973342    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-home\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.975112 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.975091    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-dshm\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.975352 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.975336    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96d60f-ff45-4fed-b343-61f3e8983875-tls-certs\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:04.981425 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:04.981397    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv8mb\" (UniqueName: \"kubernetes.io/projected/3e96d60f-ff45-4fed-b343-61f3e8983875-kube-api-access-qv8mb\") pod \"rate-test-model-017dbd-kserve-794569f787-rnwww\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") " pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:05.114101 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:05.114068    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:05.271227 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:05.271145    2564 generic.go:356] "Generic (PLEG): container finished" podID="27969a83-5655-44cf-976f-48af04b6c398" containerID="b2f1cde98474c71b665b444b840b492661f5ea3fe43bf4c5facc1502fb5a7c2f" exitCode=0
Sep 08 14:41:05.271365 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:05.271224    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv" event={"ID":"27969a83-5655-44cf-976f-48af04b6c398","Type":"ContainerDied","Data":"b2f1cde98474c71b665b444b840b492661f5ea3fe43bf4c5facc1502fb5a7c2f"}
Sep 08 14:41:05.271365 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:05.271280    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv" event={"ID":"27969a83-5655-44cf-976f-48af04b6c398","Type":"ContainerStarted","Data":"a50eb316059d06ac9e242beaf81606ee30158422f8c7167724a2dda649509bb5"}
Sep 08 14:41:05.385523 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:05.385479    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"]
Sep 08 14:41:05.387228 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:41:05.387199    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e96d60f_ff45_4fed_b343_61f3e8983875.slice/crio-b404ec1653d9bc7f04818c7c58ece228d94561dd6ab37a9fd8f87c994f1a2d81 WatchSource:0}: Error finding container b404ec1653d9bc7f04818c7c58ece228d94561dd6ab37a9fd8f87c994f1a2d81: Status 404 returned error can't find the container with id b404ec1653d9bc7f04818c7c58ece228d94561dd6ab37a9fd8f87c994f1a2d81
Sep 08 14:41:06.283963 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:06.283927    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww" event={"ID":"3e96d60f-ff45-4fed-b343-61f3e8983875","Type":"ContainerStarted","Data":"b25c88b4f82dc8733d601706b8c83b40f97b5ca94bec69ab907d0b05f98ebbff"}
Sep 08 14:41:06.284347 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:06.283975    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww" event={"ID":"3e96d60f-ff45-4fed-b343-61f3e8983875","Type":"ContainerStarted","Data":"b404ec1653d9bc7f04818c7c58ece228d94561dd6ab37a9fd8f87c994f1a2d81"}
Sep 08 14:41:06.301194 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:06.301135    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww" podStartSLOduration=2.301115041 podStartE2EDuration="2.301115041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:41:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:41:06.300787372 +0000 UTC m=+1467.696736805" watchObservedRunningTime="2026-09-08 14:41:06.301115041 +0000 UTC m=+1467.697064473"
Sep 08 14:41:06.432632 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:06.432602    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv"
Sep 08 14:41:06.485083 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:06.485049    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27969a83-5655-44cf-976f-48af04b6c398-maas-api-service-ca\") pod \"27969a83-5655-44cf-976f-48af04b6c398\" (UID: \"27969a83-5655-44cf-976f-48af04b6c398\") "
Sep 08 14:41:06.485406 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:06.485382    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27969a83-5655-44cf-976f-48af04b6c398-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "27969a83-5655-44cf-976f-48af04b6c398" (UID: "27969a83-5655-44cf-976f-48af04b6c398"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:41:06.585829 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:06.585795    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27969a83-5655-44cf-976f-48af04b6c398-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:07.290068 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:07.290043    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv"
Sep 08 14:41:07.290449 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:07.290076    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv" event={"ID":"27969a83-5655-44cf-976f-48af04b6c398","Type":"ContainerDied","Data":"a50eb316059d06ac9e242beaf81606ee30158422f8c7167724a2dda649509bb5"}
Sep 08 14:41:07.290449 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:07.290125    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a50eb316059d06ac9e242beaf81606ee30158422f8c7167724a2dda649509bb5"
Sep 08 14:41:15.114396 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:15.114357    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:15.114890 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:15.114425    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:15.127119 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:15.127092    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:15.345493 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:15.345454    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:41:19.548528 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:19.548476    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv"]
Sep 08 14:41:19.550277 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:19.550254    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-41e512-xp8rv"]
Sep 08 14:41:21.186730 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:21.186694    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27969a83-5655-44cf-976f-48af04b6c398" path="/var/lib/kubelet/pods/27969a83-5655-44cf-976f-48af04b6c398/volumes"
Sep 08 14:41:26.353646 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:26.353614    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"]
Sep 08 14:41:26.354037 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:26.353877    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl" podUID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerName="istio-proxy" containerID="cri-o://794c2d4e601ca9d0e47871a95172dd3671bbbe368761253ac8ed9025c654d338" gracePeriod=30
Sep 08 14:41:31.604308 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.604279    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:41:31.723107 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723002    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-token\") pod \"6eff3dbf-8976-4504-82e3-0da418bb7290\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") "
Sep 08 14:41:31.723107 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723050    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6eff3dbf-8976-4504-82e3-0da418bb7290-istiod-ca-cert\") pod \"6eff3dbf-8976-4504-82e3-0da418bb7290\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") "
Sep 08 14:41:31.723107 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723087    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-data\") pod \"6eff3dbf-8976-4504-82e3-0da418bb7290\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") "
Sep 08 14:41:31.723404 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723132    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-podinfo\") pod \"6eff3dbf-8976-4504-82e3-0da418bb7290\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") "
Sep 08 14:41:31.723404 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723162    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-envoy\") pod \"6eff3dbf-8976-4504-82e3-0da418bb7290\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") "
Sep 08 14:41:31.723404 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723190    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-workload-socket\") pod \"6eff3dbf-8976-4504-82e3-0da418bb7290\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") "
Sep 08 14:41:31.723404 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723265    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z87hn\" (UniqueName: \"kubernetes.io/projected/6eff3dbf-8976-4504-82e3-0da418bb7290-kube-api-access-z87hn\") pod \"6eff3dbf-8976-4504-82e3-0da418bb7290\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") "
Sep 08 14:41:31.723404 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723302    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-credential-socket\") pod \"6eff3dbf-8976-4504-82e3-0da418bb7290\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") "
Sep 08 14:41:31.723404 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723330    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-workload-certs\") pod \"6eff3dbf-8976-4504-82e3-0da418bb7290\" (UID: \"6eff3dbf-8976-4504-82e3-0da418bb7290\") "
Sep 08 14:41:31.723761 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723462    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-data" (OuterVolumeSpecName: "istio-data") pod "6eff3dbf-8976-4504-82e3-0da418bb7290" (UID: "6eff3dbf-8976-4504-82e3-0da418bb7290"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:41:31.723761 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723478    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6eff3dbf-8976-4504-82e3-0da418bb7290" (UID: "6eff3dbf-8976-4504-82e3-0da418bb7290"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:41:31.723761 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723715    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-data\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:31.723761 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723737    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-workload-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:31.723953 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723793    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6eff3dbf-8976-4504-82e3-0da418bb7290" (UID: "6eff3dbf-8976-4504-82e3-0da418bb7290"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:41:31.723953 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723854    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6eff3dbf-8976-4504-82e3-0da418bb7290" (UID: "6eff3dbf-8976-4504-82e3-0da418bb7290"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:41:31.723953 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.723900    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6eff3dbf-8976-4504-82e3-0da418bb7290-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6eff3dbf-8976-4504-82e3-0da418bb7290" (UID: "6eff3dbf-8976-4504-82e3-0da418bb7290"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:41:31.725346 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.725319    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-token" (OuterVolumeSpecName: "istio-token") pod "6eff3dbf-8976-4504-82e3-0da418bb7290" (UID: "6eff3dbf-8976-4504-82e3-0da418bb7290"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:41:31.725471 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.725428    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6eff3dbf-8976-4504-82e3-0da418bb7290-kube-api-access-z87hn" (OuterVolumeSpecName: "kube-api-access-z87hn") pod "6eff3dbf-8976-4504-82e3-0da418bb7290" (UID: "6eff3dbf-8976-4504-82e3-0da418bb7290"). InnerVolumeSpecName "kube-api-access-z87hn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:41:31.725760 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.725734    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6eff3dbf-8976-4504-82e3-0da418bb7290" (UID: "6eff3dbf-8976-4504-82e3-0da418bb7290"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:41:31.725760 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.725753    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6eff3dbf-8976-4504-82e3-0da418bb7290" (UID: "6eff3dbf-8976-4504-82e3-0da418bb7290"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:41:31.824223 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.824188    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-podinfo\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:31.824223 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.824219    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-envoy\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:31.824223 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.824229    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z87hn\" (UniqueName: \"kubernetes.io/projected/6eff3dbf-8976-4504-82e3-0da418bb7290-kube-api-access-z87hn\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:31.824451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.824237    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-credential-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:31.824451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.824246    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6eff3dbf-8976-4504-82e3-0da418bb7290-workload-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:31.824451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.824253    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6eff3dbf-8976-4504-82e3-0da418bb7290-istio-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:31.824451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:31.824261    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6eff3dbf-8976-4504-82e3-0da418bb7290-istiod-ca-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:32.422933 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:32.422904    2564 generic.go:356] "Generic (PLEG): container finished" podID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerID="794c2d4e601ca9d0e47871a95172dd3671bbbe368761253ac8ed9025c654d338" exitCode=0
Sep 08 14:41:32.423098 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:32.422952    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"
Sep 08 14:41:32.423098 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:32.422992    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl" event={"ID":"6eff3dbf-8976-4504-82e3-0da418bb7290","Type":"ContainerDied","Data":"794c2d4e601ca9d0e47871a95172dd3671bbbe368761253ac8ed9025c654d338"}
Sep 08 14:41:32.423098 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:32.423051    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl" event={"ID":"6eff3dbf-8976-4504-82e3-0da418bb7290","Type":"ContainerDied","Data":"ba1e6d9cf0e1e6aafedaf9c98ee4a8c9b64fa63fd865d5bf96c612a4fb92d628"}
Sep 08 14:41:32.423098 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:32.423073    2564 scope.go:117] "RemoveContainer" containerID="794c2d4e601ca9d0e47871a95172dd3671bbbe368761253ac8ed9025c654d338"
Sep 08 14:41:32.432698 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:32.432682    2564 scope.go:117] "RemoveContainer" containerID="2c319062d50abe424152864844d3b9903108ee0070968d14adaa5bd03300bd49"
Sep 08 14:41:32.441276 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:32.441259    2564 scope.go:117] "RemoveContainer" containerID="794c2d4e601ca9d0e47871a95172dd3671bbbe368761253ac8ed9025c654d338"
Sep 08 14:41:32.441553 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:41:32.441532    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"794c2d4e601ca9d0e47871a95172dd3671bbbe368761253ac8ed9025c654d338\": container with ID starting with 794c2d4e601ca9d0e47871a95172dd3671bbbe368761253ac8ed9025c654d338 not found: ID does not exist" containerID="794c2d4e601ca9d0e47871a95172dd3671bbbe368761253ac8ed9025c654d338"
Sep 08 14:41:32.441640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:32.441560    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"794c2d4e601ca9d0e47871a95172dd3671bbbe368761253ac8ed9025c654d338"} err="failed to get container status \"794c2d4e601ca9d0e47871a95172dd3671bbbe368761253ac8ed9025c654d338\": rpc error: code = NotFound desc = could not find container \"794c2d4e601ca9d0e47871a95172dd3671bbbe368761253ac8ed9025c654d338\": container with ID starting with 794c2d4e601ca9d0e47871a95172dd3671bbbe368761253ac8ed9025c654d338 not found: ID does not exist"
Sep 08 14:41:32.441640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:32.441576    2564 scope.go:117] "RemoveContainer" containerID="2c319062d50abe424152864844d3b9903108ee0070968d14adaa5bd03300bd49"
Sep 08 14:41:32.441845 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:41:32.441830    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c319062d50abe424152864844d3b9903108ee0070968d14adaa5bd03300bd49\": container with ID starting with 2c319062d50abe424152864844d3b9903108ee0070968d14adaa5bd03300bd49 not found: ID does not exist" containerID="2c319062d50abe424152864844d3b9903108ee0070968d14adaa5bd03300bd49"
Sep 08 14:41:32.441889 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:32.441848    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c319062d50abe424152864844d3b9903108ee0070968d14adaa5bd03300bd49"} err="failed to get container status \"2c319062d50abe424152864844d3b9903108ee0070968d14adaa5bd03300bd49\": rpc error: code = NotFound desc = could not find container \"2c319062d50abe424152864844d3b9903108ee0070968d14adaa5bd03300bd49\": container with ID starting with 2c319062d50abe424152864844d3b9903108ee0070968d14adaa5bd03300bd49 not found: ID does not exist"
Sep 08 14:41:32.448755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:32.448733    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"]
Sep 08 14:41:32.454801 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:32.454780    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-41e512-openshift-default-7f5ccf746-lh5sl"]
Sep 08 14:41:33.186433 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:33.186395    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6eff3dbf-8976-4504-82e3-0da418bb7290" path="/var/lib/kubelet/pods/6eff3dbf-8976-4504-82e3-0da418bb7290/volumes"
Sep 08 14:41:37.402860 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:37.402824    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"]
Sep 08 14:41:37.403458 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:37.403121    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg" podUID="d059a633-ef23-4f70-bbe8-6189cbf0dee5" containerName="payload-processing" containerID="cri-o://0223311da1e3545954340481b53313daf71611d984f0272e4b4049425ce171f2" gracePeriod=30
Sep 08 14:41:37.434627 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:37.434577    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg" podUID="d059a633-ef23-4f70-bbe8-6189cbf0dee5" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.55:9004: connect: connection refused"
Sep 08 14:41:37.667117 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:37.667036    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"
Sep 08 14:41:37.784426 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:37.784396    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d059a633-ef23-4f70-bbe8-6189cbf0dee5-plugins-config-volume\") pod \"d059a633-ef23-4f70-bbe8-6189cbf0dee5\" (UID: \"d059a633-ef23-4f70-bbe8-6189cbf0dee5\") "
Sep 08 14:41:37.784426 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:37.784432    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trmc6\" (UniqueName: \"kubernetes.io/projected/d059a633-ef23-4f70-bbe8-6189cbf0dee5-kube-api-access-trmc6\") pod \"d059a633-ef23-4f70-bbe8-6189cbf0dee5\" (UID: \"d059a633-ef23-4f70-bbe8-6189cbf0dee5\") "
Sep 08 14:41:37.784776 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:37.784747    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d059a633-ef23-4f70-bbe8-6189cbf0dee5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d059a633-ef23-4f70-bbe8-6189cbf0dee5" (UID: "d059a633-ef23-4f70-bbe8-6189cbf0dee5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:41:37.786466 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:37.786443    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d059a633-ef23-4f70-bbe8-6189cbf0dee5-kube-api-access-trmc6" (OuterVolumeSpecName: "kube-api-access-trmc6") pod "d059a633-ef23-4f70-bbe8-6189cbf0dee5" (UID: "d059a633-ef23-4f70-bbe8-6189cbf0dee5"). InnerVolumeSpecName "kube-api-access-trmc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:41:37.886058 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:37.886029    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d059a633-ef23-4f70-bbe8-6189cbf0dee5-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:37.886058 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:37.886055    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trmc6\" (UniqueName: \"kubernetes.io/projected/d059a633-ef23-4f70-bbe8-6189cbf0dee5-kube-api-access-trmc6\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:38.462261 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:38.462226    2564 generic.go:356] "Generic (PLEG): container finished" podID="d059a633-ef23-4f70-bbe8-6189cbf0dee5" containerID="0223311da1e3545954340481b53313daf71611d984f0272e4b4049425ce171f2" exitCode=0
Sep 08 14:41:38.462666 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:38.462279    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"
Sep 08 14:41:38.462666 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:38.462311    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg" event={"ID":"d059a633-ef23-4f70-bbe8-6189cbf0dee5","Type":"ContainerDied","Data":"0223311da1e3545954340481b53313daf71611d984f0272e4b4049425ce171f2"}
Sep 08 14:41:38.462666 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:38.462382    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg" event={"ID":"d059a633-ef23-4f70-bbe8-6189cbf0dee5","Type":"ContainerDied","Data":"64106ae9973e90f50e08d77d49bf359683ec1c2ceb3ff77a8eaa7e6c85cc388b"}
Sep 08 14:41:38.462666 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:38.462404    2564 scope.go:117] "RemoveContainer" containerID="0223311da1e3545954340481b53313daf71611d984f0272e4b4049425ce171f2"
Sep 08 14:41:38.471203 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:38.471185    2564 scope.go:117] "RemoveContainer" containerID="0223311da1e3545954340481b53313daf71611d984f0272e4b4049425ce171f2"
Sep 08 14:41:38.471468 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:41:38.471450    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0223311da1e3545954340481b53313daf71611d984f0272e4b4049425ce171f2\": container with ID starting with 0223311da1e3545954340481b53313daf71611d984f0272e4b4049425ce171f2 not found: ID does not exist" containerID="0223311da1e3545954340481b53313daf71611d984f0272e4b4049425ce171f2"
Sep 08 14:41:38.471536 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:38.471476    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0223311da1e3545954340481b53313daf71611d984f0272e4b4049425ce171f2"} err="failed to get container status \"0223311da1e3545954340481b53313daf71611d984f0272e4b4049425ce171f2\": rpc error: code = NotFound desc = could not find container \"0223311da1e3545954340481b53313daf71611d984f0272e4b4049425ce171f2\": container with ID starting with 0223311da1e3545954340481b53313daf71611d984f0272e4b4049425ce171f2 not found: ID does not exist"
Sep 08 14:41:38.483968 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:38.483941    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"]
Sep 08 14:41:38.487974 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:38.487954    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-23a1d4-67448c9559-ztwvg"]
Sep 08 14:41:39.186881 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:39.186848    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d059a633-ef23-4f70-bbe8-6189cbf0dee5" path="/var/lib/kubelet/pods/d059a633-ef23-4f70-bbe8-6189cbf0dee5/volumes"
Sep 08 14:41:39.264051 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:39.264021    2564 scope.go:117] "RemoveContainer" containerID="095656982bd44a2c5e5f465c5e5d171a041d7b00d5ae0a6925ec4bf1c6e7247d"
Sep 08 14:41:39.272422 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:39.272402    2564 scope.go:117] "RemoveContainer" containerID="7130362c5057d040f51f8af039eee487c3d2c146b1530d13c1fb5c8810961d84"
Sep 08 14:41:39.279844 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:39.279826    2564 scope.go:117] "RemoveContainer" containerID="9ca44ee0b761c24fb47fa6ee162f1efcbb7e408b1fbf64202eca326e2976406b"
Sep 08 14:41:44.789081 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.789041    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr"]
Sep 08 14:41:44.789488 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.789416    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d059a633-ef23-4f70-bbe8-6189cbf0dee5" containerName="payload-processing"
Sep 08 14:41:44.789488 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.789427    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d059a633-ef23-4f70-bbe8-6189cbf0dee5" containerName="payload-processing"
Sep 08 14:41:44.789488 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.789435    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerName="istio-proxy"
Sep 08 14:41:44.789488 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.789441    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerName="istio-proxy"
Sep 08 14:41:44.789488 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.789448    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27969a83-5655-44cf-976f-48af04b6c398" containerName="revoke-keys"
Sep 08 14:41:44.789488 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.789453    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="27969a83-5655-44cf-976f-48af04b6c398" containerName="revoke-keys"
Sep 08 14:41:44.789758 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.789551    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerName="istio-proxy"
Sep 08 14:41:44.789758 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.789562    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="27969a83-5655-44cf-976f-48af04b6c398" containerName="revoke-keys"
Sep 08 14:41:44.789758 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.789570    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d059a633-ef23-4f70-bbe8-6189cbf0dee5" containerName="payload-processing"
Sep 08 14:41:44.792607 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.792587    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr"
Sep 08 14:41:44.795243 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.795220    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:41:44.795379 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.795303    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:41:44.799753 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.799727    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr"]
Sep 08 14:41:44.848669 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.848633    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d12c4e-65a4-4b98-ae08-3531f3abd7e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr\" (UID: \"39d12c4e-65a4-4b98-ae08-3531f3abd7e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr"
Sep 08 14:41:44.949092 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.949049    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d12c4e-65a4-4b98-ae08-3531f3abd7e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr\" (UID: \"39d12c4e-65a4-4b98-ae08-3531f3abd7e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr"
Sep 08 14:41:44.949742 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:44.949720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d12c4e-65a4-4b98-ae08-3531f3abd7e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr\" (UID: \"39d12c4e-65a4-4b98-ae08-3531f3abd7e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr"
Sep 08 14:41:45.106936 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:45.106885    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr"
Sep 08 14:41:45.379250 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:45.379223    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr"]
Sep 08 14:41:45.381902 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:41:45.381874    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d12c4e_65a4_4b98_ae08_3531f3abd7e6.slice/crio-4c2c9cc6e350cc8c81202ce60f70c53ff12119f9e100a3bb147d1bb184c264df WatchSource:0}: Error finding container 4c2c9cc6e350cc8c81202ce60f70c53ff12119f9e100a3bb147d1bb184c264df: Status 404 returned error can't find the container with id 4c2c9cc6e350cc8c81202ce60f70c53ff12119f9e100a3bb147d1bb184c264df
Sep 08 14:41:45.503777 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:45.503744    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr" event={"ID":"39d12c4e-65a4-4b98-ae08-3531f3abd7e6","Type":"ContainerStarted","Data":"4c2c9cc6e350cc8c81202ce60f70c53ff12119f9e100a3bb147d1bb184c264df"}
Sep 08 14:41:46.510295 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:46.510201    2564 generic.go:356] "Generic (PLEG): container finished" podID="39d12c4e-65a4-4b98-ae08-3531f3abd7e6" containerID="8badbb318fa24b5b2cd81073d009d90c22214f2b73632c972eb68c42afa416c5" exitCode=0
Sep 08 14:41:46.510678 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:46.510286    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr" event={"ID":"39d12c4e-65a4-4b98-ae08-3531f3abd7e6","Type":"ContainerDied","Data":"8badbb318fa24b5b2cd81073d009d90c22214f2b73632c972eb68c42afa416c5"}
Sep 08 14:41:47.652370 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:47.652342    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr"
Sep 08 14:41:47.670488 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:47.670449    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d12c4e-65a4-4b98-ae08-3531f3abd7e6-maas-api-service-ca\") pod \"39d12c4e-65a4-4b98-ae08-3531f3abd7e6\" (UID: \"39d12c4e-65a4-4b98-ae08-3531f3abd7e6\") "
Sep 08 14:41:47.670843 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:47.670819    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39d12c4e-65a4-4b98-ae08-3531f3abd7e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "39d12c4e-65a4-4b98-ae08-3531f3abd7e6" (UID: "39d12c4e-65a4-4b98-ae08-3531f3abd7e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:41:47.771835 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:47.771738    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/39d12c4e-65a4-4b98-ae08-3531f3abd7e6-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:48.522507 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:48.522465    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr"
Sep 08 14:41:48.522696 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:48.522529    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr" event={"ID":"39d12c4e-65a4-4b98-ae08-3531f3abd7e6","Type":"ContainerDied","Data":"4c2c9cc6e350cc8c81202ce60f70c53ff12119f9e100a3bb147d1bb184c264df"}
Sep 08 14:41:48.522696 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:48.522583    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c2c9cc6e350cc8c81202ce60f70c53ff12119f9e100a3bb147d1bb184c264df"
Sep 08 14:41:50.839729 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:50.839681    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"]
Sep 08 14:41:55.523231 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:55.523188    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"]
Sep 08 14:41:55.523720 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:55.523445    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m" podUID="bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2" containerName="payload-pre-processing" containerID="cri-o://c36ad68ad8e42e54bbcd29536ee3f03a24e5108f7f198442421d4bd971b82d46" gracePeriod=30
Sep 08 14:41:55.688131 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:55.688088    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr"]
Sep 08 14:41:55.690435 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:55.690404    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-34656b-wfrcr"]
Sep 08 14:41:55.786305 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:55.786230    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"
Sep 08 14:41:55.847171 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:55.847132    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2-plugins-config-volume\") pod \"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2\" (UID: \"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2\") "
Sep 08 14:41:55.847355 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:55.847247    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6d5x\" (UniqueName: \"kubernetes.io/projected/bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2-kube-api-access-k6d5x\") pod \"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2\" (UID: \"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2\") "
Sep 08 14:41:55.847700 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:55.847668    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2" (UID: "bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:41:55.849973 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:55.849943    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2-kube-api-access-k6d5x" (OuterVolumeSpecName: "kube-api-access-k6d5x") pod "bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2" (UID: "bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2"). InnerVolumeSpecName "kube-api-access-k6d5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:41:55.948181 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:55.948135    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:55.948181 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:55.948174    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6d5x\" (UniqueName: \"kubernetes.io/projected/bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2-kube-api-access-k6d5x\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:41:56.563889 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.563855    2564 generic.go:356] "Generic (PLEG): container finished" podID="bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2" containerID="c36ad68ad8e42e54bbcd29536ee3f03a24e5108f7f198442421d4bd971b82d46" exitCode=0
Sep 08 14:41:56.564373 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.563902    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"
Sep 08 14:41:56.564373 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.563940    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m" event={"ID":"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2","Type":"ContainerDied","Data":"c36ad68ad8e42e54bbcd29536ee3f03a24e5108f7f198442421d4bd971b82d46"}
Sep 08 14:41:56.564373 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.564013    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m" event={"ID":"bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2","Type":"ContainerDied","Data":"b4ff4682e685f0a1d7fbfbaecaef4bcc016360448d277c1c59f961edadd57d11"}
Sep 08 14:41:56.564373 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.564038    2564 scope.go:117] "RemoveContainer" containerID="c36ad68ad8e42e54bbcd29536ee3f03a24e5108f7f198442421d4bd971b82d46"
Sep 08 14:41:56.574708 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.574686    2564 scope.go:117] "RemoveContainer" containerID="c36ad68ad8e42e54bbcd29536ee3f03a24e5108f7f198442421d4bd971b82d46"
Sep 08 14:41:56.575061 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:41:56.575039    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c36ad68ad8e42e54bbcd29536ee3f03a24e5108f7f198442421d4bd971b82d46\": container with ID starting with c36ad68ad8e42e54bbcd29536ee3f03a24e5108f7f198442421d4bd971b82d46 not found: ID does not exist" containerID="c36ad68ad8e42e54bbcd29536ee3f03a24e5108f7f198442421d4bd971b82d46"
Sep 08 14:41:56.575114 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.575072    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c36ad68ad8e42e54bbcd29536ee3f03a24e5108f7f198442421d4bd971b82d46"} err="failed to get container status \"c36ad68ad8e42e54bbcd29536ee3f03a24e5108f7f198442421d4bd971b82d46\": rpc error: code = NotFound desc = could not find container \"c36ad68ad8e42e54bbcd29536ee3f03a24e5108f7f198442421d4bd971b82d46\": container with ID starting with c36ad68ad8e42e54bbcd29536ee3f03a24e5108f7f198442421d4bd971b82d46 not found: ID does not exist"
Sep 08 14:41:56.592528 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.592462    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"]
Sep 08 14:41:56.603827 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.603782    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-34656b-94bf4b9c4-pjr4m"]
Sep 08 14:41:56.614650 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.614616    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"]
Sep 08 14:41:56.615009 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.614996    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d12c4e-65a4-4b98-ae08-3531f3abd7e6" containerName="revoke-keys"
Sep 08 14:41:56.615054 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.615010    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d12c4e-65a4-4b98-ae08-3531f3abd7e6" containerName="revoke-keys"
Sep 08 14:41:56.615054 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.615028    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2" containerName="payload-pre-processing"
Sep 08 14:41:56.615054 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.615035    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2" containerName="payload-pre-processing"
Sep 08 14:41:56.615054 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.615041    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerName="istio-proxy"
Sep 08 14:41:56.615054 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.615046    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerName="istio-proxy"
Sep 08 14:41:56.615204 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.615108    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6eff3dbf-8976-4504-82e3-0da418bb7290" containerName="istio-proxy"
Sep 08 14:41:56.615204 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.615116    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="39d12c4e-65a4-4b98-ae08-3531f3abd7e6" containerName="revoke-keys"
Sep 08 14:41:56.615204 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.615123    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2" containerName="payload-pre-processing"
Sep 08 14:41:56.619515 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.619473    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"
Sep 08 14:41:56.621994 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.621965    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-274ffa-dockercfg-vt5xd\""
Sep 08 14:41:56.621994 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.621983    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-274ffa\""
Sep 08 14:41:56.627290 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.627260    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"]
Sep 08 14:41:56.654858 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.654815    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h\" (UID: \"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"
Sep 08 14:41:56.655071 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.655012    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg2sf\" (UniqueName: \"kubernetes.io/projected/c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc-kube-api-access-kg2sf\") pod \"payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h\" (UID: \"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"
Sep 08 14:41:56.756462 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.756417    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg2sf\" (UniqueName: \"kubernetes.io/projected/c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc-kube-api-access-kg2sf\") pod \"payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h\" (UID: \"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"
Sep 08 14:41:56.756678 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.756467    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h\" (UID: \"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"
Sep 08 14:41:56.757302 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.757278    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h\" (UID: \"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"
Sep 08 14:41:56.765102 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.765052    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg2sf\" (UniqueName: \"kubernetes.io/projected/c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc-kube-api-access-kg2sf\") pod \"payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h\" (UID: \"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"
Sep 08 14:41:56.933230 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:56.933184    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"
Sep 08 14:41:57.186244 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:57.186156    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39d12c4e-65a4-4b98-ae08-3531f3abd7e6" path="/var/lib/kubelet/pods/39d12c4e-65a4-4b98-ae08-3531f3abd7e6/volumes"
Sep 08 14:41:57.186568 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:57.186554    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2" path="/var/lib/kubelet/pods/bf48a0b3-9c6e-4b58-a27e-27c6026fb5b2/volumes"
Sep 08 14:41:57.208790 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:57.208760    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"]
Sep 08 14:41:57.211199 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:41:57.211166    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3129e5c_a8d0_4d5c_98c6_709c7a1af4fc.slice/crio-e44d441cb8b1818db445cd43eb5c525f649b3c4bff8ca031de3909c40ef7f738 WatchSource:0}: Error finding container e44d441cb8b1818db445cd43eb5c525f649b3c4bff8ca031de3909c40ef7f738: Status 404 returned error can't find the container with id e44d441cb8b1818db445cd43eb5c525f649b3c4bff8ca031de3909c40ef7f738
Sep 08 14:41:57.571813 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:57.571707    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h" event={"ID":"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc","Type":"ContainerStarted","Data":"bdb42b4851b37ba14dd5455df44e016ed14b5af1d310b53b21a3ac1c19816341"}
Sep 08 14:41:57.571813 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:57.571775    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h" event={"ID":"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc","Type":"ContainerStarted","Data":"e44d441cb8b1818db445cd43eb5c525f649b3c4bff8ca031de3909c40ef7f738"}
Sep 08 14:41:57.572342 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:57.571887    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"
Sep 08 14:41:57.590314 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:41:57.590253    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h" podStartSLOduration=1.5902320429999999 podStartE2EDuration="1.590232043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:41:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:41:57.588211675 +0000 UTC m=+1518.984161107" watchObservedRunningTime="2026-09-08 14:41:57.590232043 +0000 UTC m=+1518.986181473"
Sep 08 14:42:02.396410 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:02.396321    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"]
Sep 08 14:42:02.396869 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:02.396677    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerName="istio-proxy" containerID="cri-o://fd4cb673f940cdfac6cda60c8298b049202ee0bce24092753fc6b7d3b2d5a77b" gracePeriod=30
Sep 08 14:42:05.860086 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:05.860034    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww" podUID="3e96d60f-ff45-4fed-b343-61f3e8983875" containerName="main" containerID="cri-o://b25c88b4f82dc8733d601706b8c83b40f97b5ca94bec69ab907d0b05f98ebbff" gracePeriod=45
Sep 08 14:42:06.121041 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.120977    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:42:06.250882 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.250842    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-dshm\") pod \"3e96d60f-ff45-4fed-b343-61f3e8983875\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") "
Sep 08 14:42:06.251065 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.250924    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96d60f-ff45-4fed-b343-61f3e8983875-tls-certs\") pod \"3e96d60f-ff45-4fed-b343-61f3e8983875\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") "
Sep 08 14:42:06.251065 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.250947    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-home\") pod \"3e96d60f-ff45-4fed-b343-61f3e8983875\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") "
Sep 08 14:42:06.251065 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.251006    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-model-cache\") pod \"3e96d60f-ff45-4fed-b343-61f3e8983875\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") "
Sep 08 14:42:06.251065 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.251041    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-tmp-dir\") pod \"3e96d60f-ff45-4fed-b343-61f3e8983875\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") "
Sep 08 14:42:06.251285 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.251092    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv8mb\" (UniqueName: \"kubernetes.io/projected/3e96d60f-ff45-4fed-b343-61f3e8983875-kube-api-access-qv8mb\") pod \"3e96d60f-ff45-4fed-b343-61f3e8983875\" (UID: \"3e96d60f-ff45-4fed-b343-61f3e8983875\") "
Sep 08 14:42:06.251337 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.251289    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3e96d60f-ff45-4fed-b343-61f3e8983875" (UID: "3e96d60f-ff45-4fed-b343-61f3e8983875"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:42:06.251337 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.251299    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-home" (OuterVolumeSpecName: "home") pod "3e96d60f-ff45-4fed-b343-61f3e8983875" (UID: "3e96d60f-ff45-4fed-b343-61f3e8983875"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:42:06.251337 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.251314    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-model-cache" (OuterVolumeSpecName: "model-cache") pod "3e96d60f-ff45-4fed-b343-61f3e8983875" (UID: "3e96d60f-ff45-4fed-b343-61f3e8983875"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:42:06.251484 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.251410    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-home\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:06.251484 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.251428    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-model-cache\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:06.251484 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.251440    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-tmp-dir\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:06.253154 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.253130    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-dshm" (OuterVolumeSpecName: "dshm") pod "3e96d60f-ff45-4fed-b343-61f3e8983875" (UID: "3e96d60f-ff45-4fed-b343-61f3e8983875"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:42:06.253288 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.253200    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e96d60f-ff45-4fed-b343-61f3e8983875-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3e96d60f-ff45-4fed-b343-61f3e8983875" (UID: "3e96d60f-ff45-4fed-b343-61f3e8983875"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:42:06.253288 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.253261    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e96d60f-ff45-4fed-b343-61f3e8983875-kube-api-access-qv8mb" (OuterVolumeSpecName: "kube-api-access-qv8mb") pod "3e96d60f-ff45-4fed-b343-61f3e8983875" (UID: "3e96d60f-ff45-4fed-b343-61f3e8983875"). InnerVolumeSpecName "kube-api-access-qv8mb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:42:06.352657 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.352630    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv8mb\" (UniqueName: \"kubernetes.io/projected/3e96d60f-ff45-4fed-b343-61f3e8983875-kube-api-access-qv8mb\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:06.352657 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.352654    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e96d60f-ff45-4fed-b343-61f3e8983875-dshm\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:06.352813 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.352664    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e96d60f-ff45-4fed-b343-61f3e8983875-tls-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:06.594678 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.594642    2564 patch_prober.go:28] interesting pod/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:42:06.594857 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.594701    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:42:06.622519 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.622466    2564 generic.go:356] "Generic (PLEG): container finished" podID="3e96d60f-ff45-4fed-b343-61f3e8983875" containerID="b25c88b4f82dc8733d601706b8c83b40f97b5ca94bec69ab907d0b05f98ebbff" exitCode=0
Sep 08 14:42:06.622687 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.622534    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww" event={"ID":"3e96d60f-ff45-4fed-b343-61f3e8983875","Type":"ContainerDied","Data":"b25c88b4f82dc8733d601706b8c83b40f97b5ca94bec69ab907d0b05f98ebbff"}
Sep 08 14:42:06.622687 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.622553    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"
Sep 08 14:42:06.622687 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.622570    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww" event={"ID":"3e96d60f-ff45-4fed-b343-61f3e8983875","Type":"ContainerDied","Data":"b404ec1653d9bc7f04818c7c58ece228d94561dd6ab37a9fd8f87c994f1a2d81"}
Sep 08 14:42:06.622687 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.622589    2564 scope.go:117] "RemoveContainer" containerID="b25c88b4f82dc8733d601706b8c83b40f97b5ca94bec69ab907d0b05f98ebbff"
Sep 08 14:42:06.631659 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.631642    2564 scope.go:117] "RemoveContainer" containerID="b25c88b4f82dc8733d601706b8c83b40f97b5ca94bec69ab907d0b05f98ebbff"
Sep 08 14:42:06.631932 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:42:06.631914    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b25c88b4f82dc8733d601706b8c83b40f97b5ca94bec69ab907d0b05f98ebbff\": container with ID starting with b25c88b4f82dc8733d601706b8c83b40f97b5ca94bec69ab907d0b05f98ebbff not found: ID does not exist" containerID="b25c88b4f82dc8733d601706b8c83b40f97b5ca94bec69ab907d0b05f98ebbff"
Sep 08 14:42:06.631992 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.631938    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b25c88b4f82dc8733d601706b8c83b40f97b5ca94bec69ab907d0b05f98ebbff"} err="failed to get container status \"b25c88b4f82dc8733d601706b8c83b40f97b5ca94bec69ab907d0b05f98ebbff\": rpc error: code = NotFound desc = could not find container \"b25c88b4f82dc8733d601706b8c83b40f97b5ca94bec69ab907d0b05f98ebbff\": container with ID starting with b25c88b4f82dc8733d601706b8c83b40f97b5ca94bec69ab907d0b05f98ebbff not found: ID does not exist"
Sep 08 14:42:06.643819 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.643796    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"]
Sep 08 14:42:06.648061 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:06.648041    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-017dbd/rate-test-model-017dbd-kserve-794569f787-rnwww"]
Sep 08 14:42:07.185778 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.185742    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e96d60f-ff45-4fed-b343-61f3e8983875" path="/var/lib/kubelet/pods/3e96d60f-ff45-4fed-b343-61f3e8983875/volumes"
Sep 08 14:42:07.642677 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.642644    2564 generic.go:356] "Generic (PLEG): container finished" podID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerID="fd4cb673f940cdfac6cda60c8298b049202ee0bce24092753fc6b7d3b2d5a77b" exitCode=0
Sep 08 14:42:07.642864 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.642729    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" event={"ID":"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a","Type":"ContainerDied","Data":"fd4cb673f940cdfac6cda60c8298b049202ee0bce24092753fc6b7d3b2d5a77b"}
Sep 08 14:42:07.642864 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.642843    2564 scope.go:117] "RemoveContainer" containerID="b9135c35827d48407383510119d34be2e46034536ce497648cde7d72495b977c"
Sep 08 14:42:07.665996 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:42:07.665962    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9135c35827d48407383510119d34be2e46034536ce497648cde7d72495b977c\": container with ID starting with b9135c35827d48407383510119d34be2e46034536ce497648cde7d72495b977c not found: ID does not exist" containerID="b9135c35827d48407383510119d34be2e46034536ce497648cde7d72495b977c"
Sep 08 14:42:07.669353 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.669337    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:42:07.765358 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.765328    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-token\") pod \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") "
Sep 08 14:42:07.765358 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.765358    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istiod-ca-cert\") pod \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") "
Sep 08 14:42:07.765612 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.765401    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-data\") pod \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") "
Sep 08 14:42:07.765612 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.765432    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-workload-socket\") pod \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") "
Sep 08 14:42:07.765612 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.765469    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-workload-certs\") pod \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") "
Sep 08 14:42:07.765612 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.765538    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf957\" (UniqueName: \"kubernetes.io/projected/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-kube-api-access-tf957\") pod \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") "
Sep 08 14:42:07.765612 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.765588    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-credential-socket\") pod \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") "
Sep 08 14:42:07.765851 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.765615    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-envoy\") pod \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") "
Sep 08 14:42:07.765851 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.765671    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-podinfo\") pod \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\" (UID: \"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a\") "
Sep 08 14:42:07.765851 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.765763    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" (UID: "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:42:07.765851 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.765812    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" (UID: "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:42:07.765851 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.765772    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-data" (OuterVolumeSpecName: "istio-data") pod "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" (UID: "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:42:07.766086 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.765918    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" (UID: "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:42:07.766086 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.766026    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istiod-ca-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:07.766086 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.766045    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-data\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:07.766086 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.766057    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-workload-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:07.766086 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.766069    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-workload-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:07.766279 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.766091    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" (UID: "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:42:07.767878 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.767849    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-kube-api-access-tf957" (OuterVolumeSpecName: "kube-api-access-tf957") pod "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" (UID: "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a"). InnerVolumeSpecName "kube-api-access-tf957". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:42:07.767878 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.767873    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" (UID: "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:42:07.768049 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.767966    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-token" (OuterVolumeSpecName: "istio-token") pod "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" (UID: "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:42:07.768097 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.768082    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" (UID: "fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:42:07.866939 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.866915    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-podinfo\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:07.866939 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.866936    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:07.867095 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.866946    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf957\" (UniqueName: \"kubernetes.io/projected/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-kube-api-access-tf957\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:07.867095 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.866955    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-credential-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:07.867095 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:07.866963    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a-istio-envoy\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:42:08.581450 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:08.581421    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"
Sep 08 14:42:08.649066 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:08.649045    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"
Sep 08 14:42:08.649225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:08.649037    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2" event={"ID":"fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a","Type":"ContainerDied","Data":"d302afe71892d4e1b8fa8b3d928c761b4585c0a6146e40b8fa9cc72dbb80c9c1"}
Sep 08 14:42:08.649225 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:08.649175    2564 scope.go:117] "RemoveContainer" containerID="fd4cb673f940cdfac6cda60c8298b049202ee0bce24092753fc6b7d3b2d5a77b"
Sep 08 14:42:08.671394 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:08.671367    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"]
Sep 08 14:42:08.675900 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:08.675878    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-34656b-openshift-default-96b6dd76-lkch2"]
Sep 08 14:42:09.186041 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:09.186001    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" path="/var/lib/kubelet/pods/fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a/volumes"
Sep 08 14:42:20.790774 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.790734    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"]
Sep 08 14:42:20.791255 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.791164    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerName="istio-proxy"
Sep 08 14:42:20.791255 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.791181    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerName="istio-proxy"
Sep 08 14:42:20.791255 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.791198    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerName="istio-proxy"
Sep 08 14:42:20.791255 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.791207    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerName="istio-proxy"
Sep 08 14:42:20.791255 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.791218    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e96d60f-ff45-4fed-b343-61f3e8983875" containerName="main"
Sep 08 14:42:20.791255 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.791224    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e96d60f-ff45-4fed-b343-61f3e8983875" containerName="main"
Sep 08 14:42:20.791776 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.791742    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerName="istio-proxy"
Sep 08 14:42:20.791935 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.791785    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="fecc843e-e7f8-48c7-a2cd-f2b9d7344e4a" containerName="istio-proxy"
Sep 08 14:42:20.791935 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.791804    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e96d60f-ff45-4fed-b343-61f3e8983875" containerName="main"
Sep 08 14:42:20.794920 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.794894    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.797356 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.797329    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-f7d00a-openshift-default-dockercfg-kf9nm\""
Sep 08 14:42:20.808193 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.808158    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"]
Sep 08 14:42:20.888020 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.887971    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-podinfo\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.888208 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.888069    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdct2\" (UniqueName: \"kubernetes.io/projected/67430652-9b1f-49ec-a929-4c99e3d1f836-kube-api-access-cdct2\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.888208 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.888131    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-workload-socket\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.888208 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.888169    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-data\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.888208 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.888204    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-credential-socket\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.888372 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.888275    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-envoy\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.888414 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.888364    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-workload-certs\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.888414 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.888406    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67430652-9b1f-49ec-a929-4c99e3d1f836-istiod-ca-cert\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.888555 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.888528    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-token\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.989545 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.989470    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-workload-certs\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.989765 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.989574    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67430652-9b1f-49ec-a929-4c99e3d1f836-istiod-ca-cert\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.989765 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.989632    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-token\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.989765 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.989699    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-podinfo\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.989765 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.989719    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdct2\" (UniqueName: \"kubernetes.io/projected/67430652-9b1f-49ec-a929-4c99e3d1f836-kube-api-access-cdct2\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.989765 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.989740    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-workload-socket\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.989765 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.989764    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-data\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.990177 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.989790    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-credential-socket\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.990177 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.989821    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-envoy\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.990177 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.990124    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-data\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.990342 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.990239    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-workload-certs\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.990342 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.990294    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-credential-socket\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.990445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.990340    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67430652-9b1f-49ec-a929-4c99e3d1f836-istiod-ca-cert\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.990445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.990359    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-workload-socket\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.992077 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.992054    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-envoy\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:20.992302 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:20.992283    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-podinfo\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:21.001211 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:21.001178    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdct2\" (UniqueName: \"kubernetes.io/projected/67430652-9b1f-49ec-a929-4c99e3d1f836-kube-api-access-cdct2\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:21.001623 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:21.001597    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-token\") pod \"e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") " pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:21.109919 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:21.109874    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:21.386929 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:21.386842    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"]
Sep 08 14:42:21.389842 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:42:21.389810    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67430652_9b1f_49ec_a929_4c99e3d1f836.slice/crio-1d3e21afefcd884cc883fe19ff8b8189ed23026caee46fae7073f852f27261fc WatchSource:0}: Error finding container 1d3e21afefcd884cc883fe19ff8b8189ed23026caee46fae7073f852f27261fc: Status 404 returned error can't find the container with id 1d3e21afefcd884cc883fe19ff8b8189ed23026caee46fae7073f852f27261fc
Sep 08 14:42:21.392143 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:21.392108    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:42:21.392230 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:21.392184    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:42:21.392230 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:21.392212    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:42:21.717150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:21.717018    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" event={"ID":"67430652-9b1f-49ec-a929-4c99e3d1f836","Type":"ContainerStarted","Data":"a18899725e661100d401edf1de17fd1de9497fdc8ccaf8e99f433aaac59340ee"}
Sep 08 14:42:21.717150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:21.717135    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" event={"ID":"67430652-9b1f-49ec-a929-4c99e3d1f836","Type":"ContainerStarted","Data":"1d3e21afefcd884cc883fe19ff8b8189ed23026caee46fae7073f852f27261fc"}
Sep 08 14:42:21.745118 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:21.745054    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" podStartSLOduration=1.745036856 podStartE2EDuration="1.745036856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:42:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:42:21.742889331 +0000 UTC m=+1543.138838763" watchObservedRunningTime="2026-09-08 14:42:21.745036856 +0000 UTC m=+1543.140986287"
Sep 08 14:42:22.110488 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:22.110444    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:22.116129 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:22.116098    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:22.722084 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:22.722052    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:22.723033 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:22.723012    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:25.569195 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:25.569160    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"]
Sep 08 14:42:25.572814 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:25.572791    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"
Sep 08 14:42:25.575127 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:25.575099    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-f7d00a-dockercfg-9225w\""
Sep 08 14:42:25.575282 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:25.575098    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-f7d00a\""
Sep 08 14:42:25.583075 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:25.583041    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"]
Sep 08 14:42:25.735079 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:25.735041    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200a8257-dfc5-42c8-a114-6acdfabc245a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr\" (UID: \"200a8257-dfc5-42c8-a114-6acdfabc245a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"
Sep 08 14:42:25.735306 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:25.735155    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfg84\" (UniqueName: \"kubernetes.io/projected/200a8257-dfc5-42c8-a114-6acdfabc245a-kube-api-access-xfg84\") pod \"payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr\" (UID: \"200a8257-dfc5-42c8-a114-6acdfabc245a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"
Sep 08 14:42:25.836346 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:25.836302    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200a8257-dfc5-42c8-a114-6acdfabc245a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr\" (UID: \"200a8257-dfc5-42c8-a114-6acdfabc245a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"
Sep 08 14:42:25.836583 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:25.836403    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfg84\" (UniqueName: \"kubernetes.io/projected/200a8257-dfc5-42c8-a114-6acdfabc245a-kube-api-access-xfg84\") pod \"payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr\" (UID: \"200a8257-dfc5-42c8-a114-6acdfabc245a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"
Sep 08 14:42:25.837109 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:25.837086    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200a8257-dfc5-42c8-a114-6acdfabc245a-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr\" (UID: \"200a8257-dfc5-42c8-a114-6acdfabc245a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"
Sep 08 14:42:25.845682 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:25.845649    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfg84\" (UniqueName: \"kubernetes.io/projected/200a8257-dfc5-42c8-a114-6acdfabc245a-kube-api-access-xfg84\") pod \"payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr\" (UID: \"200a8257-dfc5-42c8-a114-6acdfabc245a\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"
Sep 08 14:42:25.885857 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:25.885801    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"
Sep 08 14:42:26.160035 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:26.160006    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"]
Sep 08 14:42:26.162213 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:42:26.162184    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod200a8257_dfc5_42c8_a114_6acdfabc245a.slice/crio-6ef7c9ed35cf0e720ee23e9da3f517d22879ea35d9583c1531053851ea7e5700 WatchSource:0}: Error finding container 6ef7c9ed35cf0e720ee23e9da3f517d22879ea35d9583c1531053851ea7e5700: Status 404 returned error can't find the container with id 6ef7c9ed35cf0e720ee23e9da3f517d22879ea35d9583c1531053851ea7e5700
Sep 08 14:42:26.746933 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:26.746895    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr" event={"ID":"200a8257-dfc5-42c8-a114-6acdfabc245a","Type":"ContainerStarted","Data":"9e81e24b8306d9df355ec808bd06f38bbc50a8c731690f77bbfbdfb018a6d45f"}
Sep 08 14:42:26.747385 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:26.746946    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr" event={"ID":"200a8257-dfc5-42c8-a114-6acdfabc245a","Type":"ContainerStarted","Data":"6ef7c9ed35cf0e720ee23e9da3f517d22879ea35d9583c1531053851ea7e5700"}
Sep 08 14:42:26.747385 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:26.747032    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"
Sep 08 14:42:26.762885 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:26.762824    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr" podStartSLOduration=1.762801654 podStartE2EDuration="1.762801654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:42:26.762365017 +0000 UTC m=+1548.158314449" watchObservedRunningTime="2026-09-08 14:42:26.762801654 +0000 UTC m=+1548.158751086"
Sep 08 14:42:37.755056 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:37.755021    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"
Sep 08 14:42:41.848904 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:41.848870    2564 generic.go:356] "Generic (PLEG): container finished" podID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerID="a18899725e661100d401edf1de17fd1de9497fdc8ccaf8e99f433aaac59340ee" exitCode=0
Sep 08 14:42:41.849344 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:41.848942    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" event={"ID":"67430652-9b1f-49ec-a929-4c99e3d1f836","Type":"ContainerDied","Data":"a18899725e661100d401edf1de17fd1de9497fdc8ccaf8e99f433aaac59340ee"}
Sep 08 14:42:41.849392 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:41.849346    2564 scope.go:117] "RemoveContainer" containerID="a18899725e661100d401edf1de17fd1de9497fdc8ccaf8e99f433aaac59340ee"
Sep 08 14:42:41.850434 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:41.850404    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:42:41.850574 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:41.850478    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:42:41.850574 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:41.850527    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:42:42.864354 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:42.864312    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" event={"ID":"67430652-9b1f-49ec-a929-4c99e3d1f836","Type":"ContainerStarted","Data":"d58226bbfdf9e4c1b195e8984d7bb1e006e128167ab9230c003deadbbaa83027"}
Sep 08 14:42:43.110395 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:43.110339    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:43.110890 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:43.110856    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 08 14:42:43.110985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:43.110922    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 08 14:42:44.110867 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:44.110812    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 08 14:42:44.111409 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:44.110894    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 08 14:42:45.110657 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:45.110606    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 08 14:42:45.110888 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:45.110699    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 08 14:42:46.110963 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:46.110921    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 08 14:42:46.111576 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:46.111544    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 08 14:42:47.111479 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:47.111424    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Sep 08 14:42:47.112010 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:47.111541    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Sep 08 14:42:48.114634 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:48.114602    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:48.115014 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:48.114876    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:42:48.115616 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:42:48.115597    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:43:31.844144 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:31.844061    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h_c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc/payload-processing/0.log"
Sep 08 14:43:32.695534 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.695486    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"]
Sep 08 14:43:32.702580 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.702553    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.705367 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.705339    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-6b7995-openshift-default-dockercfg-fr7lm\""
Sep 08 14:43:32.709427 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.709399    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"]
Sep 08 14:43:32.769598 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.769569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5473e5d-a370-433c-ba23-70d96af21793-istio-podinfo\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.769745 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.769608    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-credential-socket\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.769745 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.769642    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bgxr\" (UniqueName: \"kubernetes.io/projected/e5473e5d-a370-433c-ba23-70d96af21793-kube-api-access-5bgxr\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.769836 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.769749    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5473e5d-a370-433c-ba23-70d96af21793-istio-token\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.769836 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.769806    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-workload-socket\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.769915 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.769847    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-istio-envoy\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.769915 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.769875    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-workload-certs\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.770010 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.769913    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5473e5d-a370-433c-ba23-70d96af21793-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.770010 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.769958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-istio-data\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.870593 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.870559    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bgxr\" (UniqueName: \"kubernetes.io/projected/e5473e5d-a370-433c-ba23-70d96af21793-kube-api-access-5bgxr\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.870593 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.870599    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5473e5d-a370-433c-ba23-70d96af21793-istio-token\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.871123 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.870628    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-workload-socket\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.871123 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.870665    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-istio-envoy\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.871123 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.870694    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-workload-certs\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.871123 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.870729    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5473e5d-a370-433c-ba23-70d96af21793-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.871123 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.870768    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-istio-data\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.871123 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.870805    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5473e5d-a370-433c-ba23-70d96af21793-istio-podinfo\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.871123 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.870860    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-credential-socket\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.871123 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.871104    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-workload-socket\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.871585 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.871288    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-istio-data\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.871585 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.871375    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-workload-certs\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.871585 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.871544    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5473e5d-a370-433c-ba23-70d96af21793-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.871749 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.871650    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-credential-socket\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.873221 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.873197    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-istio-envoy\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.873376 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.873360    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5473e5d-a370-433c-ba23-70d96af21793-istio-podinfo\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.879346 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.879318    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5473e5d-a370-433c-ba23-70d96af21793-istio-token\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:32.879475 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:32.879452    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bgxr\" (UniqueName: \"kubernetes.io/projected/e5473e5d-a370-433c-ba23-70d96af21793-kube-api-access-5bgxr\") pod \"e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") " pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:33.016442 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:33.016347    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:33.299944 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:33.299915    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"]
Sep 08 14:43:33.302809 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:43:33.302776    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5473e5d_a370_433c_ba23_70d96af21793.slice/crio-70343c39a87f0102fa168f6fa9c81605a3b0a1f1ebff0d61b994ec515f0e0aa5 WatchSource:0}: Error finding container 70343c39a87f0102fa168f6fa9c81605a3b0a1f1ebff0d61b994ec515f0e0aa5: Status 404 returned error can't find the container with id 70343c39a87f0102fa168f6fa9c81605a3b0a1f1ebff0d61b994ec515f0e0aa5
Sep 08 14:43:33.305542 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:33.305486    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:43:33.305659 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:33.305576    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:43:33.305659 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:33.305612    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:43:34.138288 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:34.138247    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" event={"ID":"e5473e5d-a370-433c-ba23-70d96af21793","Type":"ContainerStarted","Data":"f8a89512b4300d26bee21840a835467891c8495c6f61b5513e592c4e6374f092"}
Sep 08 14:43:34.138686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:34.138313    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" event={"ID":"e5473e5d-a370-433c-ba23-70d96af21793","Type":"ContainerStarted","Data":"70343c39a87f0102fa168f6fa9c81605a3b0a1f1ebff0d61b994ec515f0e0aa5"}
Sep 08 14:43:34.161295 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:34.161243    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" podStartSLOduration=2.161227608 podStartE2EDuration="2.161227608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:43:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:43:34.158465923 +0000 UTC m=+1615.554415354" watchObservedRunningTime="2026-09-08 14:43:34.161227608 +0000 UTC m=+1615.557177040"
Sep 08 14:43:35.016669 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:35.016634    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:35.022013 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:35.021987    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:35.143968 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:35.143935    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:35.144812 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:35.144793    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:38.019406 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:38.019365    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"]
Sep 08 14:43:38.023090 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:38.023072    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"
Sep 08 14:43:38.025517 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:38.025471    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-6b7995\""
Sep 08 14:43:38.025617 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:38.025524    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-6b7995-dockercfg-2nwbp\""
Sep 08 14:43:38.033166 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:38.033141    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"]
Sep 08 14:43:38.123572 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:38.123534    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2m7v\" (UniqueName: \"kubernetes.io/projected/f861bd3d-6ec0-4a12-961b-251334b07362-kube-api-access-q2m7v\") pod \"payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d\" (UID: \"f861bd3d-6ec0-4a12-961b-251334b07362\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"
Sep 08 14:43:38.123950 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:38.123918    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f861bd3d-6ec0-4a12-961b-251334b07362-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d\" (UID: \"f861bd3d-6ec0-4a12-961b-251334b07362\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"
Sep 08 14:43:38.224652 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:38.224609    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f861bd3d-6ec0-4a12-961b-251334b07362-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d\" (UID: \"f861bd3d-6ec0-4a12-961b-251334b07362\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"
Sep 08 14:43:38.224826 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:38.224686    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2m7v\" (UniqueName: \"kubernetes.io/projected/f861bd3d-6ec0-4a12-961b-251334b07362-kube-api-access-q2m7v\") pod \"payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d\" (UID: \"f861bd3d-6ec0-4a12-961b-251334b07362\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"
Sep 08 14:43:38.225342 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:38.225321    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f861bd3d-6ec0-4a12-961b-251334b07362-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d\" (UID: \"f861bd3d-6ec0-4a12-961b-251334b07362\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"
Sep 08 14:43:38.233055 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:38.233021    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2m7v\" (UniqueName: \"kubernetes.io/projected/f861bd3d-6ec0-4a12-961b-251334b07362-kube-api-access-q2m7v\") pod \"payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d\" (UID: \"f861bd3d-6ec0-4a12-961b-251334b07362\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"
Sep 08 14:43:38.334339 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:38.334306    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"
Sep 08 14:43:38.604867 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:38.604840    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"]
Sep 08 14:43:38.606952 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:43:38.606921    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf861bd3d_6ec0_4a12_961b_251334b07362.slice/crio-590df25f1eed3919741fc62b3ec81d427512a8ca665aebcd68dc1f91ba263f94 WatchSource:0}: Error finding container 590df25f1eed3919741fc62b3ec81d427512a8ca665aebcd68dc1f91ba263f94: Status 404 returned error can't find the container with id 590df25f1eed3919741fc62b3ec81d427512a8ca665aebcd68dc1f91ba263f94
Sep 08 14:43:39.165563 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:39.165527    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d" event={"ID":"f861bd3d-6ec0-4a12-961b-251334b07362","Type":"ContainerStarted","Data":"556657801e4199f6e56e0de36017b093be37acd6f83d074afe469aa484dfb6d3"}
Sep 08 14:43:39.165958 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:39.165691    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"
Sep 08 14:43:39.165958 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:39.165722    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d" event={"ID":"f861bd3d-6ec0-4a12-961b-251334b07362","Type":"ContainerStarted","Data":"590df25f1eed3919741fc62b3ec81d427512a8ca665aebcd68dc1f91ba263f94"}
Sep 08 14:43:39.183845 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:39.183804    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d" podStartSLOduration=1.183786253 podStartE2EDuration="1.183786253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:43:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:43:39.181137918 +0000 UTC m=+1620.577087352" watchObservedRunningTime="2026-09-08 14:43:39.183786253 +0000 UTC m=+1620.579735685"
Sep 08 14:43:39.346088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:39.346057    2564 scope.go:117] "RemoveContainer" containerID="41af2fe146f9e0c154ac601722d5af839f50c0e11d61ed367c4811f00ae1c9ea"
Sep 08 14:43:50.172684 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:50.172648    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"
Sep 08 14:43:54.256145 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:54.256106    2564 generic.go:356] "Generic (PLEG): container finished" podID="e5473e5d-a370-433c-ba23-70d96af21793" containerID="f8a89512b4300d26bee21840a835467891c8495c6f61b5513e592c4e6374f092" exitCode=0
Sep 08 14:43:54.256588 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:54.256177    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" event={"ID":"e5473e5d-a370-433c-ba23-70d96af21793","Type":"ContainerDied","Data":"f8a89512b4300d26bee21840a835467891c8495c6f61b5513e592c4e6374f092"}
Sep 08 14:43:54.256588 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:54.256546    2564 scope.go:117] "RemoveContainer" containerID="f8a89512b4300d26bee21840a835467891c8495c6f61b5513e592c4e6374f092"
Sep 08 14:43:54.257663 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:54.257636    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:43:54.257722 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:54.257699    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:43:54.257764 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:54.257735    2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Sep 08 14:43:55.263473 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:55.263443    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" event={"ID":"e5473e5d-a370-433c-ba23-70d96af21793","Type":"ContainerStarted","Data":"f8b13e13f83dfd98c1328d63ab51a4eab04a58b56d8bfa2d2e2a93e3b75a5ec0"}
Sep 08 14:43:56.017103 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:56.017057    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:43:56.017321 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:56.017183    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 08 14:43:56.017321 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:56.017239    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" podUID="e5473e5d-a370-433c-ba23-70d96af21793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 08 14:43:57.017608 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:57.017564    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 08 14:43:57.018105 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:57.017633    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" podUID="e5473e5d-a370-433c-ba23-70d96af21793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 08 14:43:58.017274 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:58.017232    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 08 14:43:58.017589 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:58.017557    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" podUID="e5473e5d-a370-433c-ba23-70d96af21793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 08 14:43:59.017414 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:59.017374    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 08 14:43:59.018019 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:43:59.017988    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" podUID="e5473e5d-a370-433c-ba23-70d96af21793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 08 14:44:00.017710 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:00.017666    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 08 14:44:00.018221 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:00.017748    2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" podUID="e5473e5d-a370-433c-ba23-70d96af21793" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 08 14:44:01.021586 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:01.021554    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:44:01.022011 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:01.021806    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:44:01.022458 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:01.022436    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:44:08.160039 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:08.160006    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"]
Sep 08 14:44:08.160439 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:08.160215    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d" podUID="f861bd3d-6ec0-4a12-961b-251334b07362" containerName="payload-processing" containerID="cri-o://556657801e4199f6e56e0de36017b093be37acd6f83d074afe469aa484dfb6d3" gracePeriod=30
Sep 08 14:44:08.333372 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:08.333341    2564 generic.go:356] "Generic (PLEG): container finished" podID="f861bd3d-6ec0-4a12-961b-251334b07362" containerID="556657801e4199f6e56e0de36017b093be37acd6f83d074afe469aa484dfb6d3" exitCode=0
Sep 08 14:44:08.333491 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:08.333391    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d" event={"ID":"f861bd3d-6ec0-4a12-961b-251334b07362","Type":"ContainerDied","Data":"556657801e4199f6e56e0de36017b093be37acd6f83d074afe469aa484dfb6d3"}
Sep 08 14:44:08.425795 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:08.425771    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"
Sep 08 14:44:08.533154 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:08.533119    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2m7v\" (UniqueName: \"kubernetes.io/projected/f861bd3d-6ec0-4a12-961b-251334b07362-kube-api-access-q2m7v\") pod \"f861bd3d-6ec0-4a12-961b-251334b07362\" (UID: \"f861bd3d-6ec0-4a12-961b-251334b07362\") "
Sep 08 14:44:08.533322 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:08.533185    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f861bd3d-6ec0-4a12-961b-251334b07362-plugins-config-volume\") pod \"f861bd3d-6ec0-4a12-961b-251334b07362\" (UID: \"f861bd3d-6ec0-4a12-961b-251334b07362\") "
Sep 08 14:44:08.533554 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:08.533520    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f861bd3d-6ec0-4a12-961b-251334b07362-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f861bd3d-6ec0-4a12-961b-251334b07362" (UID: "f861bd3d-6ec0-4a12-961b-251334b07362"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:44:08.535311 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:08.535284    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f861bd3d-6ec0-4a12-961b-251334b07362-kube-api-access-q2m7v" (OuterVolumeSpecName: "kube-api-access-q2m7v") pod "f861bd3d-6ec0-4a12-961b-251334b07362" (UID: "f861bd3d-6ec0-4a12-961b-251334b07362"). InnerVolumeSpecName "kube-api-access-q2m7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:44:08.634155 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:08.634129    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2m7v\" (UniqueName: \"kubernetes.io/projected/f861bd3d-6ec0-4a12-961b-251334b07362-kube-api-access-q2m7v\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:44:08.634155 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:08.634155    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f861bd3d-6ec0-4a12-961b-251334b07362-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:44:09.339688 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:09.339654    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d" event={"ID":"f861bd3d-6ec0-4a12-961b-251334b07362","Type":"ContainerDied","Data":"590df25f1eed3919741fc62b3ec81d427512a8ca665aebcd68dc1f91ba263f94"}
Sep 08 14:44:09.340079 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:09.339697    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"
Sep 08 14:44:09.340079 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:09.339740    2564 scope.go:117] "RemoveContainer" containerID="556657801e4199f6e56e0de36017b093be37acd6f83d074afe469aa484dfb6d3"
Sep 08 14:44:09.356788 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:09.356758    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"]
Sep 08 14:44:09.360884 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:09.360865    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-6b7995-56fb9bfdf9-hmw8d"]
Sep 08 14:44:11.185903 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:11.185860    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f861bd3d-6ec0-4a12-961b-251334b07362" path="/var/lib/kubelet/pods/f861bd3d-6ec0-4a12-961b-251334b07362/volumes"
Sep 08 14:44:15.310736 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:15.310702    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"]
Sep 08 14:44:15.311204 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:15.310937    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" podUID="e5473e5d-a370-433c-ba23-70d96af21793" containerName="istio-proxy" containerID="cri-o://f8b13e13f83dfd98c1328d63ab51a4eab04a58b56d8bfa2d2e2a93e3b75a5ec0" gracePeriod=30
Sep 08 14:44:16.024157 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:16.024120    2564 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:44:16.024323 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:16.024176    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" podUID="e5473e5d-a370-433c-ba23-70d96af21793" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:44:20.563080 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.563056    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:44:20.635784 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.635762    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-workload-certs\") pod \"e5473e5d-a370-433c-ba23-70d96af21793\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") "
Sep 08 14:44:20.635937 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.635795    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-workload-socket\") pod \"e5473e5d-a370-433c-ba23-70d96af21793\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") "
Sep 08 14:44:20.635937 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.635818    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5473e5d-a370-433c-ba23-70d96af21793-istio-podinfo\") pod \"e5473e5d-a370-433c-ba23-70d96af21793\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") "
Sep 08 14:44:20.635937 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.635858    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5473e5d-a370-433c-ba23-70d96af21793-istiod-ca-cert\") pod \"e5473e5d-a370-433c-ba23-70d96af21793\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") "
Sep 08 14:44:20.636126 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.635936    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-istio-envoy\") pod \"e5473e5d-a370-433c-ba23-70d96af21793\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") "
Sep 08 14:44:20.636126 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.635975    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-credential-socket\") pod \"e5473e5d-a370-433c-ba23-70d96af21793\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") "
Sep 08 14:44:20.636126 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.636009    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-istio-data\") pod \"e5473e5d-a370-433c-ba23-70d96af21793\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") "
Sep 08 14:44:20.636126 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.636037    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bgxr\" (UniqueName: \"kubernetes.io/projected/e5473e5d-a370-433c-ba23-70d96af21793-kube-api-access-5bgxr\") pod \"e5473e5d-a370-433c-ba23-70d96af21793\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") "
Sep 08 14:44:20.636126 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.636033    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e5473e5d-a370-433c-ba23-70d96af21793" (UID: "e5473e5d-a370-433c-ba23-70d96af21793"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:44:20.636126 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.636085    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5473e5d-a370-433c-ba23-70d96af21793-istio-token\") pod \"e5473e5d-a370-433c-ba23-70d96af21793\" (UID: \"e5473e5d-a370-433c-ba23-70d96af21793\") "
Sep 08 14:44:20.636126 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.636095    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e5473e5d-a370-433c-ba23-70d96af21793" (UID: "e5473e5d-a370-433c-ba23-70d96af21793"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:44:20.636471 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.636277    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-istio-data" (OuterVolumeSpecName: "istio-data") pod "e5473e5d-a370-433c-ba23-70d96af21793" (UID: "e5473e5d-a370-433c-ba23-70d96af21793"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:44:20.636471 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.636296    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e5473e5d-a370-433c-ba23-70d96af21793" (UID: "e5473e5d-a370-433c-ba23-70d96af21793"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:44:20.636471 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.636340    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5473e5d-a370-433c-ba23-70d96af21793-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e5473e5d-a370-433c-ba23-70d96af21793" (UID: "e5473e5d-a370-433c-ba23-70d96af21793"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:44:20.636471 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.636415    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-credential-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:44:20.636471 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.636428    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-istio-data\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:44:20.636471 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.636444    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-workload-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:44:20.636471 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.636462    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-workload-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:44:20.638096 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.638063    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e5473e5d-a370-433c-ba23-70d96af21793-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e5473e5d-a370-433c-ba23-70d96af21793" (UID: "e5473e5d-a370-433c-ba23-70d96af21793"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:44:20.638215 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.638152    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5473e5d-a370-433c-ba23-70d96af21793-kube-api-access-5bgxr" (OuterVolumeSpecName: "kube-api-access-5bgxr") pod "e5473e5d-a370-433c-ba23-70d96af21793" (UID: "e5473e5d-a370-433c-ba23-70d96af21793"). InnerVolumeSpecName "kube-api-access-5bgxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:44:20.638215 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.638165    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e5473e5d-a370-433c-ba23-70d96af21793" (UID: "e5473e5d-a370-433c-ba23-70d96af21793"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:44:20.638315 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.638216    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5473e5d-a370-433c-ba23-70d96af21793-istio-token" (OuterVolumeSpecName: "istio-token") pod "e5473e5d-a370-433c-ba23-70d96af21793" (UID: "e5473e5d-a370-433c-ba23-70d96af21793"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:44:20.737287 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.737255    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bgxr\" (UniqueName: \"kubernetes.io/projected/e5473e5d-a370-433c-ba23-70d96af21793-kube-api-access-5bgxr\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:44:20.737287 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.737286    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5473e5d-a370-433c-ba23-70d96af21793-istio-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:44:20.737287 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.737297    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5473e5d-a370-433c-ba23-70d96af21793-istio-podinfo\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:44:20.737451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.737305    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5473e5d-a370-433c-ba23-70d96af21793-istiod-ca-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:44:20.737451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:20.737313    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5473e5d-a370-433c-ba23-70d96af21793-istio-envoy\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:44:21.408021 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:21.401872    2564 generic.go:356] "Generic (PLEG): container finished" podID="e5473e5d-a370-433c-ba23-70d96af21793" containerID="f8b13e13f83dfd98c1328d63ab51a4eab04a58b56d8bfa2d2e2a93e3b75a5ec0" exitCode=0
Sep 08 14:44:21.408021 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:21.401936    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" event={"ID":"e5473e5d-a370-433c-ba23-70d96af21793","Type":"ContainerDied","Data":"f8b13e13f83dfd98c1328d63ab51a4eab04a58b56d8bfa2d2e2a93e3b75a5ec0"}
Sep 08 14:44:21.408021 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:21.402034    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2" event={"ID":"e5473e5d-a370-433c-ba23-70d96af21793","Type":"ContainerDied","Data":"70343c39a87f0102fa168f6fa9c81605a3b0a1f1ebff0d61b994ec515f0e0aa5"}
Sep 08 14:44:21.408021 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:21.402063    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"
Sep 08 14:44:21.408021 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:21.402077    2564 scope.go:117] "RemoveContainer" containerID="f8b13e13f83dfd98c1328d63ab51a4eab04a58b56d8bfa2d2e2a93e3b75a5ec0"
Sep 08 14:44:21.417338 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:21.417319    2564 scope.go:117] "RemoveContainer" containerID="f8a89512b4300d26bee21840a835467891c8495c6f61b5513e592c4e6374f092"
Sep 08 14:44:21.424349 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:21.424326    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"]
Sep 08 14:44:21.425351 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:21.425321    2564 scope.go:117] "RemoveContainer" containerID="f8b13e13f83dfd98c1328d63ab51a4eab04a58b56d8bfa2d2e2a93e3b75a5ec0"
Sep 08 14:44:21.425618 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:44:21.425596    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8b13e13f83dfd98c1328d63ab51a4eab04a58b56d8bfa2d2e2a93e3b75a5ec0\": container with ID starting with f8b13e13f83dfd98c1328d63ab51a4eab04a58b56d8bfa2d2e2a93e3b75a5ec0 not found: ID does not exist" containerID="f8b13e13f83dfd98c1328d63ab51a4eab04a58b56d8bfa2d2e2a93e3b75a5ec0"
Sep 08 14:44:21.425696 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:21.425623    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8b13e13f83dfd98c1328d63ab51a4eab04a58b56d8bfa2d2e2a93e3b75a5ec0"} err="failed to get container status \"f8b13e13f83dfd98c1328d63ab51a4eab04a58b56d8bfa2d2e2a93e3b75a5ec0\": rpc error: code = NotFound desc = could not find container \"f8b13e13f83dfd98c1328d63ab51a4eab04a58b56d8bfa2d2e2a93e3b75a5ec0\": container with ID starting with f8b13e13f83dfd98c1328d63ab51a4eab04a58b56d8bfa2d2e2a93e3b75a5ec0 not found: ID does not exist"
Sep 08 14:44:21.425696 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:21.425645    2564 scope.go:117] "RemoveContainer" containerID="f8a89512b4300d26bee21840a835467891c8495c6f61b5513e592c4e6374f092"
Sep 08 14:44:21.425894 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:44:21.425878    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8a89512b4300d26bee21840a835467891c8495c6f61b5513e592c4e6374f092\": container with ID starting with f8a89512b4300d26bee21840a835467891c8495c6f61b5513e592c4e6374f092 not found: ID does not exist" containerID="f8a89512b4300d26bee21840a835467891c8495c6f61b5513e592c4e6374f092"
Sep 08 14:44:21.425943 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:21.425900    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8a89512b4300d26bee21840a835467891c8495c6f61b5513e592c4e6374f092"} err="failed to get container status \"f8a89512b4300d26bee21840a835467891c8495c6f61b5513e592c4e6374f092\": rpc error: code = NotFound desc = could not find container \"f8a89512b4300d26bee21840a835467891c8495c6f61b5513e592c4e6374f092\": container with ID starting with f8a89512b4300d26bee21840a835467891c8495c6f61b5513e592c4e6374f092 not found: ID does not exist"
Sep 08 14:44:21.429087 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:21.429065    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b7995-openshift-default-5cb87ffdd4-dwgb2"]
Sep 08 14:44:23.185826 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:23.185796    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5473e5d-a370-433c-ba23-70d96af21793" path="/var/lib/kubelet/pods/e5473e5d-a370-433c-ba23-70d96af21793/volumes"
Sep 08 14:44:34.713275 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:34.713241    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"]
Sep 08 14:44:34.713766 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:34.713520    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h" podUID="c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc" containerName="payload-processing" containerID="cri-o://bdb42b4851b37ba14dd5455df44e016ed14b5af1d310b53b21a3ac1c19816341" gracePeriod=30
Sep 08 14:44:34.962217 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:34.962191    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"
Sep 08 14:44:35.060534 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.060417    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kg2sf\" (UniqueName: \"kubernetes.io/projected/c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc-kube-api-access-kg2sf\") pod \"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc\" (UID: \"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc\") "
Sep 08 14:44:35.060534 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.060457    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc-plugins-config-volume\") pod \"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc\" (UID: \"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc\") "
Sep 08 14:44:35.060850 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.060825    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc" (UID: "c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:44:35.062444 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.062418    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc-kube-api-access-kg2sf" (OuterVolumeSpecName: "kube-api-access-kg2sf") pod "c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc" (UID: "c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc"). InnerVolumeSpecName "kube-api-access-kg2sf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:44:35.162281 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.162209    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kg2sf\" (UniqueName: \"kubernetes.io/projected/c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc-kube-api-access-kg2sf\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:44:35.162281 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.162253    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:44:35.471654 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.471621    2564 generic.go:356] "Generic (PLEG): container finished" podID="c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc" containerID="bdb42b4851b37ba14dd5455df44e016ed14b5af1d310b53b21a3ac1c19816341" exitCode=0
Sep 08 14:44:35.471822 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.471667    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"
Sep 08 14:44:35.471822 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.471715    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h" event={"ID":"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc","Type":"ContainerDied","Data":"bdb42b4851b37ba14dd5455df44e016ed14b5af1d310b53b21a3ac1c19816341"}
Sep 08 14:44:35.471822 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.471765    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h" event={"ID":"c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc","Type":"ContainerDied","Data":"e44d441cb8b1818db445cd43eb5c525f649b3c4bff8ca031de3909c40ef7f738"}
Sep 08 14:44:35.471822 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.471789    2564 scope.go:117] "RemoveContainer" containerID="bdb42b4851b37ba14dd5455df44e016ed14b5af1d310b53b21a3ac1c19816341"
Sep 08 14:44:35.480088 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.480071    2564 scope.go:117] "RemoveContainer" containerID="bdb42b4851b37ba14dd5455df44e016ed14b5af1d310b53b21a3ac1c19816341"
Sep 08 14:44:35.480362 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:44:35.480344    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdb42b4851b37ba14dd5455df44e016ed14b5af1d310b53b21a3ac1c19816341\": container with ID starting with bdb42b4851b37ba14dd5455df44e016ed14b5af1d310b53b21a3ac1c19816341 not found: ID does not exist" containerID="bdb42b4851b37ba14dd5455df44e016ed14b5af1d310b53b21a3ac1c19816341"
Sep 08 14:44:35.480404 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.480372    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdb42b4851b37ba14dd5455df44e016ed14b5af1d310b53b21a3ac1c19816341"} err="failed to get container status \"bdb42b4851b37ba14dd5455df44e016ed14b5af1d310b53b21a3ac1c19816341\": rpc error: code = NotFound desc = could not find container \"bdb42b4851b37ba14dd5455df44e016ed14b5af1d310b53b21a3ac1c19816341\": container with ID starting with bdb42b4851b37ba14dd5455df44e016ed14b5af1d310b53b21a3ac1c19816341 not found: ID does not exist"
Sep 08 14:44:35.489906 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.489881    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"]
Sep 08 14:44:35.495297 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:35.495271    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-274ffa-54774b476f-2nc9h"]
Sep 08 14:44:37.185955 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:44:37.185925    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc" path="/var/lib/kubelet/pods/c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc/volumes"
Sep 08 14:45:00.147754 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.147714    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814645-bzlhc"]
Sep 08 14:45:00.148293 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.148273    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5473e5d-a370-433c-ba23-70d96af21793" containerName="istio-proxy"
Sep 08 14:45:00.148343 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.148298    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5473e5d-a370-433c-ba23-70d96af21793" containerName="istio-proxy"
Sep 08 14:45:00.148343 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.148330    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc" containerName="payload-processing"
Sep 08 14:45:00.148343 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.148339    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc" containerName="payload-processing"
Sep 08 14:45:00.148445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.148356    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f861bd3d-6ec0-4a12-961b-251334b07362" containerName="payload-processing"
Sep 08 14:45:00.148445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.148364    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f861bd3d-6ec0-4a12-961b-251334b07362" containerName="payload-processing"
Sep 08 14:45:00.148528 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.148453    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5473e5d-a370-433c-ba23-70d96af21793" containerName="istio-proxy"
Sep 08 14:45:00.148528 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.148465    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5473e5d-a370-433c-ba23-70d96af21793" containerName="istio-proxy"
Sep 08 14:45:00.148528 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.148474    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f861bd3d-6ec0-4a12-961b-251334b07362" containerName="payload-processing"
Sep 08 14:45:00.148528 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.148484    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3129e5c-a8d0-4d5c-98c6-709c7a1af4fc" containerName="payload-processing"
Sep 08 14:45:00.151703 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.151678    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-780944-29814645-d7wvt"]
Sep 08 14:45:00.151840 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.151784    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-bzlhc"
Sep 08 14:45:00.152002 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.151986    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5473e5d-a370-433c-ba23-70d96af21793" containerName="istio-proxy"
Sep 08 14:45:00.152002 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.152002    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5473e5d-a370-433c-ba23-70d96af21793" containerName="istio-proxy"
Sep 08 14:45:00.154548 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.154524    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:45:00.154875 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.154858    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-780944-29814645-d7wvt"
Sep 08 14:45:00.163149 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.163115    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-780944-29814645-d7wvt"]
Sep 08 14:45:00.163713 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.163695    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-bzlhc"
Sep 08 14:45:00.165719 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.165693    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814645-bzlhc"]
Sep 08 14:45:00.172222 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.172203    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-780944-29814645-d7wvt"
Sep 08 14:45:00.446363 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.446337    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814645-bzlhc"]
Sep 08 14:45:00.448844 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:45:00.448815    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d73bd95_8cf2_4a56_894c_dfbc07eecc9d.slice/crio-911add900952e60baf3f39462b14746379cd8e6a35ce41b31046aaec8bcb5db3 WatchSource:0}: Error finding container 911add900952e60baf3f39462b14746379cd8e6a35ce41b31046aaec8bcb5db3: Status 404 returned error can't find the container with id 911add900952e60baf3f39462b14746379cd8e6a35ce41b31046aaec8bcb5db3
Sep 08 14:45:00.461519 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.461486    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-780944-29814645-d7wvt"]
Sep 08 14:45:00.464616 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:45:00.464585    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b98f5b_3b75_46c6_be54_55103c42258c.slice/crio-48c076c6f9c4e7302ecea4607c10cb27caf36bd54a79017712b1f27f29c592c7 WatchSource:0}: Error finding container 48c076c6f9c4e7302ecea4607c10cb27caf36bd54a79017712b1f27f29c592c7: Status 404 returned error can't find the container with id 48c076c6f9c4e7302ecea4607c10cb27caf36bd54a79017712b1f27f29c592c7
Sep 08 14:45:00.603136 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.603052    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-780944-29814645-d7wvt" event={"ID":"76b98f5b-3b75-46c6-be54-55103c42258c","Type":"ContainerStarted","Data":"48c076c6f9c4e7302ecea4607c10cb27caf36bd54a79017712b1f27f29c592c7"}
Sep 08 14:45:00.604848 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:00.604783    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-bzlhc" event={"ID":"4d73bd95-8cf2-4a56-894c-dfbc07eecc9d","Type":"ContainerStarted","Data":"911add900952e60baf3f39462b14746379cd8e6a35ce41b31046aaec8bcb5db3"}
Sep 08 14:45:01.612948 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:01.612914    2564 generic.go:356] "Generic (PLEG): container finished" podID="76b98f5b-3b75-46c6-be54-55103c42258c" containerID="fd06fbb58e9aae78ee5c4c86397ac48ccf1f30f8f12360d9d4db8bb01dc61ea1" exitCode=0
Sep 08 14:45:01.613450 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:01.613003    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-780944-29814645-d7wvt" event={"ID":"76b98f5b-3b75-46c6-be54-55103c42258c","Type":"ContainerDied","Data":"fd06fbb58e9aae78ee5c4c86397ac48ccf1f30f8f12360d9d4db8bb01dc61ea1"}
Sep 08 14:45:01.614719 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:01.614700    2564 generic.go:356] "Generic (PLEG): container finished" podID="4d73bd95-8cf2-4a56-894c-dfbc07eecc9d" containerID="92944423e7d8f6896573e7c7419eb202946fc22c4be1cfc740be6641f8eac03b" exitCode=0
Sep 08 14:45:01.614835 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:01.614736    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-bzlhc" event={"ID":"4d73bd95-8cf2-4a56-894c-dfbc07eecc9d","Type":"ContainerDied","Data":"92944423e7d8f6896573e7c7419eb202946fc22c4be1cfc740be6641f8eac03b"}
Sep 08 14:45:02.773695 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:02.773664    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-bzlhc"
Sep 08 14:45:02.776206 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:02.776187    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-780944-29814645-d7wvt"
Sep 08 14:45:03.625799 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:03.625766    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-bzlhc"
Sep 08 14:45:03.626030 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:03.625798    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814645-bzlhc" event={"ID":"4d73bd95-8cf2-4a56-894c-dfbc07eecc9d","Type":"ContainerDied","Data":"911add900952e60baf3f39462b14746379cd8e6a35ce41b31046aaec8bcb5db3"}
Sep 08 14:45:03.626030 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:03.625855    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="911add900952e60baf3f39462b14746379cd8e6a35ce41b31046aaec8bcb5db3"
Sep 08 14:45:03.627271 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:03.627250    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-780944-29814645-d7wvt" event={"ID":"76b98f5b-3b75-46c6-be54-55103c42258c","Type":"ContainerDied","Data":"48c076c6f9c4e7302ecea4607c10cb27caf36bd54a79017712b1f27f29c592c7"}
Sep 08 14:45:03.627271 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:03.627264    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-780944-29814645-d7wvt"
Sep 08 14:45:03.627430 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:03.627286    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48c076c6f9c4e7302ecea4607c10cb27caf36bd54a79017712b1f27f29c592c7"
Sep 08 14:45:24.762787 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.762752    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c"]
Sep 08 14:45:24.763159 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.763098    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d73bd95-8cf2-4a56-894c-dfbc07eecc9d" containerName="cleanup"
Sep 08 14:45:24.763159 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.763110    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d73bd95-8cf2-4a56-894c-dfbc07eecc9d" containerName="cleanup"
Sep 08 14:45:24.763159 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.763120    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76b98f5b-3b75-46c6-be54-55103c42258c" containerName="cleanup"
Sep 08 14:45:24.763159 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.763125    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="76b98f5b-3b75-46c6-be54-55103c42258c" containerName="cleanup"
Sep 08 14:45:24.763294 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.763194    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="76b98f5b-3b75-46c6-be54-55103c42258c" containerName="cleanup"
Sep 08 14:45:24.763294 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.763202    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d73bd95-8cf2-4a56-894c-dfbc07eecc9d" containerName="cleanup"
Sep 08 14:45:24.766417 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.766395    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c"
Sep 08 14:45:24.769049 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.769026    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:45:24.769151 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.769028    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:45:24.774366 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.774343    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c"]
Sep 08 14:45:24.869049 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.869010    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7c9810-98e9-4029-8532-a5c7fadb0516-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c\" (UID: \"1c7c9810-98e9-4029-8532-a5c7fadb0516\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c"
Sep 08 14:45:24.970095 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.970062    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7c9810-98e9-4029-8532-a5c7fadb0516-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c\" (UID: \"1c7c9810-98e9-4029-8532-a5c7fadb0516\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c"
Sep 08 14:45:24.970673 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:24.970652    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7c9810-98e9-4029-8532-a5c7fadb0516-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c\" (UID: \"1c7c9810-98e9-4029-8532-a5c7fadb0516\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c"
Sep 08 14:45:25.078135 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:25.078103    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c"
Sep 08 14:45:25.349859 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:25.349832    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c"]
Sep 08 14:45:25.351177 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:45:25.351150    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c7c9810_98e9_4029_8532_a5c7fadb0516.slice/crio-e1d2c293c31154f88ba980297629adeb99f4dacb47f6dc52f84f9cc6a3852a5c WatchSource:0}: Error finding container e1d2c293c31154f88ba980297629adeb99f4dacb47f6dc52f84f9cc6a3852a5c: Status 404 returned error can't find the container with id e1d2c293c31154f88ba980297629adeb99f4dacb47f6dc52f84f9cc6a3852a5c
Sep 08 14:45:25.738311 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:25.738210    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c" event={"ID":"1c7c9810-98e9-4029-8532-a5c7fadb0516","Type":"ContainerStarted","Data":"000508a626e507d8b86dd9d7b2695e96419c855e153580aac884c2bd407b8988"}
Sep 08 14:45:25.738311 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:25.738277    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c" event={"ID":"1c7c9810-98e9-4029-8532-a5c7fadb0516","Type":"ContainerStarted","Data":"e1d2c293c31154f88ba980297629adeb99f4dacb47f6dc52f84f9cc6a3852a5c"}
Sep 08 14:45:25.754713 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:25.754666    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c" podStartSLOduration=1.754650313 podStartE2EDuration="1.754650313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:45:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:45:25.752603799 +0000 UTC m=+1727.148553230" watchObservedRunningTime="2026-09-08 14:45:25.754650313 +0000 UTC m=+1727.150599744"
Sep 08 14:45:26.744465 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:26.744435    2564 generic.go:356] "Generic (PLEG): container finished" podID="1c7c9810-98e9-4029-8532-a5c7fadb0516" containerID="000508a626e507d8b86dd9d7b2695e96419c855e153580aac884c2bd407b8988" exitCode=0
Sep 08 14:45:26.744870 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:26.744490    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c" event={"ID":"1c7c9810-98e9-4029-8532-a5c7fadb0516","Type":"ContainerDied","Data":"000508a626e507d8b86dd9d7b2695e96419c855e153580aac884c2bd407b8988"}
Sep 08 14:45:27.881705 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:27.881679    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c"
Sep 08 14:45:27.998805 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:27.998766    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7c9810-98e9-4029-8532-a5c7fadb0516-maas-api-service-ca\") pod \"1c7c9810-98e9-4029-8532-a5c7fadb0516\" (UID: \"1c7c9810-98e9-4029-8532-a5c7fadb0516\") "
Sep 08 14:45:27.999144 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:27.999118    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c7c9810-98e9-4029-8532-a5c7fadb0516-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1c7c9810-98e9-4029-8532-a5c7fadb0516" (UID: "1c7c9810-98e9-4029-8532-a5c7fadb0516"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:45:28.099886 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:28.099841    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1c7c9810-98e9-4029-8532-a5c7fadb0516-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:28.758384 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:28.758354    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c"
Sep 08 14:45:28.758571 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:28.758391    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c" event={"ID":"1c7c9810-98e9-4029-8532-a5c7fadb0516","Type":"ContainerDied","Data":"e1d2c293c31154f88ba980297629adeb99f4dacb47f6dc52f84f9cc6a3852a5c"}
Sep 08 14:45:28.758571 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:28.758438    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1d2c293c31154f88ba980297629adeb99f4dacb47f6dc52f84f9cc6a3852a5c"
Sep 08 14:45:35.329393 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.329359    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"]
Sep 08 14:45:35.329979 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.329663    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr" podUID="200a8257-dfc5-42c8-a114-6acdfabc245a" containerName="payload-pre-processing" containerID="cri-o://9e81e24b8306d9df355ec808bd06f38bbc50a8c731690f77bbfbdfb018a6d45f" gracePeriod=30
Sep 08 14:45:35.554959 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.554925    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c"]
Sep 08 14:45:35.557988 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.557958    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f7d00a-cb84c"]
Sep 08 14:45:35.587112 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.587059    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"
Sep 08 14:45:35.670881 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.670842    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200a8257-dfc5-42c8-a114-6acdfabc245a-plugins-config-volume\") pod \"200a8257-dfc5-42c8-a114-6acdfabc245a\" (UID: \"200a8257-dfc5-42c8-a114-6acdfabc245a\") "
Sep 08 14:45:35.671067 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.670920    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfg84\" (UniqueName: \"kubernetes.io/projected/200a8257-dfc5-42c8-a114-6acdfabc245a-kube-api-access-xfg84\") pod \"200a8257-dfc5-42c8-a114-6acdfabc245a\" (UID: \"200a8257-dfc5-42c8-a114-6acdfabc245a\") "
Sep 08 14:45:35.671301 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.671274    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/200a8257-dfc5-42c8-a114-6acdfabc245a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "200a8257-dfc5-42c8-a114-6acdfabc245a" (UID: "200a8257-dfc5-42c8-a114-6acdfabc245a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:45:35.673049 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.673031    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/200a8257-dfc5-42c8-a114-6acdfabc245a-kube-api-access-xfg84" (OuterVolumeSpecName: "kube-api-access-xfg84") pod "200a8257-dfc5-42c8-a114-6acdfabc245a" (UID: "200a8257-dfc5-42c8-a114-6acdfabc245a"). InnerVolumeSpecName "kube-api-access-xfg84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:45:35.771874 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.771838    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfg84\" (UniqueName: \"kubernetes.io/projected/200a8257-dfc5-42c8-a114-6acdfabc245a-kube-api-access-xfg84\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:35.771874 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.771864    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/200a8257-dfc5-42c8-a114-6acdfabc245a-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:35.797406 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.797368    2564 generic.go:356] "Generic (PLEG): container finished" podID="200a8257-dfc5-42c8-a114-6acdfabc245a" containerID="9e81e24b8306d9df355ec808bd06f38bbc50a8c731690f77bbfbdfb018a6d45f" exitCode=0
Sep 08 14:45:35.797590 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.797413    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr" event={"ID":"200a8257-dfc5-42c8-a114-6acdfabc245a","Type":"ContainerDied","Data":"9e81e24b8306d9df355ec808bd06f38bbc50a8c731690f77bbfbdfb018a6d45f"}
Sep 08 14:45:35.797590 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.797425    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"
Sep 08 14:45:35.797590 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.797464    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr" event={"ID":"200a8257-dfc5-42c8-a114-6acdfabc245a","Type":"ContainerDied","Data":"6ef7c9ed35cf0e720ee23e9da3f517d22879ea35d9583c1531053851ea7e5700"}
Sep 08 14:45:35.797590 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.797526    2564 scope.go:117] "RemoveContainer" containerID="9e81e24b8306d9df355ec808bd06f38bbc50a8c731690f77bbfbdfb018a6d45f"
Sep 08 14:45:35.807451 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.807432    2564 scope.go:117] "RemoveContainer" containerID="9e81e24b8306d9df355ec808bd06f38bbc50a8c731690f77bbfbdfb018a6d45f"
Sep 08 14:45:35.807788 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:45:35.807769    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e81e24b8306d9df355ec808bd06f38bbc50a8c731690f77bbfbdfb018a6d45f\": container with ID starting with 9e81e24b8306d9df355ec808bd06f38bbc50a8c731690f77bbfbdfb018a6d45f not found: ID does not exist" containerID="9e81e24b8306d9df355ec808bd06f38bbc50a8c731690f77bbfbdfb018a6d45f"
Sep 08 14:45:35.807861 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.807802    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e81e24b8306d9df355ec808bd06f38bbc50a8c731690f77bbfbdfb018a6d45f"} err="failed to get container status \"9e81e24b8306d9df355ec808bd06f38bbc50a8c731690f77bbfbdfb018a6d45f\": rpc error: code = NotFound desc = could not find container \"9e81e24b8306d9df355ec808bd06f38bbc50a8c731690f77bbfbdfb018a6d45f\": container with ID starting with 9e81e24b8306d9df355ec808bd06f38bbc50a8c731690f77bbfbdfb018a6d45f not found: ID does not exist"
Sep 08 14:45:35.821794 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.821763    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"]
Sep 08 14:45:35.826744 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:35.826717    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-f7d00a-7d9789bc6b-mt5dr"]
Sep 08 14:45:37.185353 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:37.185320    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c7c9810-98e9-4029-8532-a5c7fadb0516" path="/var/lib/kubelet/pods/1c7c9810-98e9-4029-8532-a5c7fadb0516/volumes"
Sep 08 14:45:37.185752 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:37.185688    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="200a8257-dfc5-42c8-a114-6acdfabc245a" path="/var/lib/kubelet/pods/200a8257-dfc5-42c8-a114-6acdfabc245a/volumes"
Sep 08 14:45:42.864589 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:42.864551    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"]
Sep 08 14:45:42.864999 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:42.864759    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerName="istio-proxy" containerID="cri-o://d58226bbfdf9e4c1b195e8984d7bb1e006e128167ab9230c003deadbbaa83027" gracePeriod=30
Sep 08 14:45:48.122052 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.122019    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:45:48.182581 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.182478    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-podinfo\") pod \"67430652-9b1f-49ec-a929-4c99e3d1f836\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") "
Sep 08 14:45:48.182581 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.182575    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-token\") pod \"67430652-9b1f-49ec-a929-4c99e3d1f836\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") "
Sep 08 14:45:48.182797 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.182596    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdct2\" (UniqueName: \"kubernetes.io/projected/67430652-9b1f-49ec-a929-4c99e3d1f836-kube-api-access-cdct2\") pod \"67430652-9b1f-49ec-a929-4c99e3d1f836\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") "
Sep 08 14:45:48.182797 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.182617    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-credential-socket\") pod \"67430652-9b1f-49ec-a929-4c99e3d1f836\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") "
Sep 08 14:45:48.182797 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.182640    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67430652-9b1f-49ec-a929-4c99e3d1f836-istiod-ca-cert\") pod \"67430652-9b1f-49ec-a929-4c99e3d1f836\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") "
Sep 08 14:45:48.182797 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.182656    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-workload-certs\") pod \"67430652-9b1f-49ec-a929-4c99e3d1f836\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") "
Sep 08 14:45:48.182797 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.182690    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-workload-socket\") pod \"67430652-9b1f-49ec-a929-4c99e3d1f836\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") "
Sep 08 14:45:48.182797 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.182711    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-envoy\") pod \"67430652-9b1f-49ec-a929-4c99e3d1f836\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") "
Sep 08 14:45:48.182797 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.182765    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-data\") pod \"67430652-9b1f-49ec-a929-4c99e3d1f836\" (UID: \"67430652-9b1f-49ec-a929-4c99e3d1f836\") "
Sep 08 14:45:48.183132 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.182879    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67430652-9b1f-49ec-a929-4c99e3d1f836" (UID: "67430652-9b1f-49ec-a929-4c99e3d1f836"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:45:48.183132 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.183018    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-credential-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:48.183132 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.183092    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-data" (OuterVolumeSpecName: "istio-data") pod "67430652-9b1f-49ec-a929-4c99e3d1f836" (UID: "67430652-9b1f-49ec-a929-4c99e3d1f836"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:45:48.183132 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.183109    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67430652-9b1f-49ec-a929-4c99e3d1f836" (UID: "67430652-9b1f-49ec-a929-4c99e3d1f836"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:45:48.183343 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.183166    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67430652-9b1f-49ec-a929-4c99e3d1f836" (UID: "67430652-9b1f-49ec-a929-4c99e3d1f836"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:45:48.183343 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.183186    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67430652-9b1f-49ec-a929-4c99e3d1f836-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67430652-9b1f-49ec-a929-4c99e3d1f836" (UID: "67430652-9b1f-49ec-a929-4c99e3d1f836"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:45:48.184823 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.184797    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67430652-9b1f-49ec-a929-4c99e3d1f836-kube-api-access-cdct2" (OuterVolumeSpecName: "kube-api-access-cdct2") pod "67430652-9b1f-49ec-a929-4c99e3d1f836" (UID: "67430652-9b1f-49ec-a929-4c99e3d1f836"). InnerVolumeSpecName "kube-api-access-cdct2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:45:48.184942 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.184823    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-token" (OuterVolumeSpecName: "istio-token") pod "67430652-9b1f-49ec-a929-4c99e3d1f836" (UID: "67430652-9b1f-49ec-a929-4c99e3d1f836"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:45:48.185001 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.184959    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67430652-9b1f-49ec-a929-4c99e3d1f836" (UID: "67430652-9b1f-49ec-a929-4c99e3d1f836"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:45:48.185001 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.184964    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67430652-9b1f-49ec-a929-4c99e3d1f836" (UID: "67430652-9b1f-49ec-a929-4c99e3d1f836"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:45:48.283933 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.283904    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-podinfo\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:48.283933 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.283927    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:48.283933 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.283937    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdct2\" (UniqueName: \"kubernetes.io/projected/67430652-9b1f-49ec-a929-4c99e3d1f836-kube-api-access-cdct2\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:48.284150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.283946    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67430652-9b1f-49ec-a929-4c99e3d1f836-istiod-ca-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:48.284150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.283954    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-workload-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:48.284150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.283962    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-workload-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:48.284150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.283970    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-envoy\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:48.284150 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.283977    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67430652-9b1f-49ec-a929-4c99e3d1f836-istio-data\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:48.873802 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.873768    2564 generic.go:356] "Generic (PLEG): container finished" podID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerID="d58226bbfdf9e4c1b195e8984d7bb1e006e128167ab9230c003deadbbaa83027" exitCode=0
Sep 08 14:45:48.873973 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.873822    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"
Sep 08 14:45:48.873973 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.873856    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" event={"ID":"67430652-9b1f-49ec-a929-4c99e3d1f836","Type":"ContainerDied","Data":"d58226bbfdf9e4c1b195e8984d7bb1e006e128167ab9230c003deadbbaa83027"}
Sep 08 14:45:48.873973 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.873913    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" event={"ID":"67430652-9b1f-49ec-a929-4c99e3d1f836","Type":"ContainerDied","Data":"1d3e21afefcd884cc883fe19ff8b8189ed23026caee46fae7073f852f27261fc"}
Sep 08 14:45:48.873973 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.873943    2564 scope.go:117] "RemoveContainer" containerID="d58226bbfdf9e4c1b195e8984d7bb1e006e128167ab9230c003deadbbaa83027"
Sep 08 14:45:48.888483 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.888465    2564 scope.go:117] "RemoveContainer" containerID="a18899725e661100d401edf1de17fd1de9497fdc8ccaf8e99f433aaac59340ee"
Sep 08 14:45:48.896439 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.896417    2564 scope.go:117] "RemoveContainer" containerID="d58226bbfdf9e4c1b195e8984d7bb1e006e128167ab9230c003deadbbaa83027"
Sep 08 14:45:48.896765 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:45:48.896745    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d58226bbfdf9e4c1b195e8984d7bb1e006e128167ab9230c003deadbbaa83027\": container with ID starting with d58226bbfdf9e4c1b195e8984d7bb1e006e128167ab9230c003deadbbaa83027 not found: ID does not exist" containerID="d58226bbfdf9e4c1b195e8984d7bb1e006e128167ab9230c003deadbbaa83027"
Sep 08 14:45:48.896855 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.896779    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d58226bbfdf9e4c1b195e8984d7bb1e006e128167ab9230c003deadbbaa83027"} err="failed to get container status \"d58226bbfdf9e4c1b195e8984d7bb1e006e128167ab9230c003deadbbaa83027\": rpc error: code = NotFound desc = could not find container \"d58226bbfdf9e4c1b195e8984d7bb1e006e128167ab9230c003deadbbaa83027\": container with ID starting with d58226bbfdf9e4c1b195e8984d7bb1e006e128167ab9230c003deadbbaa83027 not found: ID does not exist"
Sep 08 14:45:48.896855 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.896803    2564 scope.go:117] "RemoveContainer" containerID="a18899725e661100d401edf1de17fd1de9497fdc8ccaf8e99f433aaac59340ee"
Sep 08 14:45:48.897099 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:45:48.897072    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a18899725e661100d401edf1de17fd1de9497fdc8ccaf8e99f433aaac59340ee\": container with ID starting with a18899725e661100d401edf1de17fd1de9497fdc8ccaf8e99f433aaac59340ee not found: ID does not exist" containerID="a18899725e661100d401edf1de17fd1de9497fdc8ccaf8e99f433aaac59340ee"
Sep 08 14:45:48.897154 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.897106    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a18899725e661100d401edf1de17fd1de9497fdc8ccaf8e99f433aaac59340ee"} err="failed to get container status \"a18899725e661100d401edf1de17fd1de9497fdc8ccaf8e99f433aaac59340ee\": rpc error: code = NotFound desc = could not find container \"a18899725e661100d401edf1de17fd1de9497fdc8ccaf8e99f433aaac59340ee\": container with ID starting with a18899725e661100d401edf1de17fd1de9497fdc8ccaf8e99f433aaac59340ee not found: ID does not exist"
Sep 08 14:45:48.900471 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.900450    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"]
Sep 08 14:45:48.905982 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:48.905957    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw"]
Sep 08 14:45:49.115462 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:49.115421    2564 patch_prober.go:28] interesting pod/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 14:45:49.115643 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:49.115485    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-f7d00a-openshift-default-7d8577dd68-t7wqw" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 14:45:49.186098 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:49.186024    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" path="/var/lib/kubelet/pods/67430652-9b1f-49ec-a929-4c99e3d1f836/volumes"
Sep 08 14:45:53.825867 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:53.825834    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-780944-29814645-d7wvt"]
Sep 08 14:45:53.830329 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:53.830304    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-780944-29814645-d7wvt"]
Sep 08 14:45:53.866305 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:53.866272    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"]
Sep 08 14:45:53.866536 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:53.866478    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f" podUID="a6bcda92-b6ee-4dc8-8724-f50fd2c170c0" containerName="payload-processing" containerID="cri-o://272d0b74598ec71968d6c72a9f9c6d3e747f34272fe5c4f2775aed87cc8c60ab" gracePeriod=30
Sep 08 14:45:53.875668 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:53.875630    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"]
Sep 08 14:45:53.875906 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:53.875869    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g" podUID="0157a639-00f2-4c2f-af08-0c4310b19a63" containerName="payload-pre-processing" containerID="cri-o://983b9fb57e02eed87fb13beaaf814dbcc1268d00b692743953edf05adaa3895a" gracePeriod=30
Sep 08 14:45:54.117350 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.117321    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"
Sep 08 14:45:54.147904 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.147878    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"
Sep 08 14:45:54.233464 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.233428    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0157a639-00f2-4c2f-af08-0c4310b19a63-plugins-config-volume\") pod \"0157a639-00f2-4c2f-af08-0c4310b19a63\" (UID: \"0157a639-00f2-4c2f-af08-0c4310b19a63\") "
Sep 08 14:45:54.233634 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.233486    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fwm42\" (UniqueName: \"kubernetes.io/projected/a6bcda92-b6ee-4dc8-8724-f50fd2c170c0-kube-api-access-fwm42\") pod \"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0\" (UID: \"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0\") "
Sep 08 14:45:54.233634 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.233562    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6bcda92-b6ee-4dc8-8724-f50fd2c170c0-plugins-config-volume\") pod \"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0\" (UID: \"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0\") "
Sep 08 14:45:54.233733 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.233636    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwk45\" (UniqueName: \"kubernetes.io/projected/0157a639-00f2-4c2f-af08-0c4310b19a63-kube-api-access-cwk45\") pod \"0157a639-00f2-4c2f-af08-0c4310b19a63\" (UID: \"0157a639-00f2-4c2f-af08-0c4310b19a63\") "
Sep 08 14:45:54.233880 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.233859    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0157a639-00f2-4c2f-af08-0c4310b19a63-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0157a639-00f2-4c2f-af08-0c4310b19a63" (UID: "0157a639-00f2-4c2f-af08-0c4310b19a63"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:45:54.233952 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.233891    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6bcda92-b6ee-4dc8-8724-f50fd2c170c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6bcda92-b6ee-4dc8-8724-f50fd2c170c0" (UID: "a6bcda92-b6ee-4dc8-8724-f50fd2c170c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:45:54.234005 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.233944    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0157a639-00f2-4c2f-af08-0c4310b19a63-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:54.235711 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.235685    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0157a639-00f2-4c2f-af08-0c4310b19a63-kube-api-access-cwk45" (OuterVolumeSpecName: "kube-api-access-cwk45") pod "0157a639-00f2-4c2f-af08-0c4310b19a63" (UID: "0157a639-00f2-4c2f-af08-0c4310b19a63"). InnerVolumeSpecName "kube-api-access-cwk45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:45:54.235804 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.235691    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6bcda92-b6ee-4dc8-8724-f50fd2c170c0-kube-api-access-fwm42" (OuterVolumeSpecName: "kube-api-access-fwm42") pod "a6bcda92-b6ee-4dc8-8724-f50fd2c170c0" (UID: "a6bcda92-b6ee-4dc8-8724-f50fd2c170c0"). InnerVolumeSpecName "kube-api-access-fwm42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:45:54.335363 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.335330    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwk45\" (UniqueName: \"kubernetes.io/projected/0157a639-00f2-4c2f-af08-0c4310b19a63-kube-api-access-cwk45\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:54.335363 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.335356    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwm42\" (UniqueName: \"kubernetes.io/projected/a6bcda92-b6ee-4dc8-8724-f50fd2c170c0-kube-api-access-fwm42\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:54.335363 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.335365    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6bcda92-b6ee-4dc8-8724-f50fd2c170c0-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:45:54.915532 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.915472    2564 generic.go:356] "Generic (PLEG): container finished" podID="0157a639-00f2-4c2f-af08-0c4310b19a63" containerID="983b9fb57e02eed87fb13beaaf814dbcc1268d00b692743953edf05adaa3895a" exitCode=0
Sep 08 14:45:54.915967 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.915544    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"
Sep 08 14:45:54.915967 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.915563    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g" event={"ID":"0157a639-00f2-4c2f-af08-0c4310b19a63","Type":"ContainerDied","Data":"983b9fb57e02eed87fb13beaaf814dbcc1268d00b692743953edf05adaa3895a"}
Sep 08 14:45:54.915967 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.915645    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g" event={"ID":"0157a639-00f2-4c2f-af08-0c4310b19a63","Type":"ContainerDied","Data":"78e9985dcde3726f38b8dd6d210d000822684ee9964572fede0a8a6433d52d52"}
Sep 08 14:45:54.915967 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.915669    2564 scope.go:117] "RemoveContainer" containerID="983b9fb57e02eed87fb13beaaf814dbcc1268d00b692743953edf05adaa3895a"
Sep 08 14:45:54.917099 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.917077    2564 generic.go:356] "Generic (PLEG): container finished" podID="a6bcda92-b6ee-4dc8-8724-f50fd2c170c0" containerID="272d0b74598ec71968d6c72a9f9c6d3e747f34272fe5c4f2775aed87cc8c60ab" exitCode=0
Sep 08 14:45:54.917171 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.917130    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f" event={"ID":"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0","Type":"ContainerDied","Data":"272d0b74598ec71968d6c72a9f9c6d3e747f34272fe5c4f2775aed87cc8c60ab"}
Sep 08 14:45:54.917171 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.917159    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"
Sep 08 14:45:54.917278 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.917165    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f" event={"ID":"a6bcda92-b6ee-4dc8-8724-f50fd2c170c0","Type":"ContainerDied","Data":"fe72ca626fc1f5edc7e4b7224aaa2f4c5b61d99ed57e4cecbb11a3bab25b270b"}
Sep 08 14:45:54.924537 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.924513    2564 scope.go:117] "RemoveContainer" containerID="983b9fb57e02eed87fb13beaaf814dbcc1268d00b692743953edf05adaa3895a"
Sep 08 14:45:54.924869 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:45:54.924843    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"983b9fb57e02eed87fb13beaaf814dbcc1268d00b692743953edf05adaa3895a\": container with ID starting with 983b9fb57e02eed87fb13beaaf814dbcc1268d00b692743953edf05adaa3895a not found: ID does not exist" containerID="983b9fb57e02eed87fb13beaaf814dbcc1268d00b692743953edf05adaa3895a"
Sep 08 14:45:54.924967 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.924879    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"983b9fb57e02eed87fb13beaaf814dbcc1268d00b692743953edf05adaa3895a"} err="failed to get container status \"983b9fb57e02eed87fb13beaaf814dbcc1268d00b692743953edf05adaa3895a\": rpc error: code = NotFound desc = could not find container \"983b9fb57e02eed87fb13beaaf814dbcc1268d00b692743953edf05adaa3895a\": container with ID starting with 983b9fb57e02eed87fb13beaaf814dbcc1268d00b692743953edf05adaa3895a not found: ID does not exist"
Sep 08 14:45:54.924967 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.924902    2564 scope.go:117] "RemoveContainer" containerID="272d0b74598ec71968d6c72a9f9c6d3e747f34272fe5c4f2775aed87cc8c60ab"
Sep 08 14:45:54.933297 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.933268    2564 scope.go:117] "RemoveContainer" containerID="272d0b74598ec71968d6c72a9f9c6d3e747f34272fe5c4f2775aed87cc8c60ab"
Sep 08 14:45:54.933579 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:45:54.933551    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"272d0b74598ec71968d6c72a9f9c6d3e747f34272fe5c4f2775aed87cc8c60ab\": container with ID starting with 272d0b74598ec71968d6c72a9f9c6d3e747f34272fe5c4f2775aed87cc8c60ab not found: ID does not exist" containerID="272d0b74598ec71968d6c72a9f9c6d3e747f34272fe5c4f2775aed87cc8c60ab"
Sep 08 14:45:54.933656 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.933588    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"272d0b74598ec71968d6c72a9f9c6d3e747f34272fe5c4f2775aed87cc8c60ab"} err="failed to get container status \"272d0b74598ec71968d6c72a9f9c6d3e747f34272fe5c4f2775aed87cc8c60ab\": rpc error: code = NotFound desc = could not find container \"272d0b74598ec71968d6c72a9f9c6d3e747f34272fe5c4f2775aed87cc8c60ab\": container with ID starting with 272d0b74598ec71968d6c72a9f9c6d3e747f34272fe5c4f2775aed87cc8c60ab not found: ID does not exist"
Sep 08 14:45:54.947197 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.947173    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"]
Sep 08 14:45:54.952457 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.952433    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-780944-69556c76c4-txz4g"]
Sep 08 14:45:54.963126 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.963100    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"]
Sep 08 14:45:54.965959 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:54.965939    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-780944-776546c6bc-htc7f"]
Sep 08 14:45:55.187097 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:55.187024    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0157a639-00f2-4c2f-af08-0c4310b19a63" path="/var/lib/kubelet/pods/0157a639-00f2-4c2f-af08-0c4310b19a63/volumes"
Sep 08 14:45:55.187376 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:55.187350    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76b98f5b-3b75-46c6-be54-55103c42258c" path="/var/lib/kubelet/pods/76b98f5b-3b75-46c6-be54-55103c42258c/volumes"
Sep 08 14:45:55.187767 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:45:55.187746    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6bcda92-b6ee-4dc8-8724-f50fd2c170c0" path="/var/lib/kubelet/pods/a6bcda92-b6ee-4dc8-8724-f50fd2c170c0/volumes"
Sep 08 14:46:01.465321 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.465285    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"]
Sep 08 14:46:01.465784 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.465556    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerName="istio-proxy" containerID="cri-o://a27ebccf86ce3a2b4e5427b1c9a1d5ca2ab795c4d04403affa7e1863fff0d329" gracePeriod=30
Sep 08 14:46:01.843983 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.843942    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv"]
Sep 08 14:46:01.844290 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844278    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="200a8257-dfc5-42c8-a114-6acdfabc245a" containerName="payload-pre-processing"
Sep 08 14:46:01.844336 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844292    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="200a8257-dfc5-42c8-a114-6acdfabc245a" containerName="payload-pre-processing"
Sep 08 14:46:01.844336 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844304    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0157a639-00f2-4c2f-af08-0c4310b19a63" containerName="payload-pre-processing"
Sep 08 14:46:01.844336 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844310    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0157a639-00f2-4c2f-af08-0c4310b19a63" containerName="payload-pre-processing"
Sep 08 14:46:01.844336 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844319    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerName="istio-proxy"
Sep 08 14:46:01.844336 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844325    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerName="istio-proxy"
Sep 08 14:46:01.844336 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844335    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6bcda92-b6ee-4dc8-8724-f50fd2c170c0" containerName="payload-processing"
Sep 08 14:46:01.844552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844340    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6bcda92-b6ee-4dc8-8724-f50fd2c170c0" containerName="payload-processing"
Sep 08 14:46:01.844552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844351    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerName="istio-proxy"
Sep 08 14:46:01.844552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844356    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerName="istio-proxy"
Sep 08 14:46:01.844552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844363    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c7c9810-98e9-4029-8532-a5c7fadb0516" containerName="revoke-keys"
Sep 08 14:46:01.844552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844368    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c7c9810-98e9-4029-8532-a5c7fadb0516" containerName="revoke-keys"
Sep 08 14:46:01.844552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844417    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="200a8257-dfc5-42c8-a114-6acdfabc245a" containerName="payload-pre-processing"
Sep 08 14:46:01.844552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844425    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0157a639-00f2-4c2f-af08-0c4310b19a63" containerName="payload-pre-processing"
Sep 08 14:46:01.844552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844431    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerName="istio-proxy"
Sep 08 14:46:01.844552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844436    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c7c9810-98e9-4029-8532-a5c7fadb0516" containerName="revoke-keys"
Sep 08 14:46:01.844552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844445    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6bcda92-b6ee-4dc8-8724-f50fd2c170c0" containerName="payload-processing"
Sep 08 14:46:01.844552 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.844451    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="67430652-9b1f-49ec-a929-4c99e3d1f836" containerName="istio-proxy"
Sep 08 14:46:01.849100 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.849073    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv"
Sep 08 14:46:01.851580 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.851548    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:46:01.851726 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.851605    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fddbb\""
Sep 08 14:46:01.855164 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.855137    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv"]
Sep 08 14:46:01.905531 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:01.905459    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62285336-dae7-48f7-9451-167f9dc4ed30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv\" (UID: \"62285336-dae7-48f7-9451-167f9dc4ed30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv"
Sep 08 14:46:02.005999 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:02.005956    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62285336-dae7-48f7-9451-167f9dc4ed30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv\" (UID: \"62285336-dae7-48f7-9451-167f9dc4ed30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv"
Sep 08 14:46:02.006587 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:02.006569    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62285336-dae7-48f7-9451-167f9dc4ed30-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv\" (UID: \"62285336-dae7-48f7-9451-167f9dc4ed30\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv"
Sep 08 14:46:02.161112 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:02.161011    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv"
Sep 08 14:46:02.431473 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:02.431385    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv"]
Sep 08 14:46:02.434514 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:46:02.434472    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62285336_dae7_48f7_9451_167f9dc4ed30.slice/crio-79556dda434ec72ba612bb08dff07fa3cda78bed14e93e8651a99221e32c1a22 WatchSource:0}: Error finding container 79556dda434ec72ba612bb08dff07fa3cda78bed14e93e8651a99221e32c1a22: Status 404 returned error can't find the container with id 79556dda434ec72ba612bb08dff07fa3cda78bed14e93e8651a99221e32c1a22
Sep 08 14:46:02.968835 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:02.968741    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv" event={"ID":"62285336-dae7-48f7-9451-167f9dc4ed30","Type":"ContainerStarted","Data":"622cacdf51a18058ca2f7a6b7146686571f9da1c657e2af39ba91e5194b71b2b"}
Sep 08 14:46:02.968835 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:02.968790    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv" event={"ID":"62285336-dae7-48f7-9451-167f9dc4ed30","Type":"ContainerStarted","Data":"79556dda434ec72ba612bb08dff07fa3cda78bed14e93e8651a99221e32c1a22"}
Sep 08 14:46:02.985346 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:02.985294    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv" podStartSLOduration=1.985278517 podStartE2EDuration="1.985278517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:46:02.982988445 +0000 UTC m=+1764.378937876" watchObservedRunningTime="2026-09-08 14:46:02.985278517 +0000 UTC m=+1764.381227990"
Sep 08 14:46:03.975207 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:03.975173    2564 generic.go:356] "Generic (PLEG): container finished" podID="62285336-dae7-48f7-9451-167f9dc4ed30" containerID="622cacdf51a18058ca2f7a6b7146686571f9da1c657e2af39ba91e5194b71b2b" exitCode=0
Sep 08 14:46:03.975643 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:03.975263    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv" event={"ID":"62285336-dae7-48f7-9451-167f9dc4ed30","Type":"ContainerDied","Data":"622cacdf51a18058ca2f7a6b7146686571f9da1c657e2af39ba91e5194b71b2b"}
Sep 08 14:46:04.401095 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:04.401058    2564 patch_prober.go:28] interesting pod/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 14:46:04.401266 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:04.401126    2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 14:46:05.101188 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:05.101164    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv"
Sep 08 14:46:05.235941 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:05.235855    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62285336-dae7-48f7-9451-167f9dc4ed30-maas-api-service-ca\") pod \"62285336-dae7-48f7-9451-167f9dc4ed30\" (UID: \"62285336-dae7-48f7-9451-167f9dc4ed30\") "
Sep 08 14:46:05.236257 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:05.236232    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62285336-dae7-48f7-9451-167f9dc4ed30-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "62285336-dae7-48f7-9451-167f9dc4ed30" (UID: "62285336-dae7-48f7-9451-167f9dc4ed30"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:46:05.236391 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:05.236373    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/62285336-dae7-48f7-9451-167f9dc4ed30-maas-api-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:46:05.986430 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:05.986386    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv" event={"ID":"62285336-dae7-48f7-9451-167f9dc4ed30","Type":"ContainerDied","Data":"79556dda434ec72ba612bb08dff07fa3cda78bed14e93e8651a99221e32c1a22"}
Sep 08 14:46:05.986430 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:05.986423    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv"
Sep 08 14:46:05.986430 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:05.986437    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79556dda434ec72ba612bb08dff07fa3cda78bed14e93e8651a99221e32c1a22"
Sep 08 14:46:06.723472 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.723449    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:46:06.849727 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.849697    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-token\") pod \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") "
Sep 08 14:46:06.849727 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.849732    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-podinfo\") pod \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") "
Sep 08 14:46:06.849991 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.849756    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpk5l\" (UniqueName: \"kubernetes.io/projected/eb42c5ac-6835-42c9-92eb-0d815baa67a5-kube-api-access-kpk5l\") pod \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") "
Sep 08 14:46:06.849991 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.849802    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-envoy\") pod \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") "
Sep 08 14:46:06.849991 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.849823    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istiod-ca-cert\") pod \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") "
Sep 08 14:46:06.849991 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.849935    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-credential-socket\") pod \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") "
Sep 08 14:46:06.850216 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.850015    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-workload-certs\") pod \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") "
Sep 08 14:46:06.850216 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.850074    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-workload-socket\") pod \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") "
Sep 08 14:46:06.850216 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.850134    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-data\") pod \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\" (UID: \"eb42c5ac-6835-42c9-92eb-0d815baa67a5\") "
Sep 08 14:46:06.850363 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.850307    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb42c5ac-6835-42c9-92eb-0d815baa67a5" (UID: "eb42c5ac-6835-42c9-92eb-0d815baa67a5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:46:06.850419 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.850397    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb42c5ac-6835-42c9-92eb-0d815baa67a5" (UID: "eb42c5ac-6835-42c9-92eb-0d815baa67a5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:46:06.851307 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.850480    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb42c5ac-6835-42c9-92eb-0d815baa67a5" (UID: "eb42c5ac-6835-42c9-92eb-0d815baa67a5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:46:06.851307 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.850591    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb42c5ac-6835-42c9-92eb-0d815baa67a5" (UID: "eb42c5ac-6835-42c9-92eb-0d815baa67a5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:46:06.851307 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.850579    2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istiod-ca-cert\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:46:06.851639 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.851335    2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-workload-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:46:06.851639 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.850687    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb42c5ac-6835-42c9-92eb-0d815baa67a5" (UID: "eb42c5ac-6835-42c9-92eb-0d815baa67a5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:46:06.852403 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.852373    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb42c5ac-6835-42c9-92eb-0d815baa67a5" (UID: "eb42c5ac-6835-42c9-92eb-0d815baa67a5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:46:06.852530 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.852422    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb42c5ac-6835-42c9-92eb-0d815baa67a5" (UID: "eb42c5ac-6835-42c9-92eb-0d815baa67a5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 14:46:06.852530 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.852447    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb42c5ac-6835-42c9-92eb-0d815baa67a5" (UID: "eb42c5ac-6835-42c9-92eb-0d815baa67a5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:46:06.852632 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.852618    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb42c5ac-6835-42c9-92eb-0d815baa67a5-kube-api-access-kpk5l" (OuterVolumeSpecName: "kube-api-access-kpk5l") pod "eb42c5ac-6835-42c9-92eb-0d815baa67a5" (UID: "eb42c5ac-6835-42c9-92eb-0d815baa67a5"). InnerVolumeSpecName "kube-api-access-kpk5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:46:06.952529 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.952478    2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-workload-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:46:06.952529 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.952531    2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-data\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:46:06.952709 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.952545    2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-token\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:46:06.952709 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.952553    2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-podinfo\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:46:06.952709 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.952561    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpk5l\" (UniqueName: \"kubernetes.io/projected/eb42c5ac-6835-42c9-92eb-0d815baa67a5-kube-api-access-kpk5l\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:46:06.952709 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.952570    2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-istio-envoy\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:46:06.952709 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.952579    2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb42c5ac-6835-42c9-92eb-0d815baa67a5-credential-socket\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:46:06.993034 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.993006    2564 generic.go:356] "Generic (PLEG): container finished" podID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerID="a27ebccf86ce3a2b4e5427b1c9a1d5ca2ab795c4d04403affa7e1863fff0d329" exitCode=0
Sep 08 14:46:06.993169 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.993054    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"
Sep 08 14:46:06.993169 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.993083    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" event={"ID":"eb42c5ac-6835-42c9-92eb-0d815baa67a5","Type":"ContainerDied","Data":"a27ebccf86ce3a2b4e5427b1c9a1d5ca2ab795c4d04403affa7e1863fff0d329"}
Sep 08 14:46:06.993169 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.993136    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss" event={"ID":"eb42c5ac-6835-42c9-92eb-0d815baa67a5","Type":"ContainerDied","Data":"be48848b70de93013c5f4e5a6334433f5b3d4f6c8afbb5cf19733c337df9743d"}
Sep 08 14:46:06.993169 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:06.993158    2564 scope.go:117] "RemoveContainer" containerID="a27ebccf86ce3a2b4e5427b1c9a1d5ca2ab795c4d04403affa7e1863fff0d329"
Sep 08 14:46:07.003203 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:07.003186    2564 scope.go:117] "RemoveContainer" containerID="e12693f38b290e3c73ff9513f0214cc282011ef2cf2c85b9c2074c5b8e6aed31"
Sep 08 14:46:07.012133 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:07.012114    2564 scope.go:117] "RemoveContainer" containerID="a27ebccf86ce3a2b4e5427b1c9a1d5ca2ab795c4d04403affa7e1863fff0d329"
Sep 08 14:46:07.012378 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:46:07.012360    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a27ebccf86ce3a2b4e5427b1c9a1d5ca2ab795c4d04403affa7e1863fff0d329\": container with ID starting with a27ebccf86ce3a2b4e5427b1c9a1d5ca2ab795c4d04403affa7e1863fff0d329 not found: ID does not exist" containerID="a27ebccf86ce3a2b4e5427b1c9a1d5ca2ab795c4d04403affa7e1863fff0d329"
Sep 08 14:46:07.012446 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:07.012384    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27ebccf86ce3a2b4e5427b1c9a1d5ca2ab795c4d04403affa7e1863fff0d329"} err="failed to get container status \"a27ebccf86ce3a2b4e5427b1c9a1d5ca2ab795c4d04403affa7e1863fff0d329\": rpc error: code = NotFound desc = could not find container \"a27ebccf86ce3a2b4e5427b1c9a1d5ca2ab795c4d04403affa7e1863fff0d329\": container with ID starting with a27ebccf86ce3a2b4e5427b1c9a1d5ca2ab795c4d04403affa7e1863fff0d329 not found: ID does not exist"
Sep 08 14:46:07.012446 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:07.012398    2564 scope.go:117] "RemoveContainer" containerID="e12693f38b290e3c73ff9513f0214cc282011ef2cf2c85b9c2074c5b8e6aed31"
Sep 08 14:46:07.012997 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:46:07.012977    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e12693f38b290e3c73ff9513f0214cc282011ef2cf2c85b9c2074c5b8e6aed31\": container with ID starting with e12693f38b290e3c73ff9513f0214cc282011ef2cf2c85b9c2074c5b8e6aed31 not found: ID does not exist" containerID="e12693f38b290e3c73ff9513f0214cc282011ef2cf2c85b9c2074c5b8e6aed31"
Sep 08 14:46:07.013049 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:07.013003    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e12693f38b290e3c73ff9513f0214cc282011ef2cf2c85b9c2074c5b8e6aed31"} err="failed to get container status \"e12693f38b290e3c73ff9513f0214cc282011ef2cf2c85b9c2074c5b8e6aed31\": rpc error: code = NotFound desc = could not find container \"e12693f38b290e3c73ff9513f0214cc282011ef2cf2c85b9c2074c5b8e6aed31\": container with ID starting with e12693f38b290e3c73ff9513f0214cc282011ef2cf2c85b9c2074c5b8e6aed31 not found: ID does not exist"
Sep 08 14:46:07.018445 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:07.018423    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"]
Sep 08 14:46:07.022989 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:07.022970    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-780944-openshift-default-69b987d84d-zb4ss"]
Sep 08 14:46:07.185891 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:07.185814    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" path="/var/lib/kubelet/pods/eb42c5ac-6835-42c9-92eb-0d815baa67a5/volumes"
Sep 08 14:46:12.422570 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:12.422534    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"]
Sep 08 14:46:12.423040 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:12.422862    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx" podUID="01aff066-92e2-4578-8242-2c1b53da0f26" containerName="payload-processing" containerID="cri-o://9763a0f7b6b067a96b7ec46d9dda99492b73003d6b2068c0575bb0cdef610b27" gracePeriod=30
Sep 08 14:46:12.637094 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:12.637065    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv"]
Sep 08 14:46:12.639768 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:12.639746    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-017dbd-vxjqv"]
Sep 08 14:46:12.677905 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:12.677857    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"
Sep 08 14:46:12.804051 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:12.804014    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01aff066-92e2-4578-8242-2c1b53da0f26-plugins-config-volume\") pod \"01aff066-92e2-4578-8242-2c1b53da0f26\" (UID: \"01aff066-92e2-4578-8242-2c1b53da0f26\") "
Sep 08 14:46:12.804252 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:12.804110    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gfqb\" (UniqueName: \"kubernetes.io/projected/01aff066-92e2-4578-8242-2c1b53da0f26-kube-api-access-5gfqb\") pod \"01aff066-92e2-4578-8242-2c1b53da0f26\" (UID: \"01aff066-92e2-4578-8242-2c1b53da0f26\") "
Sep 08 14:46:12.804444 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:12.804419    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01aff066-92e2-4578-8242-2c1b53da0f26-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "01aff066-92e2-4578-8242-2c1b53da0f26" (UID: "01aff066-92e2-4578-8242-2c1b53da0f26"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:46:12.806175 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:12.806153    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01aff066-92e2-4578-8242-2c1b53da0f26-kube-api-access-5gfqb" (OuterVolumeSpecName: "kube-api-access-5gfqb") pod "01aff066-92e2-4578-8242-2c1b53da0f26" (UID: "01aff066-92e2-4578-8242-2c1b53da0f26"). InnerVolumeSpecName "kube-api-access-5gfqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:46:12.904762 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:12.904726    2564 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/01aff066-92e2-4578-8242-2c1b53da0f26-plugins-config-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:46:12.904762 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:12.904756    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gfqb\" (UniqueName: \"kubernetes.io/projected/01aff066-92e2-4578-8242-2c1b53da0f26-kube-api-access-5gfqb\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:46:13.025319 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:13.025226    2564 generic.go:356] "Generic (PLEG): container finished" podID="01aff066-92e2-4578-8242-2c1b53da0f26" containerID="9763a0f7b6b067a96b7ec46d9dda99492b73003d6b2068c0575bb0cdef610b27" exitCode=0
Sep 08 14:46:13.025319 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:13.025268    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"
Sep 08 14:46:13.025319 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:13.025296    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx" event={"ID":"01aff066-92e2-4578-8242-2c1b53da0f26","Type":"ContainerDied","Data":"9763a0f7b6b067a96b7ec46d9dda99492b73003d6b2068c0575bb0cdef610b27"}
Sep 08 14:46:13.025689 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:13.025349    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx" event={"ID":"01aff066-92e2-4578-8242-2c1b53da0f26","Type":"ContainerDied","Data":"8f98674b3e2f6ec668619f2dad003d799ecf4807970df176bce570249be9a7d8"}
Sep 08 14:46:13.025689 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:13.025375    2564 scope.go:117] "RemoveContainer" containerID="9763a0f7b6b067a96b7ec46d9dda99492b73003d6b2068c0575bb0cdef610b27"
Sep 08 14:46:13.034115 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:13.034091    2564 scope.go:117] "RemoveContainer" containerID="9763a0f7b6b067a96b7ec46d9dda99492b73003d6b2068c0575bb0cdef610b27"
Sep 08 14:46:13.034370 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:46:13.034349    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9763a0f7b6b067a96b7ec46d9dda99492b73003d6b2068c0575bb0cdef610b27\": container with ID starting with 9763a0f7b6b067a96b7ec46d9dda99492b73003d6b2068c0575bb0cdef610b27 not found: ID does not exist" containerID="9763a0f7b6b067a96b7ec46d9dda99492b73003d6b2068c0575bb0cdef610b27"
Sep 08 14:46:13.034415 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:13.034378    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9763a0f7b6b067a96b7ec46d9dda99492b73003d6b2068c0575bb0cdef610b27"} err="failed to get container status \"9763a0f7b6b067a96b7ec46d9dda99492b73003d6b2068c0575bb0cdef610b27\": rpc error: code = NotFound desc = could not find container \"9763a0f7b6b067a96b7ec46d9dda99492b73003d6b2068c0575bb0cdef610b27\": container with ID starting with 9763a0f7b6b067a96b7ec46d9dda99492b73003d6b2068c0575bb0cdef610b27 not found: ID does not exist"
Sep 08 14:46:13.050724 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:13.050699    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"]
Sep 08 14:46:13.054148 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:13.054127    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-017dbd-6776dbd6d5-xv2mx"]
Sep 08 14:46:13.185879 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:13.185850    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01aff066-92e2-4578-8242-2c1b53da0f26" path="/var/lib/kubelet/pods/01aff066-92e2-4578-8242-2c1b53da0f26/volumes"
Sep 08 14:46:13.186190 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:46:13.186178    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62285336-dae7-48f7-9451-167f9dc4ed30" path="/var/lib/kubelet/pods/62285336-dae7-48f7-9451-167f9dc4ed30/volumes"
Sep 08 14:47:39.423356 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:47:39.423326    2564 scope.go:117] "RemoveContainer" containerID="b2f1cde98474c71b665b444b840b492661f5ea3fe43bf4c5facc1502fb5a7c2f"
Sep 08 14:47:39.432641 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:47:39.432624    2564 scope.go:117] "RemoveContainer" containerID="baeccde1c7d6ae2001668cba203d06316d91254788fb95c238940ed725ef43c0"
Sep 08 14:48:39.454916 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:48:39.454887    2564 scope.go:117] "RemoveContainer" containerID="8badbb318fa24b5b2cd81073d009d90c22214f2b73632c972eb68c42afa416c5"
Sep 08 14:48:59.232350 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:48:59.232312    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"]
Sep 08 14:48:59.234802 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:48:59.232530    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s" podUID="995d8121-cfb3-4ab5-9d6b-1b53e665f2ed" containerName="manager" containerID="cri-o://a85b1c5afe49c1b059fa2c20c2102e0cc34e2c95df8b4eaeecfed7e5be6b1139" gracePeriod=10
Sep 08 14:49:00.580591 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.580569    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"
Sep 08 14:49:00.646211 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.646183    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gj48g\" (UniqueName: \"kubernetes.io/projected/995d8121-cfb3-4ab5-9d6b-1b53e665f2ed-kube-api-access-gj48g\") pod \"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed\" (UID: \"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed\") "
Sep 08 14:49:00.646378 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.646222    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/995d8121-cfb3-4ab5-9d6b-1b53e665f2ed-extensions-socket-volume\") pod \"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed\" (UID: \"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed\") "
Sep 08 14:49:00.646675 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.646647    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995d8121-cfb3-4ab5-9d6b-1b53e665f2ed-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "995d8121-cfb3-4ab5-9d6b-1b53e665f2ed" (UID: "995d8121-cfb3-4ab5-9d6b-1b53e665f2ed"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:49:00.648244 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.648196    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995d8121-cfb3-4ab5-9d6b-1b53e665f2ed-kube-api-access-gj48g" (OuterVolumeSpecName: "kube-api-access-gj48g") pod "995d8121-cfb3-4ab5-9d6b-1b53e665f2ed" (UID: "995d8121-cfb3-4ab5-9d6b-1b53e665f2ed"). InnerVolumeSpecName "kube-api-access-gj48g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:49:00.747766 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.747737    2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/995d8121-cfb3-4ab5-9d6b-1b53e665f2ed-extensions-socket-volume\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:49:00.747766 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.747762    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gj48g\" (UniqueName: \"kubernetes.io/projected/995d8121-cfb3-4ab5-9d6b-1b53e665f2ed-kube-api-access-gj48g\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:49:00.815560 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.815528    2564 generic.go:356] "Generic (PLEG): container finished" podID="995d8121-cfb3-4ab5-9d6b-1b53e665f2ed" containerID="a85b1c5afe49c1b059fa2c20c2102e0cc34e2c95df8b4eaeecfed7e5be6b1139" exitCode=0
Sep 08 14:49:00.815691 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.815576    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"
Sep 08 14:49:00.815691 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.815606    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s" event={"ID":"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed","Type":"ContainerDied","Data":"a85b1c5afe49c1b059fa2c20c2102e0cc34e2c95df8b4eaeecfed7e5be6b1139"}
Sep 08 14:49:00.815691 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.815658    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s" event={"ID":"995d8121-cfb3-4ab5-9d6b-1b53e665f2ed","Type":"ContainerDied","Data":"db29ffc32fb9adecbf6287e183946422aadfbe66fdf96c2af1c1a46e2bb15437"}
Sep 08 14:49:00.815691 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.815679    2564 scope.go:117] "RemoveContainer" containerID="a85b1c5afe49c1b059fa2c20c2102e0cc34e2c95df8b4eaeecfed7e5be6b1139"
Sep 08 14:49:00.825652 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.825635    2564 scope.go:117] "RemoveContainer" containerID="a85b1c5afe49c1b059fa2c20c2102e0cc34e2c95df8b4eaeecfed7e5be6b1139"
Sep 08 14:49:00.825915 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:49:00.825897    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a85b1c5afe49c1b059fa2c20c2102e0cc34e2c95df8b4eaeecfed7e5be6b1139\": container with ID starting with a85b1c5afe49c1b059fa2c20c2102e0cc34e2c95df8b4eaeecfed7e5be6b1139 not found: ID does not exist" containerID="a85b1c5afe49c1b059fa2c20c2102e0cc34e2c95df8b4eaeecfed7e5be6b1139"
Sep 08 14:49:00.825965 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.825922    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a85b1c5afe49c1b059fa2c20c2102e0cc34e2c95df8b4eaeecfed7e5be6b1139"} err="failed to get container status \"a85b1c5afe49c1b059fa2c20c2102e0cc34e2c95df8b4eaeecfed7e5be6b1139\": rpc error: code = NotFound desc = could not find container \"a85b1c5afe49c1b059fa2c20c2102e0cc34e2c95df8b4eaeecfed7e5be6b1139\": container with ID starting with a85b1c5afe49c1b059fa2c20c2102e0cc34e2c95df8b4eaeecfed7e5be6b1139 not found: ID does not exist"
Sep 08 14:49:00.841768 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.841745    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"]
Sep 08 14:49:00.847407 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:00.847385    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-srr9s"]
Sep 08 14:49:01.190780 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:01.190745    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="995d8121-cfb3-4ab5-9d6b-1b53e665f2ed" path="/var/lib/kubelet/pods/995d8121-cfb3-4ab5-9d6b-1b53e665f2ed/volumes"
Sep 08 14:49:59.979979 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.979935    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf"]
Sep 08 14:49:59.980560 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.980388    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerName="istio-proxy"
Sep 08 14:49:59.980560 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.980408    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerName="istio-proxy"
Sep 08 14:49:59.980560 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.980422    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62285336-dae7-48f7-9451-167f9dc4ed30" containerName="revoke-keys"
Sep 08 14:49:59.980560 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.980431    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="62285336-dae7-48f7-9451-167f9dc4ed30" containerName="revoke-keys"
Sep 08 14:49:59.980560 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.980461    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995d8121-cfb3-4ab5-9d6b-1b53e665f2ed" containerName="manager"
Sep 08 14:49:59.980560 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.980470    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="995d8121-cfb3-4ab5-9d6b-1b53e665f2ed" containerName="manager"
Sep 08 14:49:59.980560 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.980486    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01aff066-92e2-4578-8242-2c1b53da0f26" containerName="payload-processing"
Sep 08 14:49:59.980560 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.980512    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="01aff066-92e2-4578-8242-2c1b53da0f26" containerName="payload-processing"
Sep 08 14:49:59.980972 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.980593    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="995d8121-cfb3-4ab5-9d6b-1b53e665f2ed" containerName="manager"
Sep 08 14:49:59.980972 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.980604    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerName="istio-proxy"
Sep 08 14:49:59.980972 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.980614    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="01aff066-92e2-4578-8242-2c1b53da0f26" containerName="payload-processing"
Sep 08 14:49:59.980972 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.980624    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerName="istio-proxy"
Sep 08 14:49:59.980972 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.980635    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="62285336-dae7-48f7-9451-167f9dc4ed30" containerName="revoke-keys"
Sep 08 14:49:59.983670 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.983650    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf"
Sep 08 14:49:59.986249 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.986227    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-stv9z\""
Sep 08 14:49:59.996906 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:49:59.996883    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf"]
Sep 08 14:50:00.018466 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:00.018432    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svb4q\" (UniqueName: \"kubernetes.io/projected/751b5d3d-513d-4e65-ba49-aa955d2ed2e1-kube-api-access-svb4q\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-ltfrf\" (UID: \"751b5d3d-513d-4e65-ba49-aa955d2ed2e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf"
Sep 08 14:50:00.018594 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:00.018483    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/751b5d3d-513d-4e65-ba49-aa955d2ed2e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-ltfrf\" (UID: \"751b5d3d-513d-4e65-ba49-aa955d2ed2e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf"
Sep 08 14:50:00.119108 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:00.119078    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svb4q\" (UniqueName: \"kubernetes.io/projected/751b5d3d-513d-4e65-ba49-aa955d2ed2e1-kube-api-access-svb4q\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-ltfrf\" (UID: \"751b5d3d-513d-4e65-ba49-aa955d2ed2e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf"
Sep 08 14:50:00.119245 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:00.119128    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/751b5d3d-513d-4e65-ba49-aa955d2ed2e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-ltfrf\" (UID: \"751b5d3d-513d-4e65-ba49-aa955d2ed2e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf"
Sep 08 14:50:00.119560 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:00.119543    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/751b5d3d-513d-4e65-ba49-aa955d2ed2e1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-ltfrf\" (UID: \"751b5d3d-513d-4e65-ba49-aa955d2ed2e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf"
Sep 08 14:50:00.128584 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:00.128563    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svb4q\" (UniqueName: \"kubernetes.io/projected/751b5d3d-513d-4e65-ba49-aa955d2ed2e1-kube-api-access-svb4q\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-ltfrf\" (UID: \"751b5d3d-513d-4e65-ba49-aa955d2ed2e1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf"
Sep 08 14:50:00.293649 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:00.293560    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf"
Sep 08 14:50:00.571355 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:00.571330    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf"]
Sep 08 14:50:00.573428 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:50:00.573406    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod751b5d3d_513d_4e65_ba49_aa955d2ed2e1.slice/crio-31cb794a1b8ac3a8123accfa8b73014a3223ad76933c26bcacbc8e9da52e14d6 WatchSource:0}: Error finding container 31cb794a1b8ac3a8123accfa8b73014a3223ad76933c26bcacbc8e9da52e14d6: Status 404 returned error can't find the container with id 31cb794a1b8ac3a8123accfa8b73014a3223ad76933c26bcacbc8e9da52e14d6
Sep 08 14:50:01.085929 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:01.085897    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf" event={"ID":"751b5d3d-513d-4e65-ba49-aa955d2ed2e1","Type":"ContainerStarted","Data":"778cc0a18a8af7d6fed275a4f893bb97212f20e33995f6b68124122c6a07c5fd"}
Sep 08 14:50:01.086334 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:01.085947    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf" event={"ID":"751b5d3d-513d-4e65-ba49-aa955d2ed2e1","Type":"ContainerStarted","Data":"31cb794a1b8ac3a8123accfa8b73014a3223ad76933c26bcacbc8e9da52e14d6"}
Sep 08 14:50:01.086334 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:01.086018    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf"
Sep 08 14:50:01.109019 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:01.108968    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf" podStartSLOduration=2.108952571 podStartE2EDuration="2.108952571s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:49:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:50:01.106124923 +0000 UTC m=+2002.502074383" watchObservedRunningTime="2026-09-08 14:50:01.108952571 +0000 UTC m=+2002.504902002"
Sep 08 14:50:12.091979 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:12.091949    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-ltfrf"
Sep 08 14:50:46.646284 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.646252    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"]
Sep 08 14:50:46.647023 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.646699    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerName="istio-proxy"
Sep 08 14:50:46.647023 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.646719    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb42c5ac-6835-42c9-92eb-0d815baa67a5" containerName="istio-proxy"
Sep 08 14:50:46.649542 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.649524    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.651833 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.651813    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-35588716-kserve-self-signed-certs\""
Sep 08 14:50:46.659540 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.659515    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"]
Sep 08 14:50:46.704324 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.704291    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-tmp-dir\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.704324 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.704326    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-model-cache\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.704511 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.704345    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-tls-certs\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.704511 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.704361    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-dshm\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.704511 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.704439    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-home\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.704619 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.704514    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gn2d\" (UniqueName: \"kubernetes.io/projected/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-kube-api-access-5gn2d\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.805262 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.805230    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gn2d\" (UniqueName: \"kubernetes.io/projected/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-kube-api-access-5gn2d\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.805431 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.805279    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-tmp-dir\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.805431 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.805306    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-model-cache\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.805431 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.805327    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-tls-certs\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.805431 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.805350    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-dshm\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.805431 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.805402    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-home\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.805727 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.805702    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-tmp-dir\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.805791 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.805728    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-model-cache\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.805887 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.805868    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-home\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.807565 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.807536    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-dshm\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.807798 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.807778    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-tls-certs\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.812877 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.812852    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gn2d\" (UniqueName: \"kubernetes.io/projected/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-kube-api-access-5gn2d\") pod \"e2e-same-id-b-35588716-kserve-544f79598c-x78jx\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") " pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:46.958967 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:46.958870    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:47.231308 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:47.231277    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"]
Sep 08 14:50:47.233789 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:50:47.233759    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c507782_cf0b_4cd5_b222_dc6f90f48e1e.slice/crio-782f4a0b5867c68fb87873bdffd86306f3af6aa9f5d5236dbc134d4aa1e5d99d WatchSource:0}: Error finding container 782f4a0b5867c68fb87873bdffd86306f3af6aa9f5d5236dbc134d4aa1e5d99d: Status 404 returned error can't find the container with id 782f4a0b5867c68fb87873bdffd86306f3af6aa9f5d5236dbc134d4aa1e5d99d
Sep 08 14:50:47.297336 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:47.297301    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx" event={"ID":"3c507782-cf0b-4cd5-b222-dc6f90f48e1e","Type":"ContainerStarted","Data":"782f4a0b5867c68fb87873bdffd86306f3af6aa9f5d5236dbc134d4aa1e5d99d"}
Sep 08 14:50:48.304388 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:48.304352    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx" event={"ID":"3c507782-cf0b-4cd5-b222-dc6f90f48e1e","Type":"ContainerStarted","Data":"7ccddfb7f72cd1a8e96ed871f4bbf04237a5f0294c3d5a5e242c179886bfb9b8"}
Sep 08 14:50:48.321336 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:48.321278    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx" podStartSLOduration=2.321258 podStartE2EDuration="2.321258s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:50:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:50:48.320680093 +0000 UTC m=+2049.716629542" watchObservedRunningTime="2026-09-08 14:50:48.321258 +0000 UTC m=+2049.717207435"
Sep 08 14:50:56.959242 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:56.959203    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:56.959719 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:56.959256    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:56.971763 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:56.971740    2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:50:57.356311 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:50:57.356279    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:51:14.673137 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:14.673042    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"]
Sep 08 14:51:29.693365 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:29.693295    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx" podUID="3c507782-cf0b-4cd5-b222-dc6f90f48e1e" containerName="main" containerID="cri-o://7ccddfb7f72cd1a8e96ed871f4bbf04237a5f0294c3d5a5e242c179886bfb9b8" gracePeriod=45
Sep 08 14:51:29.943799 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:29.943734    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:51:30.072728 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.072691    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-model-cache\") pod \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") "
Sep 08 14:51:30.072898 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.072777    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-tmp-dir\") pod \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") "
Sep 08 14:51:30.072898 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.072829    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-tls-certs\") pod \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") "
Sep 08 14:51:30.072898 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.072876    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-home\") pod \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") "
Sep 08 14:51:30.072898 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.072894    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-dshm\") pod \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") "
Sep 08 14:51:30.073112 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.072923    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gn2d\" (UniqueName: \"kubernetes.io/projected/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-kube-api-access-5gn2d\") pod \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\" (UID: \"3c507782-cf0b-4cd5-b222-dc6f90f48e1e\") "
Sep 08 14:51:30.073112 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.072975    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-model-cache" (OuterVolumeSpecName: "model-cache") pod "3c507782-cf0b-4cd5-b222-dc6f90f48e1e" (UID: "3c507782-cf0b-4cd5-b222-dc6f90f48e1e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:51:30.073112 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.073015    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3c507782-cf0b-4cd5-b222-dc6f90f48e1e" (UID: "3c507782-cf0b-4cd5-b222-dc6f90f48e1e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:51:30.073281 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.073167    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-home" (OuterVolumeSpecName: "home") pod "3c507782-cf0b-4cd5-b222-dc6f90f48e1e" (UID: "3c507782-cf0b-4cd5-b222-dc6f90f48e1e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:51:30.073281 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.073221    2564 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-tmp-dir\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:51:30.073281 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.073237    2564 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-model-cache\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:51:30.075052 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.075023    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3c507782-cf0b-4cd5-b222-dc6f90f48e1e" (UID: "3c507782-cf0b-4cd5-b222-dc6f90f48e1e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:51:30.075175 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.075046    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-dshm" (OuterVolumeSpecName: "dshm") pod "3c507782-cf0b-4cd5-b222-dc6f90f48e1e" (UID: "3c507782-cf0b-4cd5-b222-dc6f90f48e1e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 14:51:30.075175 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.075136    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-kube-api-access-5gn2d" (OuterVolumeSpecName: "kube-api-access-5gn2d") pod "3c507782-cf0b-4cd5-b222-dc6f90f48e1e" (UID: "3c507782-cf0b-4cd5-b222-dc6f90f48e1e"). InnerVolumeSpecName "kube-api-access-5gn2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:51:30.173889 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.173852    2564 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-tls-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:51:30.173889 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.173887    2564 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-home\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:51:30.173889 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.173897    2564 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-dshm\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:51:30.174114 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.173908    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gn2d\" (UniqueName: \"kubernetes.io/projected/3c507782-cf0b-4cd5-b222-dc6f90f48e1e-kube-api-access-5gn2d\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:51:30.508415 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.508381    2564 generic.go:356] "Generic (PLEG): container finished" podID="3c507782-cf0b-4cd5-b222-dc6f90f48e1e" containerID="7ccddfb7f72cd1a8e96ed871f4bbf04237a5f0294c3d5a5e242c179886bfb9b8" exitCode=0
Sep 08 14:51:30.508644 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.508435    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"
Sep 08 14:51:30.508644 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.508470    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx" event={"ID":"3c507782-cf0b-4cd5-b222-dc6f90f48e1e","Type":"ContainerDied","Data":"7ccddfb7f72cd1a8e96ed871f4bbf04237a5f0294c3d5a5e242c179886bfb9b8"}
Sep 08 14:51:30.508644 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.508533    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx" event={"ID":"3c507782-cf0b-4cd5-b222-dc6f90f48e1e","Type":"ContainerDied","Data":"782f4a0b5867c68fb87873bdffd86306f3af6aa9f5d5236dbc134d4aa1e5d99d"}
Sep 08 14:51:30.508644 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.508554    2564 scope.go:117] "RemoveContainer" containerID="7ccddfb7f72cd1a8e96ed871f4bbf04237a5f0294c3d5a5e242c179886bfb9b8"
Sep 08 14:51:30.517643 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.517626    2564 scope.go:117] "RemoveContainer" containerID="7ccddfb7f72cd1a8e96ed871f4bbf04237a5f0294c3d5a5e242c179886bfb9b8"
Sep 08 14:51:30.517916 ip-10-0-131-123 kubenswrapper[2564]: E0908 14:51:30.517894    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ccddfb7f72cd1a8e96ed871f4bbf04237a5f0294c3d5a5e242c179886bfb9b8\": container with ID starting with 7ccddfb7f72cd1a8e96ed871f4bbf04237a5f0294c3d5a5e242c179886bfb9b8 not found: ID does not exist" containerID="7ccddfb7f72cd1a8e96ed871f4bbf04237a5f0294c3d5a5e242c179886bfb9b8"
Sep 08 14:51:30.517962 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.517926    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ccddfb7f72cd1a8e96ed871f4bbf04237a5f0294c3d5a5e242c179886bfb9b8"} err="failed to get container status \"7ccddfb7f72cd1a8e96ed871f4bbf04237a5f0294c3d5a5e242c179886bfb9b8\": rpc error: code = NotFound desc = could not find container \"7ccddfb7f72cd1a8e96ed871f4bbf04237a5f0294c3d5a5e242c179886bfb9b8\": container with ID starting with 7ccddfb7f72cd1a8e96ed871f4bbf04237a5f0294c3d5a5e242c179886bfb9b8 not found: ID does not exist"
Sep 08 14:51:30.530078 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.530050    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"]
Sep 08 14:51:30.534308 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:30.534283    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-35588716-kserve-544f79598c-x78jx"]
Sep 08 14:51:31.186742 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:31.186710    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c507782-cf0b-4cd5-b222-dc6f90f48e1e" path="/var/lib/kubelet/pods/3c507782-cf0b-4cd5-b222-dc6f90f48e1e/volumes"
Sep 08 14:51:33.869894 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:33.869852    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"]
Sep 08 14:51:33.870324 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:33.870310    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c507782-cf0b-4cd5-b222-dc6f90f48e1e" containerName="main"
Sep 08 14:51:33.870369 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:33.870326    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c507782-cf0b-4cd5-b222-dc6f90f48e1e" containerName="main"
Sep 08 14:51:33.870414 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:33.870404    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c507782-cf0b-4cd5-b222-dc6f90f48e1e" containerName="main"
Sep 08 14:51:33.875395 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:33.875374    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:33.879161 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:33.879097    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dck9z\""
Sep 08 14:51:33.880288 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:33.880264    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 14:51:33.880421 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:33.880307    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 14:51:33.886729 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:33.886694    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"]
Sep 08 14:51:33.889053 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:33.889032    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 14:51:33.889360 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:33.889339    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 14:51:34.006614 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.006580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2nsg\" (UniqueName: \"kubernetes.io/projected/f3884ec7-c26f-414c-846d-3ee86f529ae5-kube-api-access-p2nsg\") pod \"maas-api-7f8554757b-qm5d2\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") " pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:34.006772 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.006623    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3884ec7-c26f-414c-846d-3ee86f529ae5-metrics-certs\") pod \"maas-api-7f8554757b-qm5d2\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") " pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:34.006772 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.006651    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3884ec7-c26f-414c-846d-3ee86f529ae5-openshift-service-ca\") pod \"maas-api-7f8554757b-qm5d2\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") " pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:34.006772 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.006690    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3884ec7-c26f-414c-846d-3ee86f529ae5-maas-api-tls\") pod \"maas-api-7f8554757b-qm5d2\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") " pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:34.107920 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.107886    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3884ec7-c26f-414c-846d-3ee86f529ae5-metrics-certs\") pod \"maas-api-7f8554757b-qm5d2\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") " pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:34.108122 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.107951    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3884ec7-c26f-414c-846d-3ee86f529ae5-openshift-service-ca\") pod \"maas-api-7f8554757b-qm5d2\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") " pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:34.108122 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.107985    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3884ec7-c26f-414c-846d-3ee86f529ae5-maas-api-tls\") pod \"maas-api-7f8554757b-qm5d2\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") " pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:34.108122 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.108034    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2nsg\" (UniqueName: \"kubernetes.io/projected/f3884ec7-c26f-414c-846d-3ee86f529ae5-kube-api-access-p2nsg\") pod \"maas-api-7f8554757b-qm5d2\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") " pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:34.108730 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.108705    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3884ec7-c26f-414c-846d-3ee86f529ae5-openshift-service-ca\") pod \"maas-api-7f8554757b-qm5d2\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") " pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:34.110482 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.110461    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3884ec7-c26f-414c-846d-3ee86f529ae5-maas-api-tls\") pod \"maas-api-7f8554757b-qm5d2\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") " pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:34.110575 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.110476    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3884ec7-c26f-414c-846d-3ee86f529ae5-metrics-certs\") pod \"maas-api-7f8554757b-qm5d2\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") " pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:34.118045 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.118023    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2nsg\" (UniqueName: \"kubernetes.io/projected/f3884ec7-c26f-414c-846d-3ee86f529ae5-kube-api-access-p2nsg\") pod \"maas-api-7f8554757b-qm5d2\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") " pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:34.187042 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.186964    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:34.457678 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.457554    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"]
Sep 08 14:51:34.461308 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:51:34.461276    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3884ec7_c26f_414c_846d_3ee86f529ae5.slice/crio-97699f3be7e8d997a0f4a1e4f79a989b8aa256e03a77f167e5dda29f5c85c0b3 WatchSource:0}: Error finding container 97699f3be7e8d997a0f4a1e4f79a989b8aa256e03a77f167e5dda29f5c85c0b3: Status 404 returned error can't find the container with id 97699f3be7e8d997a0f4a1e4f79a989b8aa256e03a77f167e5dda29f5c85c0b3
Sep 08 14:51:34.463053 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.463031    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 14:51:34.534513 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:34.534458    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2" event={"ID":"f3884ec7-c26f-414c-846d-3ee86f529ae5","Type":"ContainerStarted","Data":"97699f3be7e8d997a0f4a1e4f79a989b8aa256e03a77f167e5dda29f5c85c0b3"}
Sep 08 14:51:38.559743 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:38.559652    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2" event={"ID":"f3884ec7-c26f-414c-846d-3ee86f529ae5","Type":"ContainerStarted","Data":"3adbd31a97cec14850e0d633fe3c057093dd94c117fa53051320b2748dbb8810"}
Sep 08 14:51:38.560173 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:38.559818    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:38.579257 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:38.579190    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2" podStartSLOduration=1.8954061370000002 podStartE2EDuration="5.579172315s" totalImagesPullingTime="3.683766178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:51:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:51:38.578423359 +0000 UTC m=+2099.974372792" watchObservedRunningTime="2026-09-08 14:51:38.579172315 +0000 UTC m=+2099.975121747"
Sep 08 14:51:39.489854 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:39.489819    2564 scope.go:117] "RemoveContainer" containerID="fd06fbb58e9aae78ee5c4c86397ac48ccf1f30f8f12360d9d4db8bb01dc61ea1"
Sep 08 14:51:39.497972 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:39.497950    2564 scope.go:117] "RemoveContainer" containerID="000508a626e507d8b86dd9d7b2695e96419c855e153580aac884c2bd407b8988"
Sep 08 14:51:41.371481 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.371446    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"]
Sep 08 14:51:41.371912 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.371644    2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2" podUID="f3884ec7-c26f-414c-846d-3ee86f529ae5" containerName="maas-api" containerID="cri-o://3adbd31a97cec14850e0d633fe3c057093dd94c117fa53051320b2748dbb8810" gracePeriod=30
Sep 08 14:51:41.404873 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.404838    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"]
Sep 08 14:51:41.408118 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.408098    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.419035 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.419009    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"]
Sep 08 14:51:41.465884 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.465860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a26e464-f59c-40ed-a6eb-be6f131bc4e6-maas-api-tls\") pod \"maas-api-c5bcdfbdd-7b4lh\" (UID: \"1a26e464-f59c-40ed-a6eb-be6f131bc4e6\") " pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.466006 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.465918    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a26e464-f59c-40ed-a6eb-be6f131bc4e6-metrics-certs\") pod \"maas-api-c5bcdfbdd-7b4lh\" (UID: \"1a26e464-f59c-40ed-a6eb-be6f131bc4e6\") " pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.466006 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.465958    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wf7k\" (UniqueName: \"kubernetes.io/projected/1a26e464-f59c-40ed-a6eb-be6f131bc4e6-kube-api-access-5wf7k\") pod \"maas-api-c5bcdfbdd-7b4lh\" (UID: \"1a26e464-f59c-40ed-a6eb-be6f131bc4e6\") " pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.466080 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.466024    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a26e464-f59c-40ed-a6eb-be6f131bc4e6-openshift-service-ca\") pod \"maas-api-c5bcdfbdd-7b4lh\" (UID: \"1a26e464-f59c-40ed-a6eb-be6f131bc4e6\") " pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.566755 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.566721    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wf7k\" (UniqueName: \"kubernetes.io/projected/1a26e464-f59c-40ed-a6eb-be6f131bc4e6-kube-api-access-5wf7k\") pod \"maas-api-c5bcdfbdd-7b4lh\" (UID: \"1a26e464-f59c-40ed-a6eb-be6f131bc4e6\") " pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.566927 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.566789    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a26e464-f59c-40ed-a6eb-be6f131bc4e6-openshift-service-ca\") pod \"maas-api-c5bcdfbdd-7b4lh\" (UID: \"1a26e464-f59c-40ed-a6eb-be6f131bc4e6\") " pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.566927 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.566807    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a26e464-f59c-40ed-a6eb-be6f131bc4e6-maas-api-tls\") pod \"maas-api-c5bcdfbdd-7b4lh\" (UID: \"1a26e464-f59c-40ed-a6eb-be6f131bc4e6\") " pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.566927 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.566883    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a26e464-f59c-40ed-a6eb-be6f131bc4e6-metrics-certs\") pod \"maas-api-c5bcdfbdd-7b4lh\" (UID: \"1a26e464-f59c-40ed-a6eb-be6f131bc4e6\") " pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.567640 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.567612    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a26e464-f59c-40ed-a6eb-be6f131bc4e6-openshift-service-ca\") pod \"maas-api-c5bcdfbdd-7b4lh\" (UID: \"1a26e464-f59c-40ed-a6eb-be6f131bc4e6\") " pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.569741 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.569674    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1a26e464-f59c-40ed-a6eb-be6f131bc4e6-metrics-certs\") pod \"maas-api-c5bcdfbdd-7b4lh\" (UID: \"1a26e464-f59c-40ed-a6eb-be6f131bc4e6\") " pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.570092 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.570071    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1a26e464-f59c-40ed-a6eb-be6f131bc4e6-maas-api-tls\") pod \"maas-api-c5bcdfbdd-7b4lh\" (UID: \"1a26e464-f59c-40ed-a6eb-be6f131bc4e6\") " pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.576701 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.576671    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wf7k\" (UniqueName: \"kubernetes.io/projected/1a26e464-f59c-40ed-a6eb-be6f131bc4e6-kube-api-access-5wf7k\") pod \"maas-api-c5bcdfbdd-7b4lh\" (UID: \"1a26e464-f59c-40ed-a6eb-be6f131bc4e6\") " pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.579336 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.578620    2564 generic.go:356] "Generic (PLEG): container finished" podID="f3884ec7-c26f-414c-846d-3ee86f529ae5" containerID="3adbd31a97cec14850e0d633fe3c057093dd94c117fa53051320b2748dbb8810" exitCode=0
Sep 08 14:51:41.579336 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.578794    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2" event={"ID":"f3884ec7-c26f-414c-846d-3ee86f529ae5","Type":"ContainerDied","Data":"3adbd31a97cec14850e0d633fe3c057093dd94c117fa53051320b2748dbb8810"}
Sep 08 14:51:41.617212 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.617188    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:41.667242 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.667167    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3884ec7-c26f-414c-846d-3ee86f529ae5-maas-api-tls\") pod \"f3884ec7-c26f-414c-846d-3ee86f529ae5\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") "
Sep 08 14:51:41.667242 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.667224    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3884ec7-c26f-414c-846d-3ee86f529ae5-metrics-certs\") pod \"f3884ec7-c26f-414c-846d-3ee86f529ae5\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") "
Sep 08 14:51:41.667431 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.667273    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p2nsg\" (UniqueName: \"kubernetes.io/projected/f3884ec7-c26f-414c-846d-3ee86f529ae5-kube-api-access-p2nsg\") pod \"f3884ec7-c26f-414c-846d-3ee86f529ae5\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") "
Sep 08 14:51:41.667431 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.667301    2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3884ec7-c26f-414c-846d-3ee86f529ae5-openshift-service-ca\") pod \"f3884ec7-c26f-414c-846d-3ee86f529ae5\" (UID: \"f3884ec7-c26f-414c-846d-3ee86f529ae5\") "
Sep 08 14:51:41.667725 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.667692    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3884ec7-c26f-414c-846d-3ee86f529ae5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3884ec7-c26f-414c-846d-3ee86f529ae5" (UID: "f3884ec7-c26f-414c-846d-3ee86f529ae5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 14:51:41.669403 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.669378    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3884ec7-c26f-414c-846d-3ee86f529ae5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3884ec7-c26f-414c-846d-3ee86f529ae5" (UID: "f3884ec7-c26f-414c-846d-3ee86f529ae5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:51:41.669481 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.669407    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3884ec7-c26f-414c-846d-3ee86f529ae5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f3884ec7-c26f-414c-846d-3ee86f529ae5" (UID: "f3884ec7-c26f-414c-846d-3ee86f529ae5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 14:51:41.669481 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.669427    2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3884ec7-c26f-414c-846d-3ee86f529ae5-kube-api-access-p2nsg" (OuterVolumeSpecName: "kube-api-access-p2nsg") pod "f3884ec7-c26f-414c-846d-3ee86f529ae5" (UID: "f3884ec7-c26f-414c-846d-3ee86f529ae5"). InnerVolumeSpecName "kube-api-access-p2nsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 14:51:41.751711 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.751666    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:41.767985 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.767953    2564 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3884ec7-c26f-414c-846d-3ee86f529ae5-openshift-service-ca\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:51:41.768091 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.767989    2564 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3884ec7-c26f-414c-846d-3ee86f529ae5-maas-api-tls\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:51:41.768091 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.768004    2564 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3884ec7-c26f-414c-846d-3ee86f529ae5-metrics-certs\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:51:41.768091 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:41.768016    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p2nsg\" (UniqueName: \"kubernetes.io/projected/f3884ec7-c26f-414c-846d-3ee86f529ae5-kube-api-access-p2nsg\") on node \"ip-10-0-131-123.ec2.internal\" DevicePath \"\""
Sep 08 14:51:42.024252 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:42.024208    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"]
Sep 08 14:51:42.026380 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:51:42.026347    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a26e464_f59c_40ed_a6eb_be6f131bc4e6.slice/crio-2a861b08bbbf99cc2e29902d986cdb0794c89c521bd8b191580724180d58c23f WatchSource:0}: Error finding container 2a861b08bbbf99cc2e29902d986cdb0794c89c521bd8b191580724180d58c23f: Status 404 returned error can't find the container with id 2a861b08bbbf99cc2e29902d986cdb0794c89c521bd8b191580724180d58c23f
Sep 08 14:51:42.585447 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:42.585373    2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"
Sep 08 14:51:42.585447 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:42.585378    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2" event={"ID":"f3884ec7-c26f-414c-846d-3ee86f529ae5","Type":"ContainerDied","Data":"97699f3be7e8d997a0f4a1e4f79a989b8aa256e03a77f167e5dda29f5c85c0b3"}
Sep 08 14:51:42.585447 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:42.585445    2564 scope.go:117] "RemoveContainer" containerID="3adbd31a97cec14850e0d633fe3c057093dd94c117fa53051320b2748dbb8810"
Sep 08 14:51:42.587132 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:42.587106    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh" event={"ID":"1a26e464-f59c-40ed-a6eb-be6f131bc4e6","Type":"ContainerStarted","Data":"b8df5d4e7ca0523c006c453ccdda1cf75e1afa896f6b0834670cffecd824b14f"}
Sep 08 14:51:42.587248 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:42.587190    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:51:42.587248 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:42.587209    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh" event={"ID":"1a26e464-f59c-40ed-a6eb-be6f131bc4e6","Type":"ContainerStarted","Data":"2a861b08bbbf99cc2e29902d986cdb0794c89c521bd8b191580724180d58c23f"}
Sep 08 14:51:42.608108 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:42.608066    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh" podStartSLOduration=1.301922522 podStartE2EDuration="1.608050533s" totalImagesPullingTime="306.128011ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 14:51:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:51:42.605433894 +0000 UTC m=+2104.001383325" watchObservedRunningTime="2026-09-08 14:51:42.608050533 +0000 UTC m=+2104.003999964"
Sep 08 14:51:42.620581 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:42.620557    2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"]
Sep 08 14:51:42.624704 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:42.624679    2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f8554757b-qm5d2"]
Sep 08 14:51:43.192028 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:43.191984    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3884ec7-c26f-414c-846d-3ee86f529ae5" path="/var/lib/kubelet/pods/f3884ec7-c26f-414c-846d-3ee86f529ae5/volumes"
Sep 08 14:51:48.599078 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:51:48.599045    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-c5bcdfbdd-7b4lh"
Sep 08 14:52:12.785616 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:12.785580    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-84k42_7bdbba57-15eb-478f-bd56-fd854e369f41/manager/0.log"
Sep 08 14:52:12.922019 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:12.921986    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wqgfx_22957d06-be22-4a7b-89a4-f0448e8102d4/manager/0.log"
Sep 08 14:52:13.180388 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:13.180351    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xcpv7_1ad85707-bf17-4598-96d6-9f8e3a2c1576/server/0.log"
Sep 08 14:52:13.570448 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:13.570361    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-566d57d45b-pgp4c_ac18e514-5015-4d1d-9117-a11a4de0468f/copy-manifests/0.log"
Sep 08 14:52:13.578453 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:13.578421    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-566d57d45b-pgp4c_ac18e514-5015-4d1d-9117-a11a4de0468f/manager/0.log"
Sep 08 14:52:14.061998 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:14.061966    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-c5bcdfbdd-7b4lh_1a26e464-f59c-40ed-a6eb-be6f131bc4e6/maas-api/0.log"
Sep 08 14:52:14.287334 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:14.287303    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29814630-5tg82_6be8d86e-3065-4f55-a312-95ee029c8d42/cleanup/0.log"
Sep 08 14:52:14.403984 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:14.403949    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29814645-bzlhc_4d73bd95-8cf2-4a56-894c-dfbc07eecc9d/cleanup/0.log"
Sep 08 14:52:15.889369 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:15.889331    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-ltfrf_751b5d3d-513d-4e65-ba49-aa955d2ed2e1/manager/0.log"
Sep 08 14:52:16.197053 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:16.196966    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-5z768_872e6740-57ef-4473-b9eb-59a1daec48ea/manager/0.log"
Sep 08 14:52:16.571720 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:16.571632    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx_2e0a4612-6772-4b07-b432-3a90c05cba9e/istio-proxy/0.log"
Sep 08 14:52:16.697997 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:16.697963    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l7j76_7d9e9a8c-061a-4cd1-b3d1-e90f075b067d/discovery/0.log"
Sep 08 14:52:16.942759 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:16.942727    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5df94dbdbc-xs89k_26d1effb-2a37-4a73-b70c-3cbcfc826864/kube-auth-proxy/0.log"
Sep 08 14:52:17.959975 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:17.959937    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-zmfbl_d35e040b-2302-4f18-8244-edee480d6e82/main/0.log"
Sep 08 14:52:18.348207 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:18.348179    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f55hdq_239c934e-9db5-46a3-9e5b-e5ec2e374394/main/0.log"
Sep 08 14:52:29.763908 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:29.763872    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k6dcv_3bc9c240-9b7e-45bf-99d5-849d87a774da/global-pull-secret-syncer/0.log"
Sep 08 14:52:29.851692 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:29.851659    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pw4zx_2d8ba03c-1050-4ff4-86fe-4276c9a7467a/konnectivity-agent/0.log"
Sep 08 14:52:29.907686 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:29.907647    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-123.ec2.internal_8b6dddcb8c682c982b23c18df04e5a1a/haproxy/0.log"
Sep 08 14:52:34.596958 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:34.596870    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-ltfrf_751b5d3d-513d-4e65-ba49-aa955d2ed2e1/manager/0.log"
Sep 08 14:52:34.714980 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:34.714947    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-5z768_872e6740-57ef-4473-b9eb-59a1daec48ea/manager/0.log"
Sep 08 14:52:36.651239 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:36.651205    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-dg22n_540dece3-d553-4f99-afe6-7d635b393418/kube-state-metrics/0.log"
Sep 08 14:52:36.671046 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:36.671010    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-dg22n_540dece3-d553-4f99-afe6-7d635b393418/kube-rbac-proxy-main/0.log"
Sep 08 14:52:36.696402 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:36.696378    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-dg22n_540dece3-d553-4f99-afe6-7d635b393418/kube-rbac-proxy-self/0.log"
Sep 08 14:52:36.981821 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:36.981730    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v58zr_2c7e300c-86d8-44da-8399-5eae1802b0a6/node-exporter/0.log"
Sep 08 14:52:37.007014 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:37.006989    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v58zr_2c7e300c-86d8-44da-8399-5eae1802b0a6/kube-rbac-proxy/0.log"
Sep 08 14:52:37.032674 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:37.032652    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v58zr_2c7e300c-86d8-44da-8399-5eae1802b0a6/init-textfile/0.log"
Sep 08 14:52:39.522615 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:39.522586    2564 scope.go:117] "RemoveContainer" containerID="622cacdf51a18058ca2f7a6b7146686571f9da1c657e2af39ba91e5194b71b2b"
Sep 08 14:52:40.467619 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.467590    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-zxrxw_6f1fed1f-529e-45d0-a1e8-c8205629fb51/download-server/0.log"
Sep 08 14:52:40.591892 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.591861    2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"]
Sep 08 14:52:40.592277 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.592193    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3884ec7-c26f-414c-846d-3ee86f529ae5" containerName="maas-api"
Sep 08 14:52:40.592277 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.592209    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3884ec7-c26f-414c-846d-3ee86f529ae5" containerName="maas-api"
Sep 08 14:52:40.592364 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.592338    2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3884ec7-c26f-414c-846d-3ee86f529ae5" containerName="maas-api"
Sep 08 14:52:40.595151 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.595135    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.597561 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.597536    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rt5bz\"/\"kube-root-ca.crt\""
Sep 08 14:52:40.597694 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.597673    2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rt5bz\"/\"openshift-service-ca.crt\""
Sep 08 14:52:40.598727 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.598712    2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rt5bz\"/\"default-dockercfg-fn8ct\""
Sep 08 14:52:40.601465 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.601442    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"]
Sep 08 14:52:40.761171 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.761081    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7d38ba4a-829d-4660-9364-d22776105465-proc\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.761171 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.761137    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7d38ba4a-829d-4660-9364-d22776105465-podres\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.761171 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.761162    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d38ba4a-829d-4660-9364-d22776105465-sys\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.761417 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.761198    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d38ba4a-829d-4660-9364-d22776105465-lib-modules\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.761417 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.761236    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnns6\" (UniqueName: \"kubernetes.io/projected/7d38ba4a-829d-4660-9364-d22776105465-kube-api-access-dnns6\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.862439 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.862406    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d38ba4a-829d-4660-9364-d22776105465-lib-modules\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.862611 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.862454    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnns6\" (UniqueName: \"kubernetes.io/projected/7d38ba4a-829d-4660-9364-d22776105465-kube-api-access-dnns6\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.862611 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.862534    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7d38ba4a-829d-4660-9364-d22776105465-proc\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.862611 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.862595    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7d38ba4a-829d-4660-9364-d22776105465-podres\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.862781 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.862622    2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d38ba4a-829d-4660-9364-d22776105465-sys\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.862781 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.862628    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7d38ba4a-829d-4660-9364-d22776105465-proc\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.862781 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.862597    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7d38ba4a-829d-4660-9364-d22776105465-lib-modules\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.862781 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.862709    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d38ba4a-829d-4660-9364-d22776105465-sys\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.862781 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.862744    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7d38ba4a-829d-4660-9364-d22776105465-podres\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.870736 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.870720    2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnns6\" (UniqueName: \"kubernetes.io/projected/7d38ba4a-829d-4660-9364-d22776105465-kube-api-access-dnns6\") pod \"perf-node-gather-daemonset-ln55x\" (UID: \"7d38ba4a-829d-4660-9364-d22776105465\") " pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:40.905735 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:40.905712    2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:41.174993 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:41.174964    2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"]
Sep 08 14:52:41.176835 ip-10-0-131-123 kubenswrapper[2564]: W0908 14:52:41.176805    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7d38ba4a_829d_4660_9364_d22776105465.slice/crio-2b9fc3e13995346ee8acd3508f00356a57958891a4592f13ceb5ed0ce615ff32 WatchSource:0}: Error finding container 2b9fc3e13995346ee8acd3508f00356a57958891a4592f13ceb5ed0ce615ff32: Status 404 returned error can't find the container with id 2b9fc3e13995346ee8acd3508f00356a57958891a4592f13ceb5ed0ce615ff32
Sep 08 14:52:41.864655 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:41.864624    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x" event={"ID":"7d38ba4a-829d-4660-9364-d22776105465","Type":"ContainerStarted","Data":"54c647f68b3327cc163b02109b7be8be216da7a62d258d7656dc4941838ad80e"}
Sep 08 14:52:41.865030 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:41.864672    2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x" event={"ID":"7d38ba4a-829d-4660-9364-d22776105465","Type":"ContainerStarted","Data":"2b9fc3e13995346ee8acd3508f00356a57958891a4592f13ceb5ed0ce615ff32"}
Sep 08 14:52:41.865030 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:41.864729    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:41.880773 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:41.880733    2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x" podStartSLOduration=1.880719478 podStartE2EDuration="1.880719478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 14:52:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 14:52:41.879700911 +0000 UTC m=+2163.275650348" watchObservedRunningTime="2026-09-08 14:52:41.880719478 +0000 UTC m=+2163.276668954"
Sep 08 14:52:42.462405 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:42.462374    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l4xrf_51679112-0b12-469e-9d04-a6c495691a27/dns/0.log"
Sep 08 14:52:42.487276 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:42.487251    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l4xrf_51679112-0b12-469e-9d04-a6c495691a27/kube-rbac-proxy/0.log"
Sep 08 14:52:42.562520 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:42.562478    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9dfbq_7a84aaf4-f043-431c-8168-0185682c8629/dns-node-resolver/0.log"
Sep 08 14:52:43.183327 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:43.183300    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2m9dd_cde9e505-47fa-40ac-872c-cbd86b1fcf6e/node-ca/0.log"
Sep 08 14:52:44.197766 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:44.197732    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx_2e0a4612-6772-4b07-b432-3a90c05cba9e/istio-proxy/0.log"
Sep 08 14:52:44.751282 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:44.751251    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l7j76_7d9e9a8c-061a-4cd1-b3d1-e90f075b067d/discovery/0.log"
Sep 08 14:52:44.801509 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:44.801468    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5df94dbdbc-xs89k_26d1effb-2a37-4a73-b70c-3cbcfc826864/kube-auth-proxy/0.log"
Sep 08 14:52:45.895731 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:45.895702    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vxmhm_ccc79fe4-b61c-4a96-a306-f371aa83d1d7/serve-healthcheck-canary/0.log"
Sep 08 14:52:46.473266 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:46.473236    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ps4kz_14da3a92-34a6-44df-8b9f-0ee434f57b63/kube-rbac-proxy/0.log"
Sep 08 14:52:46.499041 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:46.499008    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ps4kz_14da3a92-34a6-44df-8b9f-0ee434f57b63/exporter/0.log"
Sep 08 14:52:46.523110 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:46.523085    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ps4kz_14da3a92-34a6-44df-8b9f-0ee434f57b63/extractor/0.log"
Sep 08 14:52:47.878293 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:47.878264    2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rt5bz/perf-node-gather-daemonset-ln55x"
Sep 08 14:52:48.703937 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:48.703908    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-84k42_7bdbba57-15eb-478f-bd56-fd854e369f41/manager/0.log"
Sep 08 14:52:49.014901 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:49.014811    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wqgfx_22957d06-be22-4a7b-89a4-f0448e8102d4/manager/0.log"
Sep 08 14:52:49.100726 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:49.100696    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xcpv7_1ad85707-bf17-4598-96d6-9f8e3a2c1576/server/0.log"
Sep 08 14:52:49.268201 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:49.268115    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-566d57d45b-pgp4c_ac18e514-5015-4d1d-9117-a11a4de0468f/manager/0.log"
Sep 08 14:52:49.292310 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:49.292287    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-566d57d45b-pgp4c_ac18e514-5015-4d1d-9117-a11a4de0468f/copy-manifests/0.log"
Sep 08 14:52:50.411846 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:50.411812    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx_2e0a4612-6772-4b07-b432-3a90c05cba9e/istio-proxy/0.log"
Sep 08 14:52:50.958229 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:50.958144    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l7j76_7d9e9a8c-061a-4cd1-b3d1-e90f075b067d/discovery/0.log"
Sep 08 14:52:50.993464 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:50.993436    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5df94dbdbc-xs89k_26d1effb-2a37-4a73-b70c-3cbcfc826864/kube-auth-proxy/0.log"
Sep 08 14:52:52.720754 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:52.720723    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cp4kwx_2e0a4612-6772-4b07-b432-3a90c05cba9e/istio-proxy/0.log"
Sep 08 14:52:53.270223 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:53.270130    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-l7j76_7d9e9a8c-061a-4cd1-b3d1-e90f075b067d/discovery/0.log"
Sep 08 14:52:53.316056 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:53.316014    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5df94dbdbc-xs89k_26d1effb-2a37-4a73-b70c-3cbcfc826864/kube-auth-proxy/0.log"
Sep 08 14:52:57.435041 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:57.435006    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5mbnm_69f38441-5795-4fdd-ba8f-45c6a6a1776f/kube-multus/0.log"
Sep 08 14:52:57.797932 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:57.797858    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8jwt_75982462-3b1d-40d0-bf77-f59fd69ac4cf/kube-multus-additional-cni-plugins/0.log"
Sep 08 14:52:57.820160 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:57.820130    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8jwt_75982462-3b1d-40d0-bf77-f59fd69ac4cf/egress-router-binary-copy/0.log"
Sep 08 14:52:57.841193 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:57.841169    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8jwt_75982462-3b1d-40d0-bf77-f59fd69ac4cf/cni-plugins/0.log"
Sep 08 14:52:57.864909 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:57.864890    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8jwt_75982462-3b1d-40d0-bf77-f59fd69ac4cf/bond-cni-plugin/0.log"
Sep 08 14:52:57.888006 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:57.887985    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8jwt_75982462-3b1d-40d0-bf77-f59fd69ac4cf/routeoverride-cni/0.log"
Sep 08 14:52:57.910691 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:57.910667    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8jwt_75982462-3b1d-40d0-bf77-f59fd69ac4cf/whereabouts-cni-bincopy/0.log"
Sep 08 14:52:57.932894 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:57.932876    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s8jwt_75982462-3b1d-40d0-bf77-f59fd69ac4cf/whereabouts-cni/0.log"
Sep 08 14:52:58.099105 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:58.099080    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x8tbj_5f09cf98-dd58-4ed2-a064-4d078539840b/network-metrics-daemon/0.log"
Sep 08 14:52:58.117188 ip-10-0-131-123 kubenswrapper[2564]: I0908 14:52:58.117169    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x8tbj_5f09cf98-dd58-4ed2-a064-4d078539840b/kube-rbac-proxy/0.log"