Sep 11 14:13:00.690295 ip-10-0-137-70 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 14:13:00.690306 ip-10-0-137-70 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 14:13:00.690315 ip-10-0-137-70 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 14:13:00.690527 ip-10-0-137-70 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 14:13:10.939850 ip-10-0-137-70 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 14:13:10.939867 ip-10-0-137-70 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 48de031f9ad0425f920dff5da1271b81 --
Sep 11 14:15:03.666178 ip-10-0-137-70 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 14:15:04.077699 ip-10-0-137-70 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 14:15:04.077699 ip-10-0-137-70 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 14:15:04.077699 ip-10-0-137-70 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 14:15:04.077699 ip-10-0-137-70 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 14:15:04.077699 ip-10-0-137-70 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 14:15:04.078774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.078686    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 14:15:04.082910 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082894    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:04.082910 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082910    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082913    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082916    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082919    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082922    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082925    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082928    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082930    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082933    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082936    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082940    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082942    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082945    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082947    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082950    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082953    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082955    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082958    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082964    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082967    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:04.082977 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082969    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082972    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082974    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082977    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082980    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082983    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082986    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082988    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082991    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082994    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082996    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.082999    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083001    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083003    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083006    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083008    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083011    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083013    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083015    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:04.083449 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083018    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083021    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083023    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083025    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083028    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083031    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083033    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083043    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083049    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083059    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083062    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083065    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083068    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083071    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083075    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083079    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083082    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083085    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083088    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:04.083927 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083091    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083093    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083096    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083099    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083101    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083104    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083107    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083110    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083112    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083115    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083117    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083120    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083123    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083125    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083128    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083130    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083133    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083135    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083138    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083140    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:04.084372 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083142    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083145    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083149    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083151    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083153    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083156    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083159    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083163    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083167    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083171    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083173    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083176    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083178    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083181    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083183    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083186    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083189    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083191    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083193    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:04.084911 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083196    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083895    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083902    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083905    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083908    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083911    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083914    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083917    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083919    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083922    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083924    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083927    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083930    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083932    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083935    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083940    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083944    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083947    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083951    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:04.085358 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083954    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083957    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083961    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083964    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083966    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083969    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083972    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083975    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083977    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083980    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083982    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083985    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083988    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083991    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083993    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083995    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.083998    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084000    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084003    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084005    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:04.085821 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084008    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084011    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084013    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084016    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084019    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084021    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084023    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084026    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084028    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084031    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084033    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084035    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084038    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084040    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084043    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084046    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084048    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084051    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084053    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084056    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:04.086317 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084058    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084060    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084063    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084065    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084069    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084071    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084073    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084076    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084079    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084083    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084085    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084088    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084090    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084093    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084095    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084097    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084100    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084102    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084105    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084107    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:04.086798 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084109    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084112    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084114    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084117    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084119    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084122    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084125    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084127    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084130    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084132    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084135    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084137    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084139    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084142    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084144    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084147    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084149    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084151    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084154    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084156    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:04.087313 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084159    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084521    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084526    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084528    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084531    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084534    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084537    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084540    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084542    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084545    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084547    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084549    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084552    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084554    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084557    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084559    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084562    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084565    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084568    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084571    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:04.087822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084573    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084576    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084578    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084581    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084583    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084586    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084588    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084591    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084593    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084595    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084598    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084600    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084603    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084605    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084608    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084610    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084613    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084615    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084618    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084620    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:04.088339 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084623    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084626    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084628    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084631    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084633    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084636    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084638    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084640    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084643    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084646    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084648    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084651    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084653    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084656    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084658    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084660    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084663    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084665    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084668    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:04.088888 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084670    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084672    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084675    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084677    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084679    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084683    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084685    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084688    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084693    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084696    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084698    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084701    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084703    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084706    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084709    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084711    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084714    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084716    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084720    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084722    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:04.089578 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084725    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084727    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084730    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084732    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084736    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084740    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084743    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084745    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084748    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084750    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084753    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084755    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084757    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084760    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084762    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084764    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084768    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084771    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:04.090076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084774    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084777    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.084782    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084868    2569 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084923    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084931    2569 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084936    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084940    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084944    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084947    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084952    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084955    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084958    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084961    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084964    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084967    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084970    2569 flags.go:64] FLAG: --cgroup-root=""
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084973    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084976    2569 flags.go:64] FLAG: --client-ca-file=""
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084979    2569 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084982    2569 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084986    2569 flags.go:64] FLAG: --cluster-domain=""
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084989    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 14:15:04.090592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084992    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084995    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.084998    2569 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085002    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085005    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085008    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085011    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085015    2569 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085017    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085020    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085023    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085027    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085031    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085034    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085037    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085040    2569 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085042    2569 flags.go:64] FLAG: --enable-server="true"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085046    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085051    2569 flags.go:64] FLAG: --event-burst="100"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085054    2569 flags.go:64] FLAG: --event-qps="50"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085057    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085059    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085062    2569 flags.go:64] FLAG: --eviction-hard=""
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085066    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 14:15:04.091179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085069    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085073    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085076    2569 flags.go:64] FLAG: --eviction-soft=""
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085079    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085082    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085085    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085088    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085091    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085094    2569 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085096    2569 flags.go:64] FLAG: --feature-gates=""
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085100    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085103    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085106    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085109    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085112    2569 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085114    2569 flags.go:64] FLAG: --help="false"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085117    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085120    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085123    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085127    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085130    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085133    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085136    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 14:15:04.091759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085139    2569 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085142    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085144    2569 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085148    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085151    2569 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085153    2569 flags.go:64] FLAG: --kube-reserved=""
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085156    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085159    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085162    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085164    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085169    2569 flags.go:64] FLAG: --lock-file=""
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085172    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085174    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085177    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085182    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085185    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085188    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085190    2569 flags.go:64] FLAG: --logging-format="text"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085193    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085196    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085199    2569 flags.go:64] FLAG: --manifest-url=""
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085202    2569 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085206    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085209    2569 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085213    2569 flags.go:64] FLAG: --max-pods="110"
Sep 11 14:15:04.092462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085216    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085218    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085221    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085226    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085229    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085232    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085235    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085242    2569 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085245    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085248    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085251    2569 flags.go:64] FLAG: --pod-cidr=""
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085254    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085260    2569 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085263    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085266    2569 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085268    2569 flags.go:64] FLAG: --port="10250"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085271    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085276    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-05eebd23be71fe023"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085279    2569 flags.go:64] FLAG: --qos-reserved=""
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085282    2569 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085285    2569 flags.go:64] FLAG: --register-node="true"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085287    2569 flags.go:64] FLAG: --register-with-taints=""
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085291    2569 flags.go:64] FLAG: --registry-burst="10"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085293    2569 flags.go:64] FLAG: --registry-qps="5"
Sep 11 14:15:04.093082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085296    2569 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085299    2569 flags.go:64] FLAG: --reserved-memory=""
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085302    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085306    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085308    2569 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085311    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085314    2569 flags.go:64] FLAG: --runonce="false"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085317    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085319    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085322    2569 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085325    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085327    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085332    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085334    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085337    2569 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085340    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085343    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085345    2569 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085348    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085352    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085355    2569 flags.go:64] FLAG: --system-cgroups=""
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085359    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085365    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085368    2569 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085371    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 14:15:04.093790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085376    2569 flags.go:64] FLAG: --tls-min-version=""
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085378    2569 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085381    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085384    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085387    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085390    2569 flags.go:64] FLAG: --v="2"
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085393    2569 flags.go:64] FLAG: --version="false"
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085397    2569 flags.go:64] FLAG: --vmodule=""
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085400    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.085403    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085523    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085527    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085530    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085533    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085536    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085540    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085544    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085547    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085550    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085553    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085556    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085559    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:04.094422 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085562    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085565    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085568    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085571    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085573    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085576    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085579    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085581    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085584    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085586    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085590    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085593    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085596    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085598    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085601    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085603    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085606    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085608    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085611    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085613    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:04.094984 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085615    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085618    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085621    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085623    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085626    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085628    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085631    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085634    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085636    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085640    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085643    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085645    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085648    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085650    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085653    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085655    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085658    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085660    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.085664    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:04.095468 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086042    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086046    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086049    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086053    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086055    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086058    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086060    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086063    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086066    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086069    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086071    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086074    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086076    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086079    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086081    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086084    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086086    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086089    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086091    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:04.095989 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086095    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086098    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086102    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086106    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086108    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086111    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086114    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086117    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086120    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086122    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086125    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086127    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086130    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086133    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086136    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086138    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086142    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086144    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086147    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086149    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:04.096455 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086152    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086154    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086157    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086159    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086162    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086164    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086166    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086169    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.086171    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.086734    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.094954    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.094969    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.095760    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.095767    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 14:15:04.096991 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095823    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095828    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095831    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095834    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095837    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095840    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095843    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095845    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095848    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095850    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095853    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095856    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095859    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095861    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095864    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095867    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095884    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095887    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095889    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:04.097337 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095892    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095894    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095897    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095900    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095902    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095904    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095907    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095910    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095912    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095915    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095919    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095922    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095925    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095927    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095929    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095932    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095935    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095937    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095940    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095942    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:04.097793 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095945    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095948    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095950    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095952    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095955    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095957    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095960    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095963    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095966    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095968    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095971    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095973    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095976    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095978    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095982    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095986    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095989    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095992    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095994    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:04.098523 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.095998    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096000    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096003    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096007    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096015    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096019    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096022    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096025    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096027    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096030    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096032    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096035    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096037    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096040    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096042    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096045    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096047    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096050    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096052    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096055    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:04.099272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096057    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096061    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096065    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096068    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096072    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096075    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096077    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096080    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096083    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096086    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096089    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096091    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096094    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096096    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096099    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096101    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096104    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096107    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096109    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:04.099813 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096112    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096114    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.096119    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096231    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096236    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096239    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096242    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096244    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096246    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096250    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096254    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096257    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096260    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096263    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 14:15:04.100443 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096265    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096268    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096270    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096273    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096275    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096278    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096280    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096282    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096285    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096287    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096290    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096292    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096294    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096297    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096301    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096304    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096308    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096311    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096314    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096317    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 14:15:04.100782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096319    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096322    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096324    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096327    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096329    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096332    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096334    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096337    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096339    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096342    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096344    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096347    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096349    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096352    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096354    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096357    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096359    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096361    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096364    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096366    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 14:15:04.101350 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096369    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096371    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096374    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096376    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096379    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096382    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096385    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096388    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096390    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096393    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096396    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096398    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096401    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096403    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096406    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096409    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096411    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096413    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096416    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096419    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 14:15:04.101822 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096421    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096423    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096426    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096429    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096431    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096434    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096436    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096438    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096441    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096443    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096446    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096448    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096450    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096453    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096456    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096458    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096461    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096463    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096466    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096469    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 14:15:04.102356 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096471    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 14:15:04.102857 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096474    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 14:15:04.102857 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096476    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 14:15:04.102857 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096479    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 14:15:04.102857 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096481    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 14:15:04.102857 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096484    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 14:15:04.102857 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096486    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 14:15:04.102857 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:04.096489    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 14:15:04.102857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.096493    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 14:15:04.102857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.096593    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 14:15:04.102857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.100001    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 14:15:04.102857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.101013    2569 server.go:1019] "Starting client certificate rotation"
Sep 11 14:15:04.102857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.101118    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 14:15:04.102857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.101163    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 14:15:04.103857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.103839    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 14:15:04.108525 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.108503    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 14:15:04.117163 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.117142    2569 log.go:25] "Validated CRI v1 runtime API"
Sep 11 14:15:04.121033 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.121018    2569 log.go:25] "Validated CRI v1 image API"
Sep 11 14:15:04.121918 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.121904    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 14:15:04.125518 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.125498    2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bcad38c9-0016-4730-81f6-e4c9be9d1f62:/dev/nvme0n1p4 db8145d4-900e-4bcc-a1db-c714fc65b890:/dev/nvme0n1p3]
Sep 11 14:15:04.125615 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.125518    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 14:15:04.131173 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.131051    2569 manager.go:216] Machine: {Timestamp:2026-09-11 14:15:04.129540376 +0000 UTC m=+0.344126029 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099833 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2de8dbb2914ae84e35f644bb8c6557 SystemUUID:ec2de8db-b291-4ae8-4e35-f644bb8c6557 BootID:48de031f-9ad0-425f-920d-ff5da1271b81 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:37:2e:c5:7e:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:37:2e:c5:7e:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:f7:50:e9:a7:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 14:15:04.131173 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.131165    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 14:15:04.131329 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.131315    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 14:15:04.132021 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.132005    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 14:15:04.134602 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.134578    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 14:15:04.134762 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.134608    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-70.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 14:15:04.135333 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.135323    2569 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 14:15:04.135373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.135336    2569 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 14:15:04.135373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.135344    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 14:15:04.136062 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.136051    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 14:15:04.136905 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.136895    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 14:15:04.140963 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.140950    2569 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 14:15:04.141078 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.141068    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 14:15:04.141114 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.141098    2569 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 14:15:04.141114 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.141108    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 14:15:04.141173 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.141119    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 14:15:04.141173 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.141133    2569 kubelet.go:398] "Adding apiserver pod source"
Sep 11 14:15:04.141173 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.141147    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 14:15:04.141516 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.141505    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 14:15:04.141556 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.141528    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 14:15:04.145027 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.145001    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 14:15:04.147314 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.147300    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 14:15:04.147370 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.147331    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 14:15:04.148736 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.148723    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 14:15:04.148794 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.148740    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 14:15:04.148794 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.148746    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 14:15:04.148794 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.148751    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 14:15:04.148794 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.148759    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 14:15:04.148794 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.148765    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 14:15:04.148794 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.148777    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 14:15:04.148794 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.148782    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 14:15:04.148794 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.148788    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 14:15:04.148794 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.148793    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 14:15:04.149052 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.148802    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 14:15:04.149052 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.148807    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 14:15:04.149489 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.149480    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 14:15:04.149521 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.149489    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 14:15:04.153565 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.153551    2569 server.go:1268] "Started kubelet"
Sep 11 14:15:04.153705 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.153648    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 14:15:04.153705 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.153697    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 14:15:04.153858 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.153697    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 14:15:04.153858 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.153724    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 14:15:04.153858 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.153751    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 14:15:04.154280 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.154259    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-70.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 14:15:04.154468 ip-10-0-137-70 systemd[1]: Started Kubernetes Kubelet.
Sep 11 14:15:04.155146 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.154788    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 14:15:04.155789 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.155775    2569 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 14:15:04.158603 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.158585    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xsjnt"
Sep 11 14:15:04.159389 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.159365    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 14:15:04.160634 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.160615    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 14:15:04.160983 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.159987    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-70.ec2.internal.18d449ceb6e5a35e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-70.ec2.internal,UID:ip-10-0-137-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-70.ec2.internal,},FirstTimestamp:2026-09-11 14:15:04.153523038 +0000 UTC m=+0.368108689,LastTimestamp:2026-09-11 14:15:04.153523038 +0000 UTC m=+0.368108689,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-70.ec2.internal,}"
Sep 11 14:15:04.161143 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.161123    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 14:15:04.161251 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.161236    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-70.ec2.internal\" not found"
Sep 11 14:15:04.161814 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.161715    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 14:15:04.161814 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.161719    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 14:15:04.161814 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.161755    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 14:15:04.162003 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.161885    2569 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 14:15:04.162003 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.161897    2569 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 14:15:04.162352 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.162326    2569 factory.go:153] Registering CRI-O factory
Sep 11 14:15:04.162352 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.162347    2569 factory.go:223] Registration of the crio container factory successfully
Sep 11 14:15:04.162450 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.162413    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 14:15:04.162450 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.162423    2569 factory.go:55] Registering systemd factory
Sep 11 14:15:04.162450 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.162431    2569 factory.go:223] Registration of the systemd container factory successfully
Sep 11 14:15:04.162450 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.162447    2569 factory.go:103] Registering Raw factory
Sep 11 14:15:04.162593 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.162463    2569 manager.go:1196] Started watching for new ooms in manager
Sep 11 14:15:04.162778 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.162768    2569 manager.go:349] Starting recovery of all containers
Sep 11 14:15:04.169904 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.169854    2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 14:15:04.172488 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.172457    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 14:15:04.173704 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.173690    2569 manager.go:354] Recovery completed
Sep 11 14:15:04.174700 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.174678    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xsjnt"
Sep 11 14:15:04.175796 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.175766    2569 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 11 14:15:04.178653 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.178641    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:04.181071 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.181059    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:04.181137 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.181087    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:04.181137 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.181100    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:04.181624 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.181608    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 14:15:04.181624 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.181621    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 14:15:04.181762 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.181627    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:04.181762 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.181635    2569 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 14:15:04.182300 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.182287    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:04.182351 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.182311    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:04.182351 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.182320    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:04.183284 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.183212    2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-70.ec2.internal.18d449ceb88a046a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-70.ec2.internal,UID:ip-10-0-137-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-70.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-70.ec2.internal,},FirstTimestamp:2026-09-11 14:15:04.181073002 +0000 UTC m=+0.395658654,LastTimestamp:2026-09-11 14:15:04.181073002 +0000 UTC m=+0.395658654,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-70.ec2.internal,}"
Sep 11 14:15:04.183699 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.183687    2569 policy_none.go:49] "None policy: Start"
Sep 11 14:15:04.183735 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.183705    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 14:15:04.183735 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.183715    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 14:15:04.185722 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.185711    2569 policy_none.go:47] "Start"
Sep 11 14:15:04.217755 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.217585    2569 manager.go:337] "Starting Device Plugin manager"
Sep 11 14:15:04.243125 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.217787    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 14:15:04.243125 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.217802    2569 server.go:87] "Starting device plugin registration server"
Sep 11 14:15:04.243125 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.218034    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 14:15:04.243125 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.218063    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 14:15:04.243125 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.218144    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 14:15:04.243125 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.218214    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 14:15:04.243125 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.218221    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 14:15:04.243125 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.218783    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 14:15:04.243125 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.218834    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-70.ec2.internal\" not found"
Sep 11 14:15:04.262488 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.262459    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 14:15:04.263754 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.263732    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 14:15:04.263822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.263787    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 14:15:04.263822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.263809    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 14:15:04.263939 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.263923    2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 14:15:04.269127 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.269109    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:04.318222 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.318190    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:04.319245 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.319222    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:04.319356 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.319253    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:04.319356 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.319264    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:04.319356 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.319290    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.333310 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.333235    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.333310 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.333259    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-70.ec2.internal\": node \"ip-10-0-137-70.ec2.internal\" not found"
Sep 11 14:15:04.364442 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.364417    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-70.ec2.internal"]
Sep 11 14:15:04.364550 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.364487    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:04.369022 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.368995    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:04.369141 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.369026    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:04.369141 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.369039    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:04.371414 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.371399    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:04.371531 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.371515    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.371577 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.371548    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:04.372147 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.372133    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:04.372227 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.372146    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:04.372227 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.372159    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:04.372227 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.372166    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:04.372227 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.372173    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:04.372227 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.372175    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:04.374329 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.374316    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.374374 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.374340    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 14:15:04.375050 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.375020    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 14:15:04.375124 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.375055    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 14:15:04.375124 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.375065    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeHasSufficientPID"
Sep 11 14:15:04.392404 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.392387    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-70.ec2.internal\" not found" node="ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.395865 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.395851    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-70.ec2.internal\" not found" node="ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.442715 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.442694    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-70.ec2.internal\" not found"
Sep 11 14:15:04.543527 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.543501    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-70.ec2.internal\" not found"
Sep 11 14:15:04.563247 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.563222    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22695f11404e10618fed836926c7aa13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal\" (UID: \"22695f11404e10618fed836926c7aa13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.563315 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.563253    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22695f11404e10618fed836926c7aa13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal\" (UID: \"22695f11404e10618fed836926c7aa13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.563315 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.563269    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e1cf52d6cbbac365bbe6daf585bcf65c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-70.ec2.internal\" (UID: \"e1cf52d6cbbac365bbe6daf585bcf65c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.644318 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.644259    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-70.ec2.internal\" not found"
Sep 11 14:15:04.663798 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.663770    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22695f11404e10618fed836926c7aa13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal\" (UID: \"22695f11404e10618fed836926c7aa13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.663860 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.663800    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22695f11404e10618fed836926c7aa13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal\" (UID: \"22695f11404e10618fed836926c7aa13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.663860 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.663815    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e1cf52d6cbbac365bbe6daf585bcf65c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-70.ec2.internal\" (UID: \"e1cf52d6cbbac365bbe6daf585bcf65c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.663952 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.663870    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/22695f11404e10618fed836926c7aa13-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal\" (UID: \"22695f11404e10618fed836926c7aa13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.663952 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.663908    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e1cf52d6cbbac365bbe6daf585bcf65c-config\") pod \"kube-apiserver-proxy-ip-10-0-137-70.ec2.internal\" (UID: \"e1cf52d6cbbac365bbe6daf585bcf65c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.663952 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.663908    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22695f11404e10618fed836926c7aa13-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal\" (UID: \"22695f11404e10618fed836926c7aa13\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.695294 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.695260    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.698431 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:04.698413    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:04.744720 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.744698    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-70.ec2.internal\" not found"
Sep 11 14:15:04.845245 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.845209    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-70.ec2.internal\" not found"
Sep 11 14:15:04.945713 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:04.945644    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-70.ec2.internal\" not found"
Sep 11 14:15:05.046184 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:05.046155    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-70.ec2.internal\" not found"
Sep 11 14:15:05.100615 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:05.100577    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 14:15:05.101141 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:05.100725    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 14:15:05.147096 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:05.147065    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-70.ec2.internal\" not found"
Sep 11 14:15:05.178309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:05.178268    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 14:10:04 +0000 UTC" deadline="2028-05-12 23:23:37.903608035 +0000 UTC"
Sep 11 14:15:05.178309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:05.178305    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14625h8m32.725306334s"
Sep 11 14:15:05.247953 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:05.247928    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-70.ec2.internal\" not found"
Sep 11 14:15:05.323473 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:05.323440    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:05.361855 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:05.361822    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:05.380089 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:05.380059    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cf52d6cbbac365bbe6daf585bcf65c.slice/crio-a289487b9cebfb482ae6ccded00568f5f8d9132cdaa9a3e029a4b08aaf77e55c WatchSource:0}: Error finding container a289487b9cebfb482ae6ccded00568f5f8d9132cdaa9a3e029a4b08aaf77e55c: Status 404 returned error can't find the container with id a289487b9cebfb482ae6ccded00568f5f8d9132cdaa9a3e029a4b08aaf77e55c
Sep 11 14:15:05.382356 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:05.382331    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 14:15:05.384123 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:05.384109    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-70.ec2.internal"
Sep 11 14:15:05.384275 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:05.384254    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:15:05.396363 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:05.396347    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 14:15:05.402432 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:05.402416    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:05.727079 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:05.726986    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:05.920983 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:05.920942    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22695f11404e10618fed836926c7aa13.slice/crio-7319f014327c546580ba8be49504deaa09f188d5749540255ae09310a6add04a WatchSource:0}: Error finding container 7319f014327c546580ba8be49504deaa09f188d5749540255ae09310a6add04a: Status 404 returned error can't find the container with id 7319f014327c546580ba8be49504deaa09f188d5749540255ae09310a6add04a
Sep 11 14:15:06.142954 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.142848    2569 apiserver.go:52] "Watching apiserver"
Sep 11 14:15:06.154436 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.154405    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 14:15:06.156807 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.156764    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-2r7rd","openshift-multus/multus-dbw64","openshift-multus/network-metrics-daemon-wxmq8","openshift-network-diagnostics/network-check-target-mnwpp","openshift-ovn-kubernetes/ovnkube-node-4cqtv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq","openshift-dns/node-resolver-fxxs7","openshift-image-registry/node-ca-9xsgk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal","openshift-multus/multus-additional-cni-plugins-xl97m","openshift-network-operator/iptables-alerter-9jp7s","kube-system/global-pull-secret-syncer-r5927","kube-system/konnectivity-agent-vl9mq","kube-system/kube-apiserver-proxy-ip-10-0-137-70.ec2.internal"]
Sep 11 14:15:06.159551 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.159520    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fxxs7"
Sep 11 14:15:06.161684 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.161659    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 14:15:06.161877 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.161856    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vl9mq"
Sep 11 14:15:06.163181 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.163156    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 14:15:06.163299 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.163231    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 14:15:06.163299 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.163271    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fnjk8\""
Sep 11 14:15:06.164233 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.164215    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:06.164323 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.164280    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:06.166685 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.166511    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:06.166685 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.166578    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:06.166922 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.166900    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 14:15:06.167648 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.167628    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 14:15:06.167749 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.167671    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j6l7d\""
Sep 11 14:15:06.169108 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.169090    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.171488 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.171470    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6caa6d55-9fb4-4249-af2b-3c08a3d7a220-hosts-file\") pod \"node-resolver-fxxs7\" (UID: \"6caa6d55-9fb4-4249-af2b-3c08a3d7a220\") " pod="openshift-dns/node-resolver-fxxs7"
Sep 11 14:15:06.171596 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.171496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kxxs\" (UniqueName: \"kubernetes.io/projected/6caa6d55-9fb4-4249-af2b-3c08a3d7a220-kube-api-access-9kxxs\") pod \"node-resolver-fxxs7\" (UID: \"6caa6d55-9fb4-4249-af2b-3c08a3d7a220\") " pod="openshift-dns/node-resolver-fxxs7"
Sep 11 14:15:06.171596 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.171514    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01118f14-e151-4c1b-b875-28625a864d8e-agent-certs\") pod \"konnectivity-agent-vl9mq\" (UID: \"01118f14-e151-4c1b-b875-28625a864d8e\") " pod="kube-system/konnectivity-agent-vl9mq"
Sep 11 14:15:06.171596 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.171532    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6caa6d55-9fb4-4249-af2b-3c08a3d7a220-tmp-dir\") pod \"node-resolver-fxxs7\" (UID: \"6caa6d55-9fb4-4249-af2b-3c08a3d7a220\") " pod="openshift-dns/node-resolver-fxxs7"
Sep 11 14:15:06.171596 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.171549    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01118f14-e151-4c1b-b875-28625a864d8e-konnectivity-ca\") pod \"konnectivity-agent-vl9mq\" (UID: \"01118f14-e151-4c1b-b875-28625a864d8e\") " pod="kube-system/konnectivity-agent-vl9mq"
Sep 11 14:15:06.171596 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.171574    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:06.171596 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.171594    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfm7h\" (UniqueName: \"kubernetes.io/projected/9a377b10-7140-40c6-9e69-c228066e6001-kube-api-access-xfm7h\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:06.172501 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.172481    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.174261 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.174244    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 14:15:06.174563 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.174547    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 14:15:06.174855 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.174837    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 14:15:06.175485 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.175467    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9xsgk"
Sep 11 14:15:06.175925 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.175874    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 14:15:06.176664 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.176643    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rcqb6\""
Sep 11 14:15:06.176769 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.176724    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 14:15:06.176837 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.176775    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 14:15:06.177083 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.177059    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-vhfbv\""
Sep 11 14:15:06.177195 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.177159    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 14:15:06.177195 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.177176    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 14:15:06.177350 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.177279    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 14:15:06.178207 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.178190    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.180851 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.180828    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.182827 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.182805    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 14:15:06.183259 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.183243    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 14:15:06.183848 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.183833    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 14:15:06.184840 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.184809    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 14:15:06.184953 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.184916    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 14:15:06.185022 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.184984    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:15:06.185085 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.184923    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kfss7\""
Sep 11 14:15:06.186601 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.186582    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 14:15:06.186864 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.186842    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 14:15:06.187269 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.187251    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k455g\""
Sep 11 14:15:06.187596 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.187575    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.189318 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.189276    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sxttc\""
Sep 11 14:15:06.190161 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.190131    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9jp7s"
Sep 11 14:15:06.191059 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.191041    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vwmwk\""
Sep 11 14:15:06.192124 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.192101    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 14:15:06.192217 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.192141    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 14:15:06.192635 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.192617    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:06.192704 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.192681    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:06.195850 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.195826    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 14:15:06.195927 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.195853    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 14:15:06.196279 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.196262    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:15:06.196374 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.196337    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 14:15:06.196433 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.196369    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 14:15:06.196646 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.196633    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-lnk52\""
Sep 11 14:15:06.227863 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.227842    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gg5nw"
Sep 11 14:15:06.246548 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.246514    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gg5nw"
Sep 11 14:15:06.263111 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.263086    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 14:15:06.271136 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.271080    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal" event={"ID":"22695f11404e10618fed836926c7aa13","Type":"ContainerStarted","Data":"7319f014327c546580ba8be49504deaa09f188d5749540255ae09310a6add04a"}
Sep 11 14:15:06.271854 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.271828    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-env-overrides\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.272020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.271866    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-lib-modules\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.272020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.271910    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-tuned\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.272020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.271942    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01118f14-e151-4c1b-b875-28625a864d8e-konnectivity-ca\") pod \"konnectivity-agent-vl9mq\" (UID: \"01118f14-e151-4c1b-b875-28625a864d8e\") " pod="kube-system/konnectivity-agent-vl9mq"
Sep 11 14:15:06.272020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.271971    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qlp5\" (UniqueName: \"kubernetes.io/projected/af819a26-a7ea-4678-a737-c6c983dab0ed-kube-api-access-9qlp5\") pod \"node-ca-9xsgk\" (UID: \"af819a26-a7ea-4678-a737-c6c983dab0ed\") " pod="openshift-image-registry/node-ca-9xsgk"
Sep 11 14:15:06.272020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.271999    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9b3cebd-137c-46da-927d-157e75ea0e2c-kubelet-config\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:06.272353 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272154    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-var-lib-openvswitch\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.272353 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272207    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.272353 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272247    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-ovn-node-metrics-cert\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.272353 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272273    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmppw\" (UniqueName: \"kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw\") pod \"network-check-target-mnwpp\" (UID: \"41208f90-7b15-4cc9-b228-ef2e636fd6f2\") " pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:06.272353 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272311    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-run-netns\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.272353 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-var-lib-cni-bin\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.272553 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-multus-conf-dir\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.272553 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272387    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-systemd-units\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.272553 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272443    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfm7h\" (UniqueName: \"kubernetes.io/projected/9a377b10-7140-40c6-9e69-c228066e6001-kube-api-access-xfm7h\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:06.272553 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272484    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af819a26-a7ea-4678-a737-c6c983dab0ed-host\") pod \"node-ca-9xsgk\" (UID: \"af819a26-a7ea-4678-a737-c6c983dab0ed\") " pod="openshift-image-registry/node-ca-9xsgk"
Sep 11 14:15:06.272553 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272507    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-sys\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.272553 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272532    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/816e4492-6b85-40a8-b37c-d5afdcb11a10-host-slash\") pod \"iptables-alerter-9jp7s\" (UID: \"816e4492-6b85-40a8-b37c-d5afdcb11a10\") " pod="openshift-network-operator/iptables-alerter-9jp7s"
Sep 11 14:15:06.272750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272558    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf6f5\" (UniqueName: \"kubernetes.io/projected/816e4492-6b85-40a8-b37c-d5afdcb11a10-kube-api-access-vf6f5\") pod \"iptables-alerter-9jp7s\" (UID: \"816e4492-6b85-40a8-b37c-d5afdcb11a10\") " pod="openshift-network-operator/iptables-alerter-9jp7s"
Sep 11 14:15:06.272750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272584    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9b3cebd-137c-46da-927d-157e75ea0e2c-dbus\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:06.272750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272605    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/01118f14-e151-4c1b-b875-28625a864d8e-konnectivity-ca\") pod \"konnectivity-agent-vl9mq\" (UID: \"01118f14-e151-4c1b-b875-28625a864d8e\") " pod="kube-system/konnectivity-agent-vl9mq"
Sep 11 14:15:06.272750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272620    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-socket-dir\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.272750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272693    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-multus-cni-dir\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.272945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272743    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-run-k8s-cni-cncf-io\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.272945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272752    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-70.ec2.internal" event={"ID":"e1cf52d6cbbac365bbe6daf585bcf65c","Type":"ContainerStarted","Data":"a289487b9cebfb482ae6ccded00568f5f8d9132cdaa9a3e029a4b08aaf77e55c"}
Sep 11 14:15:06.272945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272778    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f59501e6-d33f-4b89-babe-eef822f42409-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.272945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272805    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5tls\" (UniqueName: \"kubernetes.io/projected/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-kube-api-access-p5tls\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.272945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272831    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.272945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272855    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-registration-dir\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.272945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272881    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:06.272945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272905    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-sysconfig\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.272945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272938    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b6e7d0b-9246-4281-a276-2ced09337418-cni-binary-copy\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.273346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.272981    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-multus-socket-dir-parent\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.273346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273007    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b6e7d0b-9246-4281-a276-2ced09337418-multus-daemon-config\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.273346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273032    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-etc-kubernetes\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.273346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273084    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-run-ovn\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.273346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273154    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-ovnkube-config\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.273346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273187    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-ovnkube-script-lib\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.273346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273218    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af819a26-a7ea-4678-a737-c6c983dab0ed-serviceca\") pod \"node-ca-9xsgk\" (UID: \"af819a26-a7ea-4678-a737-c6c983dab0ed\") " pod="openshift-image-registry/node-ca-9xsgk"
Sep 11 14:15:06.273346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273249    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-cnibin\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.273346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273275    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-run-multus-certs\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.273346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273304    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6caa6d55-9fb4-4249-af2b-3c08a3d7a220-hosts-file\") pod \"node-resolver-fxxs7\" (UID: \"6caa6d55-9fb4-4249-af2b-3c08a3d7a220\") " pod="openshift-dns/node-resolver-fxxs7"
Sep 11 14:15:06.273787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273365    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kxxs\" (UniqueName: \"kubernetes.io/projected/6caa6d55-9fb4-4249-af2b-3c08a3d7a220-kube-api-access-9kxxs\") pod \"node-resolver-fxxs7\" (UID: \"6caa6d55-9fb4-4249-af2b-3c08a3d7a220\") " pod="openshift-dns/node-resolver-fxxs7"
Sep 11 14:15:06.273787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273374    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6caa6d55-9fb4-4249-af2b-3c08a3d7a220-hosts-file\") pod \"node-resolver-fxxs7\" (UID: \"6caa6d55-9fb4-4249-af2b-3c08a3d7a220\") " pod="openshift-dns/node-resolver-fxxs7"
Sep 11 14:15:06.273787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273404    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01118f14-e151-4c1b-b875-28625a864d8e-agent-certs\") pod \"konnectivity-agent-vl9mq\" (UID: \"01118f14-e151-4c1b-b875-28625a864d8e\") " pod="kube-system/konnectivity-agent-vl9mq"
Sep 11 14:15:06.273787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273446    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-var-lib-kubelet\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.273787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273567    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f59501e6-d33f-4b89-babe-eef822f42409-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.273787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273626    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.273787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273664    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-cni-netd\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.273787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273699    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-run\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.273787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273739    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-kubernetes\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.273787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273760    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-sysctl-d\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.273787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273782    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-sysctl-conf\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273808    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-var-lib-cni-multus\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273831    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-var-lib-kubelet\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273851    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-hostroot\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273870    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-run-openvswitch\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273932    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-sys-fs\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.273974    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7dw7\" (UniqueName: \"kubernetes.io/projected/c07f6914-f5c7-4830-8090-d30e8429429a-kube-api-access-q7dw7\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274010    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274002    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274037    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx774\" (UniqueName: \"kubernetes.io/projected/f59501e6-d33f-4b89-babe-eef822f42409-kube-api-access-gx774\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274062    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-run-systemd\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274097    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-etc-selinux\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.274110    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274127    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-host\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274148    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-tmp\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274171    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59501e6-d33f-4b89-babe-eef822f42409-system-cni-dir\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274196    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-log-socket\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.274242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274229    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-cni-bin\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274258    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v86dk\" (UniqueName: \"kubernetes.io/projected/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-kube-api-access-v86dk\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.274308    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs podName:9a377b10-7140-40c6-9e69-c228066e6001 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:06.774274282 +0000 UTC m=+2.988859941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs") pod "network-metrics-daemon-wxmq8" (UID: "9a377b10-7140-40c6-9e69-c228066e6001") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274327    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-modprobe-d\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274372    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6caa6d55-9fb4-4249-af2b-3c08a3d7a220-tmp-dir\") pod \"node-resolver-fxxs7\" (UID: \"6caa6d55-9fb4-4249-af2b-3c08a3d7a220\") " pod="openshift-dns/node-resolver-fxxs7"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274399    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-systemd\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274428    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/816e4492-6b85-40a8-b37c-d5afdcb11a10-iptables-alerter-script\") pod \"iptables-alerter-9jp7s\" (UID: \"816e4492-6b85-40a8-b37c-d5afdcb11a10\") " pod="openshift-network-operator/iptables-alerter-9jp7s"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274452    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-kubelet\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274485    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-node-log\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274539    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f59501e6-d33f-4b89-babe-eef822f42409-cnibin\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f59501e6-d33f-4b89-babe-eef822f42409-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274591    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-run-netns\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274605    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-etc-openvswitch\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274638    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xg2m\" (UniqueName: \"kubernetes.io/projected/6b6e7d0b-9246-4281-a276-2ced09337418-kube-api-access-8xg2m\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274678    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-device-dir\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274712    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-system-cni-dir\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.275043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274736    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f59501e6-d33f-4b89-babe-eef822f42409-cni-binary-copy\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.275647 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274762    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-slash\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.275647 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.274825    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6caa6d55-9fb4-4249-af2b-3c08a3d7a220-tmp-dir\") pod \"node-resolver-fxxs7\" (UID: \"6caa6d55-9fb4-4249-af2b-3c08a3d7a220\") " pod="openshift-dns/node-resolver-fxxs7"
Sep 11 14:15:06.278262 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.278242    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/01118f14-e151-4c1b-b875-28625a864d8e-agent-certs\") pod \"konnectivity-agent-vl9mq\" (UID: \"01118f14-e151-4c1b-b875-28625a864d8e\") " pod="kube-system/konnectivity-agent-vl9mq"
Sep 11 14:15:06.294342 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.294310    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfm7h\" (UniqueName: \"kubernetes.io/projected/9a377b10-7140-40c6-9e69-c228066e6001-kube-api-access-xfm7h\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:06.295643 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.295616    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kxxs\" (UniqueName: \"kubernetes.io/projected/6caa6d55-9fb4-4249-af2b-3c08a3d7a220-kube-api-access-9kxxs\") pod \"node-resolver-fxxs7\" (UID: \"6caa6d55-9fb4-4249-af2b-3c08a3d7a220\") " pod="openshift-dns/node-resolver-fxxs7"
Sep 11 14:15:06.375978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.375927    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v86dk\" (UniqueName: \"kubernetes.io/projected/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-kube-api-access-v86dk\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.375978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.375984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-modprobe-d\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.376235 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.376008    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-systemd\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.376235 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.376030    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/816e4492-6b85-40a8-b37c-d5afdcb11a10-iptables-alerter-script\") pod \"iptables-alerter-9jp7s\" (UID: \"816e4492-6b85-40a8-b37c-d5afdcb11a10\") " pod="openshift-network-operator/iptables-alerter-9jp7s"
Sep 11 14:15:06.376235 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.376052    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-kubelet\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.376235 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.376072    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-node-log\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.376235 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.376093    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f59501e6-d33f-4b89-babe-eef822f42409-cnibin\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.376235 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.376155    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-modprobe-d\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.376235 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.376179    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-kubelet\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.376235 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.376204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f59501e6-d33f-4b89-babe-eef822f42409-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.376235 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.376227    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-run-netns\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.380952 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.376244    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-etc-openvswitch\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.381084 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381017    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-systemd\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.381084 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381030    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-run-netns\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.381205 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.376226    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-node-log\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.381205 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381128    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-etc-openvswitch\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.381205 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381141    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f59501e6-d33f-4b89-babe-eef822f42409-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.381205 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381160    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xg2m\" (UniqueName: \"kubernetes.io/projected/6b6e7d0b-9246-4281-a276-2ced09337418-kube-api-access-8xg2m\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.381205 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381152    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f59501e6-d33f-4b89-babe-eef822f42409-cnibin\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.381428 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381314    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-device-dir\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.381428 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381368    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-system-cni-dir\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.381428 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381378    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-device-dir\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.381570 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381405    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f59501e6-d33f-4b89-babe-eef822f42409-cni-binary-copy\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.381570 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381482    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-slash\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.381570 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381517    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-env-overrides\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.381570 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381528    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/816e4492-6b85-40a8-b37c-d5afdcb11a10-iptables-alerter-script\") pod \"iptables-alerter-9jp7s\" (UID: \"816e4492-6b85-40a8-b37c-d5afdcb11a10\") " pod="openshift-network-operator/iptables-alerter-9jp7s"
Sep 11 14:15:06.381570 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381548    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-lib-modules\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.381813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381583    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-slash\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.381813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381579    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-tuned\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.381813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381643    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qlp5\" (UniqueName: \"kubernetes.io/projected/af819a26-a7ea-4678-a737-c6c983dab0ed-kube-api-access-9qlp5\") pod \"node-ca-9xsgk\" (UID: \"af819a26-a7ea-4678-a737-c6c983dab0ed\") " pod="openshift-image-registry/node-ca-9xsgk"
Sep 11 14:15:06.381813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381680    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9b3cebd-137c-46da-927d-157e75ea0e2c-kubelet-config\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:06.381813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381714    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-var-lib-openvswitch\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.381813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381750    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.382129 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381822    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-ovn-node-metrics-cert\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.382129 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381851    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmppw\" (UniqueName: \"kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw\") pod \"network-check-target-mnwpp\" (UID: \"41208f90-7b15-4cc9-b228-ef2e636fd6f2\") " pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:06.382129 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381883    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-run-netns\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.382129 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381968    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-var-lib-cni-bin\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.382129 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382002    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-multus-conf-dir\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.382129 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382032    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-systemd-units\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.382129 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382098    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f59501e6-d33f-4b89-babe-eef822f42409-cni-binary-copy\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.382129 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382111    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-env-overrides\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.382529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382107    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af819a26-a7ea-4678-a737-c6c983dab0ed-host\") pod \"node-ca-9xsgk\" (UID: \"af819a26-a7ea-4678-a737-c6c983dab0ed\") " pod="openshift-image-registry/node-ca-9xsgk"
Sep 11 14:15:06.382529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.381452    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-system-cni-dir\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.382529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382178    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/af819a26-a7ea-4678-a737-c6c983dab0ed-host\") pod \"node-ca-9xsgk\" (UID: \"af819a26-a7ea-4678-a737-c6c983dab0ed\") " pod="openshift-image-registry/node-ca-9xsgk"
Sep 11 14:15:06.382529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382254    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-multus-conf-dir\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.382529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382301    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-run-netns\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.382529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382258    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-sys\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.382529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382350    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-var-lib-cni-bin\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.382529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/816e4492-6b85-40a8-b37c-d5afdcb11a10-host-slash\") pod \"iptables-alerter-9jp7s\" (UID: \"816e4492-6b85-40a8-b37c-d5afdcb11a10\") " pod="openshift-network-operator/iptables-alerter-9jp7s"
Sep 11 14:15:06.382529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382399    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/816e4492-6b85-40a8-b37c-d5afdcb11a10-host-slash\") pod \"iptables-alerter-9jp7s\" (UID: \"816e4492-6b85-40a8-b37c-d5afdcb11a10\") " pod="openshift-network-operator/iptables-alerter-9jp7s"
Sep 11 14:15:06.382529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382399    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf6f5\" (UniqueName: \"kubernetes.io/projected/816e4492-6b85-40a8-b37c-d5afdcb11a10-kube-api-access-vf6f5\") pod \"iptables-alerter-9jp7s\" (UID: \"816e4492-6b85-40a8-b37c-d5afdcb11a10\") " pod="openshift-network-operator/iptables-alerter-9jp7s"
Sep 11 14:15:06.382529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382441    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9b3cebd-137c-46da-927d-157e75ea0e2c-dbus\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:06.382529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382509    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-systemd-units\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.383149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382546    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-socket-dir\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.383149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382553    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e9b3cebd-137c-46da-927d-157e75ea0e2c-dbus\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:06.383149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382692    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-sys\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.383149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382695    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-multus-cni-dir\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.383149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382756    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-run-k8s-cni-cncf-io\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.383149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382830    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-socket-dir\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.383149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382886    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-lib-modules\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.383149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382892    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f59501e6-d33f-4b89-babe-eef822f42409-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.383149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382973    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.383149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.382967    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-run-k8s-cni-cncf-io\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.383149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383030    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-var-lib-openvswitch\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.383149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383082    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e9b3cebd-137c-46da-927d-157e75ea0e2c-kubelet-config\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:06.383149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383129    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5tls\" (UniqueName: \"kubernetes.io/projected/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-kube-api-access-p5tls\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.383791 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383182    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.383791 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383356    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-registration-dir\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.383791 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383433    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:06.383791 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383493    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f59501e6-d33f-4b89-babe-eef822f42409-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.383791 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383471    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-multus-cni-dir\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.383791 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383510    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-sysconfig\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.383791 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383604    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-registration-dir\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.383791 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383675    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b6e7d0b-9246-4281-a276-2ced09337418-cni-binary-copy\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.383791 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383717    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-multus-socket-dir-parent\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.383791 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383740    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-sysconfig\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.383791 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383794    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b6e7d0b-9246-4281-a276-2ced09337418-multus-daemon-config\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.384373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383800    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.384373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383847    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-multus-socket-dir-parent\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.384373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383877    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-etc-kubernetes\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.384373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-run-ovn\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.384373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383980    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-etc-kubernetes\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.384373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.383981    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-run-ovn\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.384373 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.384015    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:06.384697 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.384053    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-ovnkube-config\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.384753 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.384129    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret podName:e9b3cebd-137c-46da-927d-157e75ea0e2c nodeName:}" failed. No retries permitted until 2026-09-11 14:15:06.884109144 +0000 UTC m=+3.098694801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret") pod "global-pull-secret-syncer-r5927" (UID: "e9b3cebd-137c-46da-927d-157e75ea0e2c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:06.384818 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.384459    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b6e7d0b-9246-4281-a276-2ced09337418-cni-binary-copy\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.384818 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.384527    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b6e7d0b-9246-4281-a276-2ced09337418-multus-daemon-config\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.384924 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.384670    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-tuned\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.384924 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.384666    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-ovnkube-config\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.384924 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.384910    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-ovnkube-script-lib\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.385105 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.384954    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af819a26-a7ea-4678-a737-c6c983dab0ed-serviceca\") pod \"node-ca-9xsgk\" (UID: \"af819a26-a7ea-4678-a737-c6c983dab0ed\") " pod="openshift-image-registry/node-ca-9xsgk"
Sep 11 14:15:06.385105 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.384988    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-cnibin\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.385105 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385048    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-run-multus-certs\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.385266 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385126    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-run-multus-certs\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.385266 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385143    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-cnibin\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.385266 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385153    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-ovn-node-metrics-cert\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.385266 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385171    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-var-lib-kubelet\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.385266 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385244    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f59501e6-d33f-4b89-babe-eef822f42409-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.385266 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385227    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-var-lib-kubelet\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.385605 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385285    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.385605 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385305    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-cni-netd\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.385605 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385336    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-run\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.385605 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385405    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.385605 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385403    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-kubernetes\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.385605 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385481    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-cni-netd\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.385605 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385531    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/af819a26-a7ea-4678-a737-c6c983dab0ed-serviceca\") pod \"node-ca-9xsgk\" (UID: \"af819a26-a7ea-4678-a737-c6c983dab0ed\") " pod="openshift-image-registry/node-ca-9xsgk"
Sep 11 14:15:06.385605 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385539    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-run\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385614    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-ovnkube-script-lib\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385613    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-sysctl-d\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385677    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-sysctl-conf\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385616    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-kubernetes\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385716    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-var-lib-cni-multus\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385730    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-sysctl-d\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385732    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f59501e6-d33f-4b89-babe-eef822f42409-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385740    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-var-lib-kubelet\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385795    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-var-lib-cni-multus\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385819    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-hostroot\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385806    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-host-var-lib-kubelet\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385850    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-etc-sysctl-conf\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385862    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b6e7d0b-9246-4281-a276-2ced09337418-hostroot\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385874    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-run-openvswitch\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385924    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-sys-fs\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.386044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.385955    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7dw7\" (UniqueName: \"kubernetes.io/projected/c07f6914-f5c7-4830-8090-d30e8429429a-kube-api-access-q7dw7\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386467    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx774\" (UniqueName: \"kubernetes.io/projected/f59501e6-d33f-4b89-babe-eef822f42409-kube-api-access-gx774\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-run-systemd\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386514    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-etc-selinux\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386530    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-host\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386546    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-tmp\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386546    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-sys-fs\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386563    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59501e6-d33f-4b89-babe-eef822f42409-system-cni-dir\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386412    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-run-openvswitch\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386602    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-log-socket\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386634    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-cni-bin\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386706    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-host-cni-bin\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386748    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-log-socket\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386795    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-host\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.386832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386833    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-run-systemd\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.387623 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386882    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c07f6914-f5c7-4830-8090-d30e8429429a-etc-selinux\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.387623 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.386885    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f59501e6-d33f-4b89-babe-eef822f42409-system-cni-dir\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.388991 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.388971    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-tmp\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.408170 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.408079    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xg2m\" (UniqueName: \"kubernetes.io/projected/6b6e7d0b-9246-4281-a276-2ced09337418-kube-api-access-8xg2m\") pod \"multus-dbw64\" (UID: \"6b6e7d0b-9246-4281-a276-2ced09337418\") " pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.409516 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.409495    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 14:15:06.416718 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.416684    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qlp5\" (UniqueName: \"kubernetes.io/projected/af819a26-a7ea-4678-a737-c6c983dab0ed-kube-api-access-9qlp5\") pod \"node-ca-9xsgk\" (UID: \"af819a26-a7ea-4678-a737-c6c983dab0ed\") " pod="openshift-image-registry/node-ca-9xsgk"
Sep 11 14:15:06.420855 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.420830    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:06.420992 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.420861    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:06.420992 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.420873    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7dw7\" (UniqueName: \"kubernetes.io/projected/c07f6914-f5c7-4830-8090-d30e8429429a-kube-api-access-q7dw7\") pod \"aws-ebs-csi-driver-node-tffpq\" (UID: \"c07f6914-f5c7-4830-8090-d30e8429429a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.420992 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.420895    2569 projected.go:196] Error preparing data for projected volume kube-api-access-nmppw for pod openshift-network-diagnostics/network-check-target-mnwpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:06.421138 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.421006    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw podName:41208f90-7b15-4cc9-b228-ef2e636fd6f2 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:06.920989151 +0000 UTC m=+3.135574792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-nmppw" (UniqueName: "kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw") pod "network-check-target-mnwpp" (UID: "41208f90-7b15-4cc9-b228-ef2e636fd6f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:06.421244 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.421218    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx774\" (UniqueName: \"kubernetes.io/projected/f59501e6-d33f-4b89-babe-eef822f42409-kube-api-access-gx774\") pod \"multus-additional-cni-plugins-xl97m\" (UID: \"f59501e6-d33f-4b89-babe-eef822f42409\") " pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.423519 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.423499    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf6f5\" (UniqueName: \"kubernetes.io/projected/816e4492-6b85-40a8-b37c-d5afdcb11a10-kube-api-access-vf6f5\") pod \"iptables-alerter-9jp7s\" (UID: \"816e4492-6b85-40a8-b37c-d5afdcb11a10\") " pod="openshift-network-operator/iptables-alerter-9jp7s"
Sep 11 14:15:06.432891 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.432845    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v86dk\" (UniqueName: \"kubernetes.io/projected/f284ef64-d5bf-4ea0-98bf-8d073ab500ce-kube-api-access-v86dk\") pod \"tuned-2r7rd\" (UID: \"f284ef64-d5bf-4ea0-98bf-8d073ab500ce\") " pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.438688 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.438667    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5tls\" (UniqueName: \"kubernetes.io/projected/d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc-kube-api-access-p5tls\") pod \"ovnkube-node-4cqtv\" (UID: \"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.471623 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.471592    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fxxs7"
Sep 11 14:15:06.479305 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.479283    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vl9mq"
Sep 11 14:15:06.493402 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.493224    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:06.497166 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.497148    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq"
Sep 11 14:15:06.504052 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.504030    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9xsgk"
Sep 11 14:15:06.511096 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.510953    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2r7rd"
Sep 11 14:15:06.516713 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.516693    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dbw64"
Sep 11 14:15:06.524427 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.524408    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xl97m"
Sep 11 14:15:06.530101 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.530083    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9jp7s"
Sep 11 14:15:06.789336 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.789250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:06.789493 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.789431    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:06.789552 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.789504    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs podName:9a377b10-7140-40c6-9e69-c228066e6001 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:07.789482932 +0000 UTC m=+4.004068577 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs") pod "network-metrics-daemon-wxmq8" (UID: "9a377b10-7140-40c6-9e69-c228066e6001") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:06.889696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.889642    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:06.889923 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.889871    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:06.890000 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.889949    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret podName:e9b3cebd-137c-46da-927d-157e75ea0e2c nodeName:}" failed. No retries permitted until 2026-09-11 14:15:07.889912116 +0000 UTC m=+4.104497761 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret") pod "global-pull-secret-syncer-r5927" (UID: "e9b3cebd-137c-46da-927d-157e75ea0e2c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:06.953414 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:06.953375    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf284ef64_d5bf_4ea0_98bf_8d073ab500ce.slice/crio-4ecef0862f3e796835d3a9358ba2524928fab377749cddb728fc48a9c2c1d7da WatchSource:0}: Error finding container 4ecef0862f3e796835d3a9358ba2524928fab377749cddb728fc48a9c2c1d7da: Status 404 returned error can't find the container with id 4ecef0862f3e796835d3a9358ba2524928fab377749cddb728fc48a9c2c1d7da
Sep 11 14:15:06.985186 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:06.985151    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod816e4492_6b85_40a8_b37c_d5afdcb11a10.slice/crio-a7bbf4b07b4a8aa8fa0af30b12cf542101160466953c27c157ce1124022120d5 WatchSource:0}: Error finding container a7bbf4b07b4a8aa8fa0af30b12cf542101160466953c27c157ce1124022120d5: Status 404 returned error can't find the container with id a7bbf4b07b4a8aa8fa0af30b12cf542101160466953c27c157ce1124022120d5
Sep 11 14:15:06.986640 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:06.986604    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf819a26_a7ea_4678_a737_c6c983dab0ed.slice/crio-3b52b1c93749368e68f89391bb73d98ea036d199de6c396ed0e95fb5f368fe92 WatchSource:0}: Error finding container 3b52b1c93749368e68f89391bb73d98ea036d199de6c396ed0e95fb5f368fe92: Status 404 returned error can't find the container with id 3b52b1c93749368e68f89391bb73d98ea036d199de6c396ed0e95fb5f368fe92
Sep 11 14:15:06.988069 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:06.988042    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6caa6d55_9fb4_4249_af2b_3c08a3d7a220.slice/crio-9d409eacdfaaa5bdd9f9bff6f0d07ea0f56d0566741c615261f669c310fa3a0e WatchSource:0}: Error finding container 9d409eacdfaaa5bdd9f9bff6f0d07ea0f56d0566741c615261f669c310fa3a0e: Status 404 returned error can't find the container with id 9d409eacdfaaa5bdd9f9bff6f0d07ea0f56d0566741c615261f669c310fa3a0e
Sep 11 14:15:06.991203 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:06.990155    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmppw\" (UniqueName: \"kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw\") pod \"network-check-target-mnwpp\" (UID: \"41208f90-7b15-4cc9-b228-ef2e636fd6f2\") " pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:06.991203 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.990305    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:06.991203 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.990326    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:06.991203 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.990339    2569 projected.go:196] Error preparing data for projected volume kube-api-access-nmppw for pod openshift-network-diagnostics/network-check-target-mnwpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:06.991203 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:06.990394    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw podName:41208f90-7b15-4cc9-b228-ef2e636fd6f2 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:07.990373475 +0000 UTC m=+4.204959123 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-nmppw" (UniqueName: "kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw") pod "network-check-target-mnwpp" (UID: "41208f90-7b15-4cc9-b228-ef2e636fd6f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:06.994623 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:06.994190    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01118f14_e151_4c1b_b875_28625a864d8e.slice/crio-8876ba8fb58f7121783d29d5f01a27adb5340d0b15adc34d368184d07e5523f2 WatchSource:0}: Error finding container 8876ba8fb58f7121783d29d5f01a27adb5340d0b15adc34d368184d07e5523f2: Status 404 returned error can't find the container with id 8876ba8fb58f7121783d29d5f01a27adb5340d0b15adc34d368184d07e5523f2
Sep 11 14:15:06.996204 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:06.995679    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6e7d0b_9246_4281_a276_2ced09337418.slice/crio-dc72b90498739f18ea4f383d7916e6a7b12478fa6c63f0c3a81966530bd813e5 WatchSource:0}: Error finding container dc72b90498739f18ea4f383d7916e6a7b12478fa6c63f0c3a81966530bd813e5: Status 404 returned error can't find the container with id dc72b90498739f18ea4f383d7916e6a7b12478fa6c63f0c3a81966530bd813e5
Sep 11 14:15:07.251374 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.251146    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 14:10:07 +0000 UTC" deadline="2028-03-21 14:50:57.385865533 +0000 UTC"
Sep 11 14:15:07.251374 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.251367    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13368h35m50.134502104s"
Sep 11 14:15:07.264509 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.264477    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:07.264651 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:07.264606    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:07.276867 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.276836    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fxxs7" event={"ID":"6caa6d55-9fb4-4249-af2b-3c08a3d7a220","Type":"ContainerStarted","Data":"9d409eacdfaaa5bdd9f9bff6f0d07ea0f56d0566741c615261f669c310fa3a0e"}
Sep 11 14:15:07.278395 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.278360    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dbw64" event={"ID":"6b6e7d0b-9246-4281-a276-2ced09337418","Type":"ContainerStarted","Data":"dc72b90498739f18ea4f383d7916e6a7b12478fa6c63f0c3a81966530bd813e5"}
Sep 11 14:15:07.279871 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.279840    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq" event={"ID":"c07f6914-f5c7-4830-8090-d30e8429429a","Type":"ContainerStarted","Data":"aeb8ed777f33e3abb1976e9af10d5bfd6ed0fe818565d6e6aeb3304a2f5ea183"}
Sep 11 14:15:07.281326 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.281270    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xl97m" event={"ID":"f59501e6-d33f-4b89-babe-eef822f42409","Type":"ContainerStarted","Data":"936d4c24e41d96d892f46943a1325ed9765014407f8414709ee92240eba3a513"}
Sep 11 14:15:07.282701 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.282678    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9xsgk" event={"ID":"af819a26-a7ea-4678-a737-c6c983dab0ed","Type":"ContainerStarted","Data":"3b52b1c93749368e68f89391bb73d98ea036d199de6c396ed0e95fb5f368fe92"}
Sep 11 14:15:07.284158 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.284127    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9jp7s" event={"ID":"816e4492-6b85-40a8-b37c-d5afdcb11a10","Type":"ContainerStarted","Data":"a7bbf4b07b4a8aa8fa0af30b12cf542101160466953c27c157ce1124022120d5"}
Sep 11 14:15:07.285702 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.285677    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2r7rd" event={"ID":"f284ef64-d5bf-4ea0-98bf-8d073ab500ce","Type":"ContainerStarted","Data":"4ecef0862f3e796835d3a9358ba2524928fab377749cddb728fc48a9c2c1d7da"}
Sep 11 14:15:07.288153 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.288124    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-70.ec2.internal" event={"ID":"e1cf52d6cbbac365bbe6daf585bcf65c","Type":"ContainerStarted","Data":"a1a48f01cc4aec708e46dc1caa793c67ceddc6d61e1496ddc551ad48cecb2bd7"}
Sep 11 14:15:07.289621 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.289597    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vl9mq" event={"ID":"01118f14-e151-4c1b-b875-28625a864d8e","Type":"ContainerStarted","Data":"8876ba8fb58f7121783d29d5f01a27adb5340d0b15adc34d368184d07e5523f2"}
Sep 11 14:15:07.291006 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.290983    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv" event={"ID":"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc","Type":"ContainerStarted","Data":"daaaa28fb0c2f31b77c7d38424cddc901e120b11c10dd596845d2bb675db17b2"}
Sep 11 14:15:07.796590 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.796492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:07.796759 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:07.796674    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:07.796759 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:07.796743    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs podName:9a377b10-7140-40c6-9e69-c228066e6001 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:09.796724071 +0000 UTC m=+6.011309733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs") pod "network-metrics-daemon-wxmq8" (UID: "9a377b10-7140-40c6-9e69-c228066e6001") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:07.898720 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.897986    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:07.898720 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:07.898160    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:07.898720 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:07.898229    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret podName:e9b3cebd-137c-46da-927d-157e75ea0e2c nodeName:}" failed. No retries permitted until 2026-09-11 14:15:09.898209927 +0000 UTC m=+6.112795573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret") pod "global-pull-secret-syncer-r5927" (UID: "e9b3cebd-137c-46da-927d-157e75ea0e2c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:07.999003 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:07.998955    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmppw\" (UniqueName: \"kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw\") pod \"network-check-target-mnwpp\" (UID: \"41208f90-7b15-4cc9-b228-ef2e636fd6f2\") " pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:07.999204 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:07.999129    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:07.999204 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:07.999149    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:07.999204 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:07.999164    2569 projected.go:196] Error preparing data for projected volume kube-api-access-nmppw for pod openshift-network-diagnostics/network-check-target-mnwpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:07.999371 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:07.999236    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw podName:41208f90-7b15-4cc9-b228-ef2e636fd6f2 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:09.999205919 +0000 UTC m=+6.213791577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-nmppw" (UniqueName: "kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw") pod "network-check-target-mnwpp" (UID: "41208f90-7b15-4cc9-b228-ef2e636fd6f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:08.251940 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:08.251893    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 14:10:07 +0000 UTC" deadline="2028-05-24 08:25:14.825629914 +0000 UTC"
Sep 11 14:15:08.251940 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:08.251937    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14898h10m6.573697221s"
Sep 11 14:15:08.266726 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:08.266698    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:08.266880 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:08.266845    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:08.266965 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:08.266929    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:08.267123 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:08.267032    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:08.300167 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:08.300131    2569 generic.go:356] "Generic (PLEG): container finished" podID="22695f11404e10618fed836926c7aa13" containerID="ed5f532aa4ee41df2df47f095751b133b4381a7b711fafb8788f1ea95c7c9106" exitCode=0
Sep 11 14:15:08.301114 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:08.301087    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal" event={"ID":"22695f11404e10618fed836926c7aa13","Type":"ContainerDied","Data":"ed5f532aa4ee41df2df47f095751b133b4381a7b711fafb8788f1ea95c7c9106"}
Sep 11 14:15:08.321329 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:08.321058    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-70.ec2.internal" podStartSLOduration=2.321036176 podStartE2EDuration="2.321036176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:07.312243911 +0000 UTC m=+3.526829575" watchObservedRunningTime="2026-09-11 14:15:08.321036176 +0000 UTC m=+4.535621841"
Sep 11 14:15:09.264672 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:09.264062    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:09.264672 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:09.264289    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:09.334797 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:09.334758    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal" event={"ID":"22695f11404e10618fed836926c7aa13","Type":"ContainerStarted","Data":"2a20af1a170e533d288e86090b25daa2cd3992820cac46b688465fb539627439"}
Sep 11 14:15:09.813663 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:09.813622    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:09.813891 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:09.813805    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:09.813891 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:09.813872    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs podName:9a377b10-7140-40c6-9e69-c228066e6001 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:13.81385365 +0000 UTC m=+10.028439307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs") pod "network-metrics-daemon-wxmq8" (UID: "9a377b10-7140-40c6-9e69-c228066e6001") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:09.914345 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:09.914256    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:09.914539 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:09.914443    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:09.914539 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:09.914512    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret podName:e9b3cebd-137c-46da-927d-157e75ea0e2c nodeName:}" failed. No retries permitted until 2026-09-11 14:15:13.914492972 +0000 UTC m=+10.129078627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret") pod "global-pull-secret-syncer-r5927" (UID: "e9b3cebd-137c-46da-927d-157e75ea0e2c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:10.015324 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:10.015280    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmppw\" (UniqueName: \"kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw\") pod \"network-check-target-mnwpp\" (UID: \"41208f90-7b15-4cc9-b228-ef2e636fd6f2\") " pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:10.015647 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:10.015565    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:10.015647 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:10.015590    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:10.015647 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:10.015606    2569 projected.go:196] Error preparing data for projected volume kube-api-access-nmppw for pod openshift-network-diagnostics/network-check-target-mnwpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:10.015841 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:10.015819    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw podName:41208f90-7b15-4cc9-b228-ef2e636fd6f2 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:14.015651443 +0000 UTC m=+10.230237085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-nmppw" (UniqueName: "kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw") pod "network-check-target-mnwpp" (UID: "41208f90-7b15-4cc9-b228-ef2e636fd6f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:10.266611 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:10.266529    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:10.267021 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:10.266670    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:10.267021 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:10.266899    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:10.267150 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:10.267109    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:11.264984 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:11.264937    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:11.265191 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:11.265080    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:12.265052 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:12.265022    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:12.265588 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:12.265082    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:12.265588 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:12.265179    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:12.267645 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:12.267615    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:13.264973 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:13.264818    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:13.265139 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:13.264968    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:13.850731 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:13.850180    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:13.850731 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:13.850367    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:13.850731 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:13.850437    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs podName:9a377b10-7140-40c6-9e69-c228066e6001 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:21.850420428 +0000 UTC m=+18.065006087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs") pod "network-metrics-daemon-wxmq8" (UID: "9a377b10-7140-40c6-9e69-c228066e6001") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:13.951378 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:13.951341    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:13.951561 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:13.951524    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:13.951620 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:13.951585    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret podName:e9b3cebd-137c-46da-927d-157e75ea0e2c nodeName:}" failed. No retries permitted until 2026-09-11 14:15:21.951566171 +0000 UTC m=+18.166151827 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret") pod "global-pull-secret-syncer-r5927" (UID: "e9b3cebd-137c-46da-927d-157e75ea0e2c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:14.053510 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:14.052851    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmppw\" (UniqueName: \"kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw\") pod \"network-check-target-mnwpp\" (UID: \"41208f90-7b15-4cc9-b228-ef2e636fd6f2\") " pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:14.053510 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:14.053059    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:14.053510 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:14.053079    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:14.053510 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:14.053093    2569 projected.go:196] Error preparing data for projected volume kube-api-access-nmppw for pod openshift-network-diagnostics/network-check-target-mnwpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:14.053510 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:14.053150    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw podName:41208f90-7b15-4cc9-b228-ef2e636fd6f2 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:22.053131768 +0000 UTC m=+18.267717413 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-nmppw" (UniqueName: "kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw") pod "network-check-target-mnwpp" (UID: "41208f90-7b15-4cc9-b228-ef2e636fd6f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:14.271022 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:14.266231    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:14.273308 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:14.271821    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:14.273308 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:14.271974    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:14.273308 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:14.272104    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:15.264800 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:15.264769    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:15.265034 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:15.264893    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:16.265089 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:16.265006    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:16.265555 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:16.265154    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:16.265555 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:16.265236    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:16.265555 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:16.265362    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:17.263985 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:17.263948    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:17.264187 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:17.264075    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:18.264048 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:18.264015    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:18.264393 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:18.264020    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:18.264393 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:18.264148    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:18.264393 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:18.264223    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:19.264296 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:19.264261    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:19.264690 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:19.264394    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:20.264565 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:20.264520    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:20.264565 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:20.264540    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:20.265099 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:20.264653    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:20.265099 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:20.264781    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:21.264115 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:21.264081    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:21.264334 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:21.264188    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:21.908996 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:21.908961    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:21.909384 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:21.909076    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:21.909384 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:21.909144    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs podName:9a377b10-7140-40c6-9e69-c228066e6001 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:37.909123649 +0000 UTC m=+34.123709331 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs") pod "network-metrics-daemon-wxmq8" (UID: "9a377b10-7140-40c6-9e69-c228066e6001") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:22.010234 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:22.010199    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:22.010401 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:22.010318    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:22.010401 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:22.010381    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret podName:e9b3cebd-137c-46da-927d-157e75ea0e2c nodeName:}" failed. No retries permitted until 2026-09-11 14:15:38.01036603 +0000 UTC m=+34.224951682 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret") pod "global-pull-secret-syncer-r5927" (UID: "e9b3cebd-137c-46da-927d-157e75ea0e2c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:22.111193 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:22.111161    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmppw\" (UniqueName: \"kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw\") pod \"network-check-target-mnwpp\" (UID: \"41208f90-7b15-4cc9-b228-ef2e636fd6f2\") " pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:22.111374 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:22.111319    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:22.111374 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:22.111339    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:22.111374 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:22.111350    2569 projected.go:196] Error preparing data for projected volume kube-api-access-nmppw for pod openshift-network-diagnostics/network-check-target-mnwpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:22.111509 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:22.111394    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw podName:41208f90-7b15-4cc9-b228-ef2e636fd6f2 nodeName:}" failed. No retries permitted until 2026-09-11 14:15:38.111379888 +0000 UTC m=+34.325965526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-nmppw" (UniqueName: "kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw") pod "network-check-target-mnwpp" (UID: "41208f90-7b15-4cc9-b228-ef2e636fd6f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:22.264750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:22.264274    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:22.264750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:22.264332    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:22.264750 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:22.264411    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:22.264750 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:22.264547    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:23.264558 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:23.264528    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:23.264989 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:23.264649    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:24.267472 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:24.267287    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:24.267896 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:24.267287    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:24.267896 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:24.267580    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:24.267896 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:24.267620    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:25.264035 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:25.264005    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:25.264189 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:25.264121    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:26.264077 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.264054    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:26.264370 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.264063    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:26.264370 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:26.264156    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:26.264370 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:26.264245    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:26.371419 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.371386    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vl9mq" event={"ID":"01118f14-e151-4c1b-b875-28625a864d8e","Type":"ContainerStarted","Data":"cf9b222ae538345fd5050c29a2f9fe3bb00350ac8d08cb12c03457fc34fd91ba"}
Sep 11 14:15:26.374407 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.374377    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv" event={"ID":"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc","Type":"ContainerStarted","Data":"d5a763d3c6a899fd85f036a11fb29c8d180d4f689db2927c31bfeb2998ad54dd"}
Sep 11 14:15:26.374514 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.374455    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv" event={"ID":"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc","Type":"ContainerStarted","Data":"822d7e59b2c9d62ec992d8a26c6dc03d8130ab2e70d640a1516b8fb771a2814a"}
Sep 11 14:15:26.374514 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.374496    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv" event={"ID":"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc","Type":"ContainerStarted","Data":"77d111b176853467a63ce0b25dfd5d34f6f13b14cc7fc5779d4443b9359d6566"}
Sep 11 14:15:26.374620 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.374529    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv" event={"ID":"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc","Type":"ContainerStarted","Data":"203175cb98ac585e56f213d65e7a8692bd48bb78e82c36ef3a6e6882f2f182a8"}
Sep 11 14:15:26.374620 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.374571    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv" event={"ID":"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc","Type":"ContainerStarted","Data":"35552e1e5b978bab0dff1491d384ff7ae1460c0f5471a2b86283ad3899125bd9"}
Sep 11 14:15:26.375793 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.375770    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fxxs7" event={"ID":"6caa6d55-9fb4-4249-af2b-3c08a3d7a220","Type":"ContainerStarted","Data":"8f3eef9cce70e2214250b13143684ea1d85298d48d6ccee2fe9110df6ce56812"}
Sep 11 14:15:26.377130 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.377110    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dbw64" event={"ID":"6b6e7d0b-9246-4281-a276-2ced09337418","Type":"ContainerStarted","Data":"5c228965ae2e35a072e7319a1cec0f5e42e6513daacbe952031b918226acb907"}
Sep 11 14:15:26.378520 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.378502    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq" event={"ID":"c07f6914-f5c7-4830-8090-d30e8429429a","Type":"ContainerStarted","Data":"8d72f0f66b32a61c9ba020af29b6bd0c70fed3a4ebc05469a3c7f3cdc836722b"}
Sep 11 14:15:26.379988 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.379965    2569 generic.go:356] "Generic (PLEG): container finished" podID="f59501e6-d33f-4b89-babe-eef822f42409" containerID="35a695ae2c305c003316f94fc9282660db95ca2cfcac91431d3e642b14847b77" exitCode=0
Sep 11 14:15:26.380073 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.380041    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xl97m" event={"ID":"f59501e6-d33f-4b89-babe-eef822f42409","Type":"ContainerDied","Data":"35a695ae2c305c003316f94fc9282660db95ca2cfcac91431d3e642b14847b77"}
Sep 11 14:15:26.381461 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.381442    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9xsgk" event={"ID":"af819a26-a7ea-4678-a737-c6c983dab0ed","Type":"ContainerStarted","Data":"10e77cbaf8f52308503a3418b2cb480e8eb45e5f8c71a1b469357a22983a7299"}
Sep 11 14:15:26.382832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.382814    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2r7rd" event={"ID":"f284ef64-d5bf-4ea0-98bf-8d073ab500ce","Type":"ContainerStarted","Data":"a27f10ddc79328a2e30ae85d8fa27ccd3b223e4a9e0282a9cae9d575c01972ca"}
Sep 11 14:15:26.438406 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.438363    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-70.ec2.internal" podStartSLOduration=20.438332963 podStartE2EDuration="20.438332963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:09.35419326 +0000 UTC m=+5.568778926" watchObservedRunningTime="2026-09-11 14:15:26.438332963 +0000 UTC m=+22.652918606"
Sep 11 14:15:26.438620 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.438600    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vl9mq" podStartSLOduration=2.6384920960000002 podStartE2EDuration="21.438592597s" totalImagesPullingTime="18.800100501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:26.438515168 +0000 UTC m=+22.653100829" watchObservedRunningTime="2026-09-11 14:15:26.438592597 +0000 UTC m=+22.653178257"
Sep 11 14:15:26.487436 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.487390    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dbw64" podStartSLOduration=2.636425217 podStartE2EDuration="21.487375939s" totalImagesPullingTime="18.850950722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:26.485942062 +0000 UTC m=+22.700527725" watchObservedRunningTime="2026-09-11 14:15:26.487375939 +0000 UTC m=+22.701961601"
Sep 11 14:15:26.538318 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.538267    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fxxs7" podStartSLOduration=6.062973147 podStartE2EDuration="21.538252201s" totalImagesPullingTime="15.475279054s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:26.538029223 +0000 UTC m=+22.752614884" watchObservedRunningTime="2026-09-11 14:15:26.538252201 +0000 UTC m=+22.752837861"
Sep 11 14:15:26.574576 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.574467    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9xsgk" podStartSLOduration=2.7585565020000002 podStartE2EDuration="21.5744467s" totalImagesPullingTime="18.815890198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:26.574436077 +0000 UTC m=+22.789021734" watchObservedRunningTime="2026-09-11 14:15:26.5744467 +0000 UTC m=+22.789032361"
Sep 11 14:15:26.662413 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:26.662366    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2r7rd" podStartSLOduration=2.812889954 podStartE2EDuration="21.662349687s" totalImagesPullingTime="18.849459733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:26.662316737 +0000 UTC m=+22.876902398" watchObservedRunningTime="2026-09-11 14:15:26.662349687 +0000 UTC m=+22.876935353"
Sep 11 14:15:27.264811 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:27.264784    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:27.265392 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:27.264951    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:27.311496 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:27.311465    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 14:15:27.386738 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:27.386700    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9jp7s" event={"ID":"816e4492-6b85-40a8-b37c-d5afdcb11a10","Type":"ContainerStarted","Data":"79aeee71f5821f85ddd94b18e4422e1e2f74ec7fce6d812fcb887bf6c6524980"}
Sep 11 14:15:27.390576 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:27.390430    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv" event={"ID":"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc","Type":"ContainerStarted","Data":"180679d60a80ed2bda49337aac9c30757af05aa8dddbafafe360603a9be87d1e"}
Sep 11 14:15:27.392369 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:27.392342    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq" event={"ID":"c07f6914-f5c7-4830-8090-d30e8429429a","Type":"ContainerStarted","Data":"bf549d6d814404219e732cfea361de6fdd9c50165eeed8cb783f6a2c66ddb25f"}
Sep 11 14:15:27.404061 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:27.404013    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9jp7s" podStartSLOduration=6.927384195 podStartE2EDuration="22.40399994s" totalImagesPullingTime="15.476615745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:27.403928388 +0000 UTC m=+23.618514048" watchObservedRunningTime="2026-09-11 14:15:27.40399994 +0000 UTC m=+23.618585601"
Sep 11 14:15:28.229971 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:28.229808    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T14:15:27.311491824Z","UUID":"10e33d7b-fc4f-44c3-a9d5-a6ea3b50390f","Handler":null,"Name":"","Endpoint":""}
Sep 11 14:15:28.231483 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:28.231458    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 14:15:28.231620 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:28.231496    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 14:15:28.264995 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:28.264031    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:28.264995 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:28.264037    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:28.264995 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:28.264146    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:28.264995 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:28.264236    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:28.397231 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:28.397189    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq" event={"ID":"c07f6914-f5c7-4830-8090-d30e8429429a","Type":"ContainerStarted","Data":"1883462d524a3648e3cb27f508747a6a239dfc5072b7f1214434e78388929e6d"}
Sep 11 14:15:28.418317 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:28.418253    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tffpq" podStartSLOduration=2.604737257 podStartE2EDuration="23.418230689s" totalImagesPullingTime="20.813493432s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:28.41696238 +0000 UTC m=+24.631548042" watchObservedRunningTime="2026-09-11 14:15:28.418230689 +0000 UTC m=+24.632816352"
Sep 11 14:15:29.264892 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:29.264840    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:29.265062 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:29.264978    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:29.403619 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:29.403584    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv" event={"ID":"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc","Type":"ContainerStarted","Data":"ab6f8fc61e7729bb06e5d9260729b74b002fc7219f8633d19c42d3031066ccd6"}
Sep 11 14:15:30.264987 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:30.264953    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:30.265181 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:30.264953    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:30.265181 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:30.265097    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:30.265564 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:30.265199    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:30.362088 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:30.361824    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vl9mq"
Sep 11 14:15:30.362744 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:30.362714    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vl9mq"
Sep 11 14:15:31.264647 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:31.264567    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:31.264781 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:31.264667    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:31.311961 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:31.311922    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vl9mq"
Sep 11 14:15:31.312600 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:31.312584    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vl9mq"
Sep 11 14:15:31.413039 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:31.413008    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv" event={"ID":"d7ed8f9b-f72a-4a6c-b005-e3a95bec04dc","Type":"ContainerStarted","Data":"71457a56421c24bc44cd0f7ece5d8b2d8f9fe54e7ce72ebaf58e30bbe939f48a"}
Sep 11 14:15:31.413326 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:31.413309    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:31.414894 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:31.414854    2569 generic.go:356] "Generic (PLEG): container finished" podID="f59501e6-d33f-4b89-babe-eef822f42409" containerID="73da43865e4afc8ec3469dec362b4a6226d2b0e2d027f0effe8f78db0a71bf55" exitCode=0
Sep 11 14:15:31.415011 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:31.414951    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xl97m" event={"ID":"f59501e6-d33f-4b89-babe-eef822f42409","Type":"ContainerDied","Data":"73da43865e4afc8ec3469dec362b4a6226d2b0e2d027f0effe8f78db0a71bf55"}
Sep 11 14:15:31.429929 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:31.429908    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:31.446616 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:31.446576    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv" podStartSLOduration=7.559951294 podStartE2EDuration="26.446560728s" totalImagesPullingTime="18.886609434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:31.445187325 +0000 UTC m=+27.659772986" watchObservedRunningTime="2026-09-11 14:15:31.446560728 +0000 UTC m=+27.661146388"
Sep 11 14:15:32.265095 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:32.264912    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:32.265275 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:32.264951    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:32.265275 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:32.265195    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:32.265275 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:32.265266    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:32.419617 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:32.419541    2569 generic.go:356] "Generic (PLEG): container finished" podID="f59501e6-d33f-4b89-babe-eef822f42409" containerID="513f5f0e500bef162be56eecbcc903fef36a273b9274496d81e40a2d96b1b3f9" exitCode=0
Sep 11 14:15:32.420031 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:32.419621    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xl97m" event={"ID":"f59501e6-d33f-4b89-babe-eef822f42409","Type":"ContainerDied","Data":"513f5f0e500bef162be56eecbcc903fef36a273b9274496d81e40a2d96b1b3f9"}
Sep 11 14:15:32.420505 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:32.420373    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:32.420505 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:32.420445    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:32.436717 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:32.436688    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:15:32.763097 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:32.763028    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mnwpp"]
Sep 11 14:15:32.763219 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:32.763131    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:32.763219 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:32.763203    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:32.765287 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:32.765261    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wxmq8"]
Sep 11 14:15:32.765407 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:32.765345    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:32.765458 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:32.765441    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:32.765858 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:32.765834    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r5927"]
Sep 11 14:15:32.765945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:32.765924    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:32.766012 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:32.765997    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:33.423933 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:33.423830    2569 generic.go:356] "Generic (PLEG): container finished" podID="f59501e6-d33f-4b89-babe-eef822f42409" containerID="45143274bd57e963f1289ad774ce9730d8a0b4065c941ce5dd7085486a2c4f5f" exitCode=0
Sep 11 14:15:33.424602 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:33.423927    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xl97m" event={"ID":"f59501e6-d33f-4b89-babe-eef822f42409","Type":"ContainerDied","Data":"45143274bd57e963f1289ad774ce9730d8a0b4065c941ce5dd7085486a2c4f5f"}
Sep 11 14:15:34.265451 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:34.265415    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:34.265599 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:34.265516    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:34.265599 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:34.265565    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:34.265741 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:34.265720    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:34.265866 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:34.265715    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:34.265866 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:34.265822    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:36.265079 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:36.264867    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:36.265495 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:36.265201    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:36.265495 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:36.264887    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:36.265495 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:36.265285    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:36.265495 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:36.264866    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:36.265495 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:36.265343    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:37.931615 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:37.931589    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:37.931943 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:37.931710    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:37.931943 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:37.931765    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs podName:9a377b10-7140-40c6-9e69-c228066e6001 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:09.931751 +0000 UTC m=+66.146336639 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs") pod "network-metrics-daemon-wxmq8" (UID: "9a377b10-7140-40c6-9e69-c228066e6001") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 14:15:38.032317 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.032244    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:38.032450 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:38.032391    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:38.032488 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:38.032459    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret podName:e9b3cebd-137c-46da-927d-157e75ea0e2c nodeName:}" failed. No retries permitted until 2026-09-11 14:16:10.032444515 +0000 UTC m=+66.247030171 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret") pod "global-pull-secret-syncer-r5927" (UID: "e9b3cebd-137c-46da-927d-157e75ea0e2c") : object "kube-system"/"original-pull-secret" not registered
Sep 11 14:15:38.132928 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.132886    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmppw\" (UniqueName: \"kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw\") pod \"network-check-target-mnwpp\" (UID: \"41208f90-7b15-4cc9-b228-ef2e636fd6f2\") " pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:38.133088 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:38.133028    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 14:15:38.133088 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:38.133045    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 14:15:38.133088 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:38.133054    2569 projected.go:196] Error preparing data for projected volume kube-api-access-nmppw for pod openshift-network-diagnostics/network-check-target-mnwpp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:38.133207 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:38.133107    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw podName:41208f90-7b15-4cc9-b228-ef2e636fd6f2 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:10.133091184 +0000 UTC m=+66.347676825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-nmppw" (UniqueName: "kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw") pod "network-check-target-mnwpp" (UID: "41208f90-7b15-4cc9-b228-ef2e636fd6f2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 14:15:38.264866 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.264837    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:38.265039 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.264849    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:38.265039 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:38.265004    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r5927" podUID="e9b3cebd-137c-46da-927d-157e75ea0e2c"
Sep 11 14:15:38.265113 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.265048    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:38.265146 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:38.265133    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wxmq8" podUID="9a377b10-7140-40c6-9e69-c228066e6001"
Sep 11 14:15:38.265221 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:38.265203    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mnwpp" podUID="41208f90-7b15-4cc9-b228-ef2e636fd6f2"
Sep 11 14:15:38.439402 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.439369    2569 generic.go:356] "Generic (PLEG): container finished" podID="f59501e6-d33f-4b89-babe-eef822f42409" containerID="262652383d8f04b718d3f3b7f8c97c8e936edff634190dfb36d7d3f7ed562865" exitCode=0
Sep 11 14:15:38.439541 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.439417    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xl97m" event={"ID":"f59501e6-d33f-4b89-babe-eef822f42409","Type":"ContainerDied","Data":"262652383d8f04b718d3f3b7f8c97c8e936edff634190dfb36d7d3f7ed562865"}
Sep 11 14:15:38.552428 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.552337    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-70.ec2.internal" event="NodeReady"
Sep 11 14:15:38.552565 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.552484    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 14:15:38.621706 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.621667    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4xxzr"]
Sep 11 14:15:38.632139 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.632117    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4kbd4"]
Sep 11 14:15:38.632281 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.632263    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4xxzr"
Sep 11 14:15:38.637612 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.637590    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 14:15:38.641266 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.641243    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 14:15:38.641266 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.641260    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 14:15:38.641442 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.641412    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nv8ln\""
Sep 11 14:15:38.644437 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.644416    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4xxzr"]
Sep 11 14:15:38.644539 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.644457    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4kbd4"]
Sep 11 14:15:38.644539 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.644523    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:38.646604 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.646587    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xhc84\""
Sep 11 14:15:38.647992 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.647975    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 14:15:38.648086 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.648013    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 14:15:38.737417 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.737382    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z452\" (UniqueName: \"kubernetes.io/projected/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-kube-api-access-9z452\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:38.737551 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.737468    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7hnb\" (UniqueName: \"kubernetes.io/projected/6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb-kube-api-access-q7hnb\") pod \"ingress-canary-4xxzr\" (UID: \"6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb\") " pod="openshift-ingress-canary/ingress-canary-4xxzr"
Sep 11 14:15:38.737551 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.737488    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-config-volume\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:38.737551 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.737502    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:38.737551 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.737528    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb-cert\") pod \"ingress-canary-4xxzr\" (UID: \"6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb\") " pod="openshift-ingress-canary/ingress-canary-4xxzr"
Sep 11 14:15:38.737699 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.737578    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-tmp-dir\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:38.838723 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.838692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-tmp-dir\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:38.838818 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.838729    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z452\" (UniqueName: \"kubernetes.io/projected/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-kube-api-access-9z452\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:38.838818 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.838779    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7hnb\" (UniqueName: \"kubernetes.io/projected/6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb-kube-api-access-q7hnb\") pod \"ingress-canary-4xxzr\" (UID: \"6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb\") " pod="openshift-ingress-canary/ingress-canary-4xxzr"
Sep 11 14:15:38.838818 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.838795    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-config-volume\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:38.838818 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.838809    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:38.839043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.838831    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb-cert\") pod \"ingress-canary-4xxzr\" (UID: \"6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb\") " pod="openshift-ingress-canary/ingress-canary-4xxzr"
Sep 11 14:15:38.839095 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:38.839037    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:38.839142 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:38.839114    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls podName:4e161a3f-4c64-4241-b8a7-455c2d3ca46f nodeName:}" failed. No retries permitted until 2026-09-11 14:15:39.339093632 +0000 UTC m=+35.553679278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls") pod "dns-default-4kbd4" (UID: "4e161a3f-4c64-4241-b8a7-455c2d3ca46f") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:38.839200 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.839131    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-tmp-dir\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:38.839419 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.839402    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-config-volume\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:38.843076 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.843060    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb-cert\") pod \"ingress-canary-4xxzr\" (UID: \"6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb\") " pod="openshift-ingress-canary/ingress-canary-4xxzr"
Sep 11 14:15:38.857316 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.857125    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z452\" (UniqueName: \"kubernetes.io/projected/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-kube-api-access-9z452\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:38.858730 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.858711    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7hnb\" (UniqueName: \"kubernetes.io/projected/6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb-kube-api-access-q7hnb\") pod \"ingress-canary-4xxzr\" (UID: \"6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb\") " pod="openshift-ingress-canary/ingress-canary-4xxzr"
Sep 11 14:15:38.984045 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:38.984003    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4xxzr"
Sep 11 14:15:39.317830 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:39.317626    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4xxzr"]
Sep 11 14:15:39.322062 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:15:39.322038    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ffb1bf5_08c6_4fa3_8379_ad8ba9ff74cb.slice/crio-4f053cca22c32c6a730087e51346c061fad31ac51b716ae3f3d83491e573e042 WatchSource:0}: Error finding container 4f053cca22c32c6a730087e51346c061fad31ac51b716ae3f3d83491e573e042: Status 404 returned error can't find the container with id 4f053cca22c32c6a730087e51346c061fad31ac51b716ae3f3d83491e573e042
Sep 11 14:15:39.343203 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:39.343178    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:39.343360 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:39.343340    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:39.343426 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:39.343412    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls podName:4e161a3f-4c64-4241-b8a7-455c2d3ca46f nodeName:}" failed. No retries permitted until 2026-09-11 14:15:40.343391761 +0000 UTC m=+36.557977416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls") pod "dns-default-4kbd4" (UID: "4e161a3f-4c64-4241-b8a7-455c2d3ca46f") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:39.445425 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:39.445387    2569 generic.go:356] "Generic (PLEG): container finished" podID="f59501e6-d33f-4b89-babe-eef822f42409" containerID="66867c05ae2849e37c09a9c3c9b30b4e50c136a014af95701f077293c25dbfbc" exitCode=0
Sep 11 14:15:39.445585 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:39.445462    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xl97m" event={"ID":"f59501e6-d33f-4b89-babe-eef822f42409","Type":"ContainerDied","Data":"66867c05ae2849e37c09a9c3c9b30b4e50c136a014af95701f077293c25dbfbc"}
Sep 11 14:15:39.446684 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:39.446662    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4xxzr" event={"ID":"6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb","Type":"ContainerStarted","Data":"4f053cca22c32c6a730087e51346c061fad31ac51b716ae3f3d83491e573e042"}
Sep 11 14:15:40.264888 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:40.264833    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:15:40.265462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:40.264981    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:15:40.265462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:40.264992    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:15:40.269394 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:40.268795    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 14:15:40.269394 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:40.269246    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 14:15:40.269394 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:40.269279    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 14:15:40.269820 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:40.269799    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lrm6v\""
Sep 11 14:15:40.269962 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:40.269849    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cqjkr\""
Sep 11 14:15:40.269962 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:40.269858    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 14:15:40.350296 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:40.350261    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:40.350482 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:40.350388    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:40.350482 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:40.350456    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls podName:4e161a3f-4c64-4241-b8a7-455c2d3ca46f nodeName:}" failed. No retries permitted until 2026-09-11 14:15:42.350438974 +0000 UTC m=+38.565024616 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls") pod "dns-default-4kbd4" (UID: "4e161a3f-4c64-4241-b8a7-455c2d3ca46f") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:40.453277 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:40.453242    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xl97m" event={"ID":"f59501e6-d33f-4b89-babe-eef822f42409","Type":"ContainerStarted","Data":"7ff2fca960ffdc40f92dec87a687d450d9edaf40d3d0f15de95df3ead887cde6"}
Sep 11 14:15:40.483576 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:40.483512    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xl97m" podStartSLOduration=6.771995761 podStartE2EDuration="35.483496413s" totalImagesPullingTime="28.711500652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:40.483113127 +0000 UTC m=+36.697698789" watchObservedRunningTime="2026-09-11 14:15:40.483496413 +0000 UTC m=+36.698082073"
Sep 11 14:15:42.365437 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:42.365399    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:42.366002 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:42.365514    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:42.366002 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:42.365566    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls podName:4e161a3f-4c64-4241-b8a7-455c2d3ca46f nodeName:}" failed. No retries permitted until 2026-09-11 14:15:46.365552886 +0000 UTC m=+42.580138537 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls") pod "dns-default-4kbd4" (UID: "4e161a3f-4c64-4241-b8a7-455c2d3ca46f") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:42.459757 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:42.459717    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4xxzr" event={"ID":"6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb","Type":"ContainerStarted","Data":"8f2ddc3b45c9a0a1e8c5aa6b883fdccc8e6383298d2d484064336d11a3284f95"}
Sep 11 14:15:46.390124 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:46.390080    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:46.390529 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:46.390247    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:46.390529 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:46.390315    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls podName:4e161a3f-4c64-4241-b8a7-455c2d3ca46f nodeName:}" failed. No retries permitted until 2026-09-11 14:15:54.39029987 +0000 UTC m=+50.604885512 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls") pod "dns-default-4kbd4" (UID: "4e161a3f-4c64-4241-b8a7-455c2d3ca46f") : secret "dns-default-metrics-tls" not found
Sep 11 14:15:54.450517 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:15:54.450475    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:15:54.450991 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:54.450595    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:15:54.450991 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:15:54.450662    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls podName:4e161a3f-4c64-4241-b8a7-455c2d3ca46f nodeName:}" failed. No retries permitted until 2026-09-11 14:16:10.450644666 +0000 UTC m=+66.665230319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls") pod "dns-default-4kbd4" (UID: "4e161a3f-4c64-4241-b8a7-455c2d3ca46f") : secret "dns-default-metrics-tls" not found
Sep 11 14:16:04.437894 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:04.437850    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4cqtv"
Sep 11 14:16:04.509023 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:04.508965    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4xxzr" podStartSLOduration=23.988379916 podStartE2EDuration="26.508945739s" totalImagesPullingTime="2.520565823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:15:42.486786194 +0000 UTC m=+38.701371852" watchObservedRunningTime="2026-09-11 14:16:04.508945739 +0000 UTC m=+60.723531400"
Sep 11 14:16:05.323713 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.323675    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"]
Sep 11 14:16:05.326472 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.326456    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"
Sep 11 14:16:05.341890 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.341860    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:16:05.342016 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.342000    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-jw9tq\""
Sep 11 14:16:05.350826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.350803    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 14:16:05.351970 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.351954    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 14:16:05.357243 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.357228    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 14:16:05.366962 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.366942    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"]
Sep 11 14:16:05.424921 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.424891    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/da9524fe-8b00-46c9-9683-271d619dba05-serving-cert\") pod \"service-ca-operator-cf7c776b7-pqz5j\" (UID: \"da9524fe-8b00-46c9-9683-271d619dba05\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"
Sep 11 14:16:05.425089 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.424933    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6wg2\" (UniqueName: \"kubernetes.io/projected/da9524fe-8b00-46c9-9683-271d619dba05-kube-api-access-n6wg2\") pod \"service-ca-operator-cf7c776b7-pqz5j\" (UID: \"da9524fe-8b00-46c9-9683-271d619dba05\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"
Sep 11 14:16:05.425089 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.424980    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/da9524fe-8b00-46c9-9683-271d619dba05-config\") pod \"service-ca-operator-cf7c776b7-pqz5j\" (UID: \"da9524fe-8b00-46c9-9683-271d619dba05\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"
Sep 11 14:16:05.463381 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.463349    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-g2trc"]
Sep 11 14:16:05.465383 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.465365    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.470799 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.470781    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 14:16:05.470941 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.470859    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:16:05.471016 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.470955    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 14:16:05.481375 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.481356    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 14:16:05.481565 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.481550    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kdjtd\""
Sep 11 14:16:05.482121 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.482104    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-mgbbx"]
Sep 11 14:16:05.483886 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.483853    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-mgbbx"
Sep 11 14:16:05.486630 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:05.486607    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"network-diagnostics-dockercfg-ttd7t\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-network-diagnostics\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ttd7t\"" type="*v1.Secret"
Sep 11 14:16:05.487219 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.487203    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 14:16:05.525994 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.525972    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6wg2\" (UniqueName: \"kubernetes.io/projected/da9524fe-8b00-46c9-9683-271d619dba05-kube-api-access-n6wg2\") pod \"service-ca-operator-cf7c776b7-pqz5j\" (UID: \"da9524fe-8b00-46c9-9683-271d619dba05\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"
Sep 11 14:16:05.526116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.526003    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c8baef3-30b3-4df3-bb34-fc6a997308b6-config\") pod \"console-operator-696884fb9c-g2trc\" (UID: \"4c8baef3-30b3-4df3-bb34-fc6a997308b6\") " pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.526116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.526018    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c8baef3-30b3-4df3-bb34-fc6a997308b6-trusted-ca\") pod \"console-operator-696884fb9c-g2trc\" (UID: \"4c8baef3-30b3-4df3-bb34-fc6a997308b6\") " pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.526116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.526038    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfjfk\" (UniqueName: \"kubernetes.io/projected/fc0272c6-1a8a-4fe9-a152-b300b337af71-kube-api-access-dfjfk\") pod \"network-check-source-6f8b768455-mgbbx\" (UID: \"fc0272c6-1a8a-4fe9-a152-b300b337af71\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-mgbbx"
Sep 11 14:16:05.526116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.526069    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/da9524fe-8b00-46c9-9683-271d619dba05-config\") pod \"service-ca-operator-cf7c776b7-pqz5j\" (UID: \"da9524fe-8b00-46c9-9683-271d619dba05\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"
Sep 11 14:16:05.526251 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.526135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7p755\" (UniqueName: \"kubernetes.io/projected/4c8baef3-30b3-4df3-bb34-fc6a997308b6-kube-api-access-7p755\") pod \"console-operator-696884fb9c-g2trc\" (UID: \"4c8baef3-30b3-4df3-bb34-fc6a997308b6\") " pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.526251 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.526166    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c8baef3-30b3-4df3-bb34-fc6a997308b6-serving-cert\") pod \"console-operator-696884fb9c-g2trc\" (UID: \"4c8baef3-30b3-4df3-bb34-fc6a997308b6\") " pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.526251 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.526234    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/da9524fe-8b00-46c9-9683-271d619dba05-serving-cert\") pod \"service-ca-operator-cf7c776b7-pqz5j\" (UID: \"da9524fe-8b00-46c9-9683-271d619dba05\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"
Sep 11 14:16:05.526512 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.526496    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/da9524fe-8b00-46c9-9683-271d619dba05-config\") pod \"service-ca-operator-cf7c776b7-pqz5j\" (UID: \"da9524fe-8b00-46c9-9683-271d619dba05\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"
Sep 11 14:16:05.529297 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.529271    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/da9524fe-8b00-46c9-9683-271d619dba05-serving-cert\") pod \"service-ca-operator-cf7c776b7-pqz5j\" (UID: \"da9524fe-8b00-46c9-9683-271d619dba05\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"
Sep 11 14:16:05.542280 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.542259    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-g2trc"]
Sep 11 14:16:05.550349 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.550329    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-mgbbx"]
Sep 11 14:16:05.560226 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.560201    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6wg2\" (UniqueName: \"kubernetes.io/projected/da9524fe-8b00-46c9-9683-271d619dba05-kube-api-access-n6wg2\") pod \"service-ca-operator-cf7c776b7-pqz5j\" (UID: \"da9524fe-8b00-46c9-9683-271d619dba05\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"
Sep 11 14:16:05.627377 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.627292    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7p755\" (UniqueName: \"kubernetes.io/projected/4c8baef3-30b3-4df3-bb34-fc6a997308b6-kube-api-access-7p755\") pod \"console-operator-696884fb9c-g2trc\" (UID: \"4c8baef3-30b3-4df3-bb34-fc6a997308b6\") " pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.627377 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.627331    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c8baef3-30b3-4df3-bb34-fc6a997308b6-serving-cert\") pod \"console-operator-696884fb9c-g2trc\" (UID: \"4c8baef3-30b3-4df3-bb34-fc6a997308b6\") " pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.627579 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.627556    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c8baef3-30b3-4df3-bb34-fc6a997308b6-config\") pod \"console-operator-696884fb9c-g2trc\" (UID: \"4c8baef3-30b3-4df3-bb34-fc6a997308b6\") " pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.627617 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.627595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c8baef3-30b3-4df3-bb34-fc6a997308b6-trusted-ca\") pod \"console-operator-696884fb9c-g2trc\" (UID: \"4c8baef3-30b3-4df3-bb34-fc6a997308b6\") " pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.627656 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.627627    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfjfk\" (UniqueName: \"kubernetes.io/projected/fc0272c6-1a8a-4fe9-a152-b300b337af71-kube-api-access-dfjfk\") pod \"network-check-source-6f8b768455-mgbbx\" (UID: \"fc0272c6-1a8a-4fe9-a152-b300b337af71\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-mgbbx"
Sep 11 14:16:05.628176 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.628148    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4c8baef3-30b3-4df3-bb34-fc6a997308b6-config\") pod \"console-operator-696884fb9c-g2trc\" (UID: \"4c8baef3-30b3-4df3-bb34-fc6a997308b6\") " pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.628441 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.628422    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4c8baef3-30b3-4df3-bb34-fc6a997308b6-trusted-ca\") pod \"console-operator-696884fb9c-g2trc\" (UID: \"4c8baef3-30b3-4df3-bb34-fc6a997308b6\") " pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.629845 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.629825    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4c8baef3-30b3-4df3-bb34-fc6a997308b6-serving-cert\") pod \"console-operator-696884fb9c-g2trc\" (UID: \"4c8baef3-30b3-4df3-bb34-fc6a997308b6\") " pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.634723 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.634706    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"
Sep 11 14:16:05.742705 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.742678    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7p755\" (UniqueName: \"kubernetes.io/projected/4c8baef3-30b3-4df3-bb34-fc6a997308b6-kube-api-access-7p755\") pod \"console-operator-696884fb9c-g2trc\" (UID: \"4c8baef3-30b3-4df3-bb34-fc6a997308b6\") " pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.758552 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.758529    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 14:16:05.768035 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.768008    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"]
Sep 11 14:16:05.770124 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.770110    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:05.771521 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.771504    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 14:16:05.773747 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.773729    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:05.780483 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.780370    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfjfk\" (UniqueName: \"kubernetes.io/projected/fc0272c6-1a8a-4fe9-a152-b300b337af71-kube-api-access-dfjfk\") pod \"network-check-source-6f8b768455-mgbbx\" (UID: \"fc0272c6-1a8a-4fe9-a152-b300b337af71\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-mgbbx"
Sep 11 14:16:05.829290 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.829261    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbz2w\" (UniqueName: \"kubernetes.io/projected/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-kube-api-access-xbz2w\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:05.829457 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.829311    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:05.829457 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.829337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:05.840126 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.840103    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 14:16:05.840432 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.840401    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-c89sv\""
Sep 11 14:16:05.841028 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.841009    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 14:16:05.841589 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.841571    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 14:16:05.841669 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.841589    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 14:16:05.842463 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.842442    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"]
Sep 11 14:16:05.930421 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.930396    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbz2w\" (UniqueName: \"kubernetes.io/projected/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-kube-api-access-xbz2w\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:05.930581 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.930430    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:05.930581 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.930446    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:05.933674 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:05.930891    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:05.933674 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:05.930992    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls podName:4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:06.430962943 +0000 UTC m=+62.645548585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-phwxt" (UID: "4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990") : secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:05.933674 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:05.932062    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:06.009168 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:06.009135    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbz2w\" (UniqueName: \"kubernetes.io/projected/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-kube-api-access-xbz2w\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:06.039405 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:06.039374    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j"]
Sep 11 14:16:06.042185 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:16:06.042161    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda9524fe_8b00_46c9_9683_271d619dba05.slice/crio-d513448374a02dc3c4b7ec0a8794bdf355bfa59e36c99d6016e41de1ca3fbc2d WatchSource:0}: Error finding container d513448374a02dc3c4b7ec0a8794bdf355bfa59e36c99d6016e41de1ca3fbc2d: Status 404 returned error can't find the container with id d513448374a02dc3c4b7ec0a8794bdf355bfa59e36c99d6016e41de1ca3fbc2d
Sep 11 14:16:06.123383 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:06.123354    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-g2trc"]
Sep 11 14:16:06.126866 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:16:06.126843    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8baef3_30b3_4df3_bb34_fc6a997308b6.slice/crio-53462f81f77b1cccabc2c749db47269d93623f6a1447208d129d68efee47f4de WatchSource:0}: Error finding container 53462f81f77b1cccabc2c749db47269d93623f6a1447208d129d68efee47f4de: Status 404 returned error can't find the container with id 53462f81f77b1cccabc2c749db47269d93623f6a1447208d129d68efee47f4de
Sep 11 14:16:06.434970 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:06.434940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:06.435133 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:06.435097    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:06.435172 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:06.435164    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls podName:4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:07.435147208 +0000 UTC m=+63.649732847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-phwxt" (UID: "4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990") : secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:06.515503 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:06.515466    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j" event={"ID":"da9524fe-8b00-46c9-9683-271d619dba05","Type":"ContainerStarted","Data":"d513448374a02dc3c4b7ec0a8794bdf355bfa59e36c99d6016e41de1ca3fbc2d"}
Sep 11 14:16:06.516491 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:06.516468    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-g2trc" event={"ID":"4c8baef3-30b3-4df3-bb34-fc6a997308b6","Type":"ContainerStarted","Data":"53462f81f77b1cccabc2c749db47269d93623f6a1447208d129d68efee47f4de"}
Sep 11 14:16:06.792334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:06.792240    2569 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-network-diagnostics/network-check-source-6f8b768455-mgbbx" secret="" err="failed to sync secret cache: timed out waiting for the condition"
Sep 11 14:16:06.792334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:06.792327    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-mgbbx"
Sep 11 14:16:07.001033 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:07.001003    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-ttd7t\""
Sep 11 14:16:07.097173 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:07.097084    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-mgbbx"]
Sep 11 14:16:07.106272 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:16:07.106243    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc0272c6_1a8a_4fe9_a152_b300b337af71.slice/crio-ebbba3518e0dad1511e68ef8282c4e54163ed65526759c54d5a710fc62ee4417 WatchSource:0}: Error finding container ebbba3518e0dad1511e68ef8282c4e54163ed65526759c54d5a710fc62ee4417: Status 404 returned error can't find the container with id ebbba3518e0dad1511e68ef8282c4e54163ed65526759c54d5a710fc62ee4417
Sep 11 14:16:07.445421 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:07.445384    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:07.445596 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:07.445540    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:07.445661 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:07.445617    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls podName:4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:09.445599343 +0000 UTC m=+65.660184986 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-phwxt" (UID: "4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990") : secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:07.520453 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:07.520413    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-mgbbx" event={"ID":"fc0272c6-1a8a-4fe9-a152-b300b337af71","Type":"ContainerStarted","Data":"ebbba3518e0dad1511e68ef8282c4e54163ed65526759c54d5a710fc62ee4417"}
Sep 11 14:16:08.525927 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:08.525234    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/0.log"
Sep 11 14:16:08.525927 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:08.525275    2569 generic.go:356] "Generic (PLEG): container finished" podID="4c8baef3-30b3-4df3-bb34-fc6a997308b6" containerID="ce94cfe92b9d90795ca436abd81da0f192678963b58ee0200ffcb36d66d82254" exitCode=255
Sep 11 14:16:08.525927 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:08.525307    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-g2trc" event={"ID":"4c8baef3-30b3-4df3-bb34-fc6a997308b6","Type":"ContainerDied","Data":"ce94cfe92b9d90795ca436abd81da0f192678963b58ee0200ffcb36d66d82254"}
Sep 11 14:16:08.525927 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:08.525615    2569 scope.go:117] "RemoveContainer" containerID="ce94cfe92b9d90795ca436abd81da0f192678963b58ee0200ffcb36d66d82254"
Sep 11 14:16:09.460094 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:09.460057    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:09.460271 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:09.460225    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:09.460331 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:09.460311    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls podName:4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:13.460288393 +0000 UTC m=+69.674874045 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-phwxt" (UID: "4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990") : secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:09.529742 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:09.529707    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:16:09.530477 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:09.530451    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/0.log"
Sep 11 14:16:09.530603 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:09.530502    2569 generic.go:356] "Generic (PLEG): container finished" podID="4c8baef3-30b3-4df3-bb34-fc6a997308b6" containerID="7c576e081be2b59d743460d5e94c5cd69060b3367ffdf91de0c23f70daff115a" exitCode=255
Sep 11 14:16:09.530603 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:09.530541    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-g2trc" event={"ID":"4c8baef3-30b3-4df3-bb34-fc6a997308b6","Type":"ContainerDied","Data":"7c576e081be2b59d743460d5e94c5cd69060b3367ffdf91de0c23f70daff115a"}
Sep 11 14:16:09.530603 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:09.530593    2569 scope.go:117] "RemoveContainer" containerID="ce94cfe92b9d90795ca436abd81da0f192678963b58ee0200ffcb36d66d82254"
Sep 11 14:16:09.530804 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:09.530788    2569 scope.go:117] "RemoveContainer" containerID="7c576e081be2b59d743460d5e94c5cd69060b3367ffdf91de0c23f70daff115a"
Sep 11 14:16:09.531015 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:09.530996    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-g2trc_openshift-console-operator(4c8baef3-30b3-4df3-bb34-fc6a997308b6)\"" pod="openshift-console-operator/console-operator-696884fb9c-g2trc" podUID="4c8baef3-30b3-4df3-bb34-fc6a997308b6"
Sep 11 14:16:09.965231 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:09.965193    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:16:09.968181 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:09.968150    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 14:16:09.976484 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:09.976461    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 14:16:09.976616 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:09.976534    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs podName:9a377b10-7140-40c6-9e69-c228066e6001 nodeName:}" failed. No retries permitted until 2026-09-11 14:17:13.976515563 +0000 UTC m=+130.191101218 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs") pod "network-metrics-daemon-wxmq8" (UID: "9a377b10-7140-40c6-9e69-c228066e6001") : secret "metrics-daemon-secret" not found
Sep 11 14:16:10.066319 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:10.066281    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:16:10.069434 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:10.069405    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 14:16:10.079461 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:10.079435    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e9b3cebd-137c-46da-927d-157e75ea0e2c-original-pull-secret\") pod \"global-pull-secret-syncer-r5927\" (UID: \"e9b3cebd-137c-46da-927d-157e75ea0e2c\") " pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:16:10.167285 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:10.167236    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmppw\" (UniqueName: \"kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw\") pod \"network-check-target-mnwpp\" (UID: \"41208f90-7b15-4cc9-b228-ef2e636fd6f2\") " pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:16:10.175585 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:10.175518    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmppw\" (UniqueName: \"kubernetes.io/projected/41208f90-7b15-4cc9-b228-ef2e636fd6f2-kube-api-access-nmppw\") pod \"network-check-target-mnwpp\" (UID: \"41208f90-7b15-4cc9-b228-ef2e636fd6f2\") " pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:16:10.279459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:10.279389    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cqjkr\""
Sep 11 14:16:10.284938 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:10.284913    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r5927"
Sep 11 14:16:10.287080 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:10.287055    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:16:10.471031 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:10.470994    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:16:10.471188 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:10.471169    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 14:16:10.471274 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:10.471251    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls podName:4e161a3f-4c64-4241-b8a7-455c2d3ca46f nodeName:}" failed. No retries permitted until 2026-09-11 14:16:42.471230679 +0000 UTC m=+98.685816333 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls") pod "dns-default-4kbd4" (UID: "4e161a3f-4c64-4241-b8a7-455c2d3ca46f") : secret "dns-default-metrics-tls" not found
Sep 11 14:16:10.534330 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:10.534252    2569 scope.go:117] "RemoveContainer" containerID="7c576e081be2b59d743460d5e94c5cd69060b3367ffdf91de0c23f70daff115a"
Sep 11 14:16:10.534757 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:10.534451    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-g2trc_openshift-console-operator(4c8baef3-30b3-4df3-bb34-fc6a997308b6)\"" pod="openshift-console-operator/console-operator-696884fb9c-g2trc" podUID="4c8baef3-30b3-4df3-bb34-fc6a997308b6"
Sep 11 14:16:11.066157 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.066080    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mnwpp"]
Sep 11 14:16:11.069663 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:16:11.069635    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41208f90_7b15_4cc9_b228_ef2e636fd6f2.slice/crio-8308e1b81adea2f54e1e4cb9222211605f1813d31d1f10d280dd4284da335508 WatchSource:0}: Error finding container 8308e1b81adea2f54e1e4cb9222211605f1813d31d1f10d280dd4284da335508: Status 404 returned error can't find the container with id 8308e1b81adea2f54e1e4cb9222211605f1813d31d1f10d280dd4284da335508
Sep 11 14:16:11.071846 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.071819    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r5927"]
Sep 11 14:16:11.074865 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:16:11.074842    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b3cebd_137c_46da_927d_157e75ea0e2c.slice/crio-45fa2bb9137552d005462d56376128f57c5b4e16198bbdd0b7639670174dd51c WatchSource:0}: Error finding container 45fa2bb9137552d005462d56376128f57c5b4e16198bbdd0b7639670174dd51c: Status 404 returned error can't find the container with id 45fa2bb9137552d005462d56376128f57c5b4e16198bbdd0b7639670174dd51c
Sep 11 14:16:11.400976 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.400890    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-dppg6"]
Sep 11 14:16:11.404320 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.404299    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.406947 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.406926    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 14:16:11.407288 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.407268    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 14:16:11.407377 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.407327    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 14:16:11.407483 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.407464    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 14:16:11.407927 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.407910    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lzjkv\""
Sep 11 14:16:11.433622 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.433592    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dppg6"]
Sep 11 14:16:11.479082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.479052    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc5l4\" (UniqueName: \"kubernetes.io/projected/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-api-access-fc5l4\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.479309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.479283    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/363387d2-5943-4a23-b2e1-b6fc3e298981-crio-socket\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.479444 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.479337    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.479444 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.479368    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/363387d2-5943-4a23-b2e1-b6fc3e298981-data-volume\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.479444 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.479393    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.538530 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.538494    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j" event={"ID":"da9524fe-8b00-46c9-9683-271d619dba05","Type":"ContainerStarted","Data":"409b91d3fbf7c7638246835f5489d5e21ffd732f142a968e9b49c7d92f8646e7"}
Sep 11 14:16:11.540665 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.540636    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r5927" event={"ID":"e9b3cebd-137c-46da-927d-157e75ea0e2c","Type":"ContainerStarted","Data":"45fa2bb9137552d005462d56376128f57c5b4e16198bbdd0b7639670174dd51c"}
Sep 11 14:16:11.542622 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.542602    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:16:11.544783 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.544759    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mnwpp" event={"ID":"41208f90-7b15-4cc9-b228-ef2e636fd6f2","Type":"ContainerStarted","Data":"524238830f8ab93d801a4583f7b6593a926a73ebbdb61d1536abf27fbee23940"}
Sep 11 14:16:11.544932 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.544817    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:16:11.544932 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.544840    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mnwpp" event={"ID":"41208f90-7b15-4cc9-b228-ef2e636fd6f2","Type":"ContainerStarted","Data":"8308e1b81adea2f54e1e4cb9222211605f1813d31d1f10d280dd4284da335508"}
Sep 11 14:16:11.546572 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.546551    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-mgbbx" event={"ID":"fc0272c6-1a8a-4fe9-a152-b300b337af71","Type":"ContainerStarted","Data":"51c33d16881acdc6226c778688b08827bc17fedd9fc21f74072bbc26b59bc268"}
Sep 11 14:16:11.566210 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.566157    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j" podStartSLOduration=1.8086326910000001 podStartE2EDuration="6.566141792s" totalImagesPullingTime="4.757509101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:11.565305166 +0000 UTC m=+67.779890826" watchObservedRunningTime="2026-09-11 14:16:11.566141792 +0000 UTC m=+67.780727494"
Sep 11 14:16:11.579752 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.579728    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc5l4\" (UniqueName: \"kubernetes.io/projected/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-api-access-fc5l4\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.579935 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.579767    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/363387d2-5943-4a23-b2e1-b6fc3e298981-crio-socket\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.579935 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.579826    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.579935 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.579869    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/363387d2-5943-4a23-b2e1-b6fc3e298981-data-volume\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.579935 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.579909    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.580119 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:11.580002    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:11.580119 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.580004    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/363387d2-5943-4a23-b2e1-b6fc3e298981-crio-socket\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.580119 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:11.580066    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm podName:363387d2-5943-4a23-b2e1-b6fc3e298981 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:12.080048235 +0000 UTC m=+68.294633887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dppg6" (UID: "363387d2-5943-4a23-b2e1-b6fc3e298981") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:11.580685 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:11.580667    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:11.580720 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.580711    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/363387d2-5943-4a23-b2e1-b6fc3e298981-data-volume\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.580753 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:11.580722    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls podName:363387d2-5943-4a23-b2e1-b6fc3e298981 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:12.080707052 +0000 UTC m=+68.295292705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dppg6" (UID: "363387d2-5943-4a23-b2e1-b6fc3e298981") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:11.620926 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.620868    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc5l4\" (UniqueName: \"kubernetes.io/projected/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-api-access-fc5l4\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:11.631065 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.631006    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-mgbbx" podStartSLOduration=2.929080448 podStartE2EDuration="6.630978446s" totalImagesPullingTime="3.701897998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:11.602078834 +0000 UTC m=+67.816664497" watchObservedRunningTime="2026-09-11 14:16:11.630978446 +0000 UTC m=+67.845564109"
Sep 11 14:16:11.631377 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:11.631343    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mnwpp" podStartSLOduration=66.631333674 podStartE2EDuration="1m6.631333674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:11.62909581 +0000 UTC m=+67.843681472" watchObservedRunningTime="2026-09-11 14:16:11.631333674 +0000 UTC m=+67.845919335"
Sep 11 14:16:12.083480 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:12.083441    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:12.083648 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:12.083491    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:12.083648 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:12.083601    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:12.083648 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:12.083602    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:12.083814 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:12.083660    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm podName:363387d2-5943-4a23-b2e1-b6fc3e298981 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:13.083643993 +0000 UTC m=+69.298229638 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dppg6" (UID: "363387d2-5943-4a23-b2e1-b6fc3e298981") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:12.083814 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:12.083678    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls podName:363387d2-5943-4a23-b2e1-b6fc3e298981 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:13.083668686 +0000 UTC m=+69.298254331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dppg6" (UID: "363387d2-5943-4a23-b2e1-b6fc3e298981") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:12.961949 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:12.961910    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hnhbr"]
Sep 11 14:16:12.966929 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:12.966902    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hnhbr"
Sep 11 14:16:12.975578 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:12.975551    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 14:16:12.975679 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:12.975630    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 14:16:12.976502 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:12.976483    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ptl9f\""
Sep 11 14:16:12.978037 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:12.978019    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hnhbr"]
Sep 11 14:16:12.990321 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:12.990297    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f452c\" (UniqueName: \"kubernetes.io/projected/8903189e-f5d2-4e14-a592-a4b1df525069-kube-api-access-f452c\") pod \"migrator-8b4d697c5-hnhbr\" (UID: \"8903189e-f5d2-4e14-a592-a4b1df525069\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hnhbr"
Sep 11 14:16:13.088431 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:13.088402    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fxxs7_6caa6d55-9fb4-4249-af2b-3c08a3d7a220/dns-node-resolver/0.log"
Sep 11 14:16:13.091727 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:13.091665    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f452c\" (UniqueName: \"kubernetes.io/projected/8903189e-f5d2-4e14-a592-a4b1df525069-kube-api-access-f452c\") pod \"migrator-8b4d697c5-hnhbr\" (UID: \"8903189e-f5d2-4e14-a592-a4b1df525069\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hnhbr"
Sep 11 14:16:13.091868 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:13.091739    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:13.091868 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:13.091771    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:13.092006 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:13.091863    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:13.092006 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:13.091958    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm podName:363387d2-5943-4a23-b2e1-b6fc3e298981 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:15.091940061 +0000 UTC m=+71.306525717 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dppg6" (UID: "363387d2-5943-4a23-b2e1-b6fc3e298981") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:13.092149 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:13.091864    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:13.092149 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:13.092070    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls podName:363387d2-5943-4a23-b2e1-b6fc3e298981 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:15.09205615 +0000 UTC m=+71.306641788 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dppg6" (UID: "363387d2-5943-4a23-b2e1-b6fc3e298981") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:13.109539 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:13.109516    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f452c\" (UniqueName: \"kubernetes.io/projected/8903189e-f5d2-4e14-a592-a4b1df525069-kube-api-access-f452c\") pod \"migrator-8b4d697c5-hnhbr\" (UID: \"8903189e-f5d2-4e14-a592-a4b1df525069\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hnhbr"
Sep 11 14:16:13.278304 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:13.278225    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hnhbr"
Sep 11 14:16:13.495083 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:13.495039    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:13.495260 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:13.495210    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:13.495315 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:13.495280    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls podName:4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:21.49526618 +0000 UTC m=+77.709851832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-phwxt" (UID: "4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990") : secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:13.590558 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:13.590474    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hnhbr"]
Sep 11 14:16:14.081670 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:14.081637    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9xsgk_af819a26-a7ea-4678-a737-c6c983dab0ed/node-ca/0.log"
Sep 11 14:16:14.725706 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:16:14.725672    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8903189e_f5d2_4e14_a592_a4b1df525069.slice/crio-ab2d742fbebe27f06a0b5958639dd1d19c185e804f621ba5d4d174a84ce542ef WatchSource:0}: Error finding container ab2d742fbebe27f06a0b5958639dd1d19c185e804f621ba5d4d174a84ce542ef: Status 404 returned error can't find the container with id ab2d742fbebe27f06a0b5958639dd1d19c185e804f621ba5d4d174a84ce542ef
Sep 11 14:16:14.889739 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:14.889714    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4xxzr_6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb/serve-healthcheck-canary/0.log"
Sep 11 14:16:15.106926 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:15.106814    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:15.106926 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:15.106855    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:15.107319 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:15.106983    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:15.107319 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:15.107023    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:15.107319 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:15.107055    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls podName:363387d2-5943-4a23-b2e1-b6fc3e298981 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:19.107040101 +0000 UTC m=+75.321625756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dppg6" (UID: "363387d2-5943-4a23-b2e1-b6fc3e298981") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:15.107319 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:15.107076    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm podName:363387d2-5943-4a23-b2e1-b6fc3e298981 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:19.107063144 +0000 UTC m=+75.321648787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dppg6" (UID: "363387d2-5943-4a23-b2e1-b6fc3e298981") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:15.559055 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:15.559023    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hnhbr" event={"ID":"8903189e-f5d2-4e14-a592-a4b1df525069","Type":"ContainerStarted","Data":"ab2d742fbebe27f06a0b5958639dd1d19c185e804f621ba5d4d174a84ce542ef"}
Sep 11 14:16:15.560316 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:15.560297    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r5927" event={"ID":"e9b3cebd-137c-46da-927d-157e75ea0e2c","Type":"ContainerStarted","Data":"687ae175b6efe9d138a04b4fc33473534b14df7af31b027e56c5b1ebef8f3adb"}
Sep 11 14:16:15.774460 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:15.774423    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:15.774624 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:15.774495    2569 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:15.774845 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:15.774831    2569 scope.go:117] "RemoveContainer" containerID="7c576e081be2b59d743460d5e94c5cd69060b3367ffdf91de0c23f70daff115a"
Sep 11 14:16:15.775031 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:15.775011    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-g2trc_openshift-console-operator(4c8baef3-30b3-4df3-bb34-fc6a997308b6)\"" pod="openshift-console-operator/console-operator-696884fb9c-g2trc" podUID="4c8baef3-30b3-4df3-bb34-fc6a997308b6"
Sep 11 14:16:17.568521 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:17.568430    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hnhbr" event={"ID":"8903189e-f5d2-4e14-a592-a4b1df525069","Type":"ContainerStarted","Data":"2d18c38ca133678c519d98cd2f0750202f9f47d8664f8dd55741e9c3465eafe3"}
Sep 11 14:16:17.568521 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:17.568516    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hnhbr" event={"ID":"8903189e-f5d2-4e14-a592-a4b1df525069","Type":"ContainerStarted","Data":"4217b3204d718873d373812cf1cd89b9a214918d9785988dcf473924776882e0"}
Sep 11 14:16:17.607363 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:17.607313    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r5927" podStartSLOduration=68.891440672 podStartE2EDuration="1m12.607297329s" totalImagesPullingTime="3.715856657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:15.597292154 +0000 UTC m=+71.811877816" watchObservedRunningTime="2026-09-11 14:16:17.607297329 +0000 UTC m=+73.821883047"
Sep 11 14:16:19.135464 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:19.135422    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:19.135464 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:19.135463    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:19.135898 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:19.135549    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 14:16:19.135898 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:19.135570    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:19.135898 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:19.135602    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm podName:363387d2-5943-4a23-b2e1-b6fc3e298981 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:27.135588989 +0000 UTC m=+83.350174632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm") pod "insights-runtime-extractor-dppg6" (UID: "363387d2-5943-4a23-b2e1-b6fc3e298981") : configmap "kube-rbac-proxy" not found
Sep 11 14:16:19.135898 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:19.135621    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls podName:363387d2-5943-4a23-b2e1-b6fc3e298981 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:27.135608577 +0000 UTC m=+83.350194216 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dppg6" (UID: "363387d2-5943-4a23-b2e1-b6fc3e298981") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:21.552296 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:21.552261    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:21.552685 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:21.552429    2569 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:21.552685 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:21.552498    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls podName:4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:37.552479927 +0000 UTC m=+93.767065569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-phwxt" (UID: "4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990") : secret "cluster-monitoring-operator-tls" not found
Sep 11 14:16:27.193736 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:27.193543    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:27.193736 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:27.193630    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:27.193736 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:27.193678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:27.193736 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:16:27.193691    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls podName:363387d2-5943-4a23-b2e1-b6fc3e298981 nodeName:}" failed. No retries permitted until 2026-09-11 14:16:43.193677999 +0000 UTC m=+99.408263641 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls") pod "insights-runtime-extractor-dppg6" (UID: "363387d2-5943-4a23-b2e1-b6fc3e298981") : secret "insights-runtime-extractor-tls" not found
Sep 11 14:16:27.194218 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:27.194205    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/363387d2-5943-4a23-b2e1-b6fc3e298981-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:30.265036 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:30.265006    2569 scope.go:117] "RemoveContainer" containerID="7c576e081be2b59d743460d5e94c5cd69060b3367ffdf91de0c23f70daff115a"
Sep 11 14:16:30.609566 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:30.609484    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:16:30.609566 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:30.609546    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-g2trc" event={"ID":"4c8baef3-30b3-4df3-bb34-fc6a997308b6","Type":"ContainerStarted","Data":"15d82f1e2004ca35df48964f4e7b2a5aa1628cdf0498f84cae5cf044e9a1b4ed"}
Sep 11 14:16:30.609829 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:30.609809    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:30.640143 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:30.640080    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-g2trc" podStartSLOduration=23.556892042 podStartE2EDuration="25.640064821s" totalImagesPullingTime="2.083172779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:30.639379218 +0000 UTC m=+86.853964880" watchObservedRunningTime="2026-09-11 14:16:30.640064821 +0000 UTC m=+86.854650480"
Sep 11 14:16:30.640328 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:30.640174    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hnhbr" podStartSLOduration=16.149827841 podStartE2EDuration="18.640168555s" totalImagesPullingTime="2.490340714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:17.607565761 +0000 UTC m=+73.822151421" watchObservedRunningTime="2026-09-11 14:16:30.640168555 +0000 UTC m=+86.854754224"
Sep 11 14:16:31.064851 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:31.064820    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-g2trc"
Sep 11 14:16:34.478164 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.478128    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"]
Sep 11 14:16:34.481233 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.481217    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.484725 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.484701    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 11 14:16:34.485397 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.485377    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 14:16:34.485565 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.485500    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 11 14:16:34.485565 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.485548    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 11 14:16:34.485730 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.485581    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 14:16:34.485730 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.485693    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 11 14:16:34.485832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.485743    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 14:16:34.513439 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.513418    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"]
Sep 11 14:16:34.546454 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.546428    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6twkz\" (UniqueName: \"kubernetes.io/projected/afb70b71-1773-44c3-b293-5af891adb9e2-kube-api-access-6twkz\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.546593 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.546486    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/afb70b71-1773-44c3-b293-5af891adb9e2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.546593 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.546565    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/afb70b71-1773-44c3-b293-5af891adb9e2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.546759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.546648    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/afb70b71-1773-44c3-b293-5af891adb9e2-hub\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.546932 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.546916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/afb70b71-1773-44c3-b293-5af891adb9e2-ca\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.546989 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.546973    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/afb70b71-1773-44c3-b293-5af891adb9e2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.647782 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.647747    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/afb70b71-1773-44c3-b293-5af891adb9e2-ca\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.647982 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.647791    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/afb70b71-1773-44c3-b293-5af891adb9e2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.647982 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.647830    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6twkz\" (UniqueName: \"kubernetes.io/projected/afb70b71-1773-44c3-b293-5af891adb9e2-kube-api-access-6twkz\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.647982 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.647938    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/afb70b71-1773-44c3-b293-5af891adb9e2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.648155 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.647987    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/afb70b71-1773-44c3-b293-5af891adb9e2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.648155 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.648016    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/afb70b71-1773-44c3-b293-5af891adb9e2-hub\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.648717 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.648692    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/afb70b71-1773-44c3-b293-5af891adb9e2-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.650635 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.650607    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/afb70b71-1773-44c3-b293-5af891adb9e2-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.650719 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.650702    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/afb70b71-1773-44c3-b293-5af891adb9e2-hub\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.650975 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.650957    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/afb70b71-1773-44c3-b293-5af891adb9e2-ca\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.651060 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.651044    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/afb70b71-1773-44c3-b293-5af891adb9e2-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.676050 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.676018    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6twkz\" (UniqueName: \"kubernetes.io/projected/afb70b71-1773-44c3-b293-5af891adb9e2-kube-api-access-6twkz\") pod \"cluster-proxy-proxy-agent-5fb7599bd4-tmwh6\" (UID: \"afb70b71-1773-44c3-b293-5af891adb9e2\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:34.798744 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:34.798655    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"
Sep 11 14:16:35.108372 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:35.108346    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6"]
Sep 11 14:16:35.109938 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:16:35.109914    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podafb70b71_1773_44c3_b293_5af891adb9e2.slice/crio-3b1500da8e306914b4be9bc6db657eae56b29ecead9b5c648cf5f7101d8a632c WatchSource:0}: Error finding container 3b1500da8e306914b4be9bc6db657eae56b29ecead9b5c648cf5f7101d8a632c: Status 404 returned error can't find the container with id 3b1500da8e306914b4be9bc6db657eae56b29ecead9b5c648cf5f7101d8a632c
Sep 11 14:16:35.627502 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:35.627464    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6" event={"ID":"afb70b71-1773-44c3-b293-5af891adb9e2","Type":"ContainerStarted","Data":"3b1500da8e306914b4be9bc6db657eae56b29ecead9b5c648cf5f7101d8a632c"}
Sep 11 14:16:37.581610 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:37.581563    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:37.584409 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:37.584378    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-phwxt\" (UID: \"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:37.879478 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:37.879392    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"
Sep 11 14:16:38.870232 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:38.870210    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt"]
Sep 11 14:16:38.871570 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:16:38.871548    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4af6c1c4_a7dc_4cd7_b5ff_fde48c0b9990.slice/crio-94233b27e8ae61c545fe6d8b3e83805b2c35b8c07703dce147ce502ea5d11c76 WatchSource:0}: Error finding container 94233b27e8ae61c545fe6d8b3e83805b2c35b8c07703dce147ce502ea5d11c76: Status 404 returned error can't find the container with id 94233b27e8ae61c545fe6d8b3e83805b2c35b8c07703dce147ce502ea5d11c76
Sep 11 14:16:39.645142 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:39.645103    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt" event={"ID":"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990","Type":"ContainerStarted","Data":"94233b27e8ae61c545fe6d8b3e83805b2c35b8c07703dce147ce502ea5d11c76"}
Sep 11 14:16:39.647455 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:39.647430    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6" event={"ID":"afb70b71-1773-44c3-b293-5af891adb9e2","Type":"ContainerStarted","Data":"46ae6e0accf3fb592fc663cc4539d51ae3c4ae60a0bc7e9f20c658d033a5f380"}
Sep 11 14:16:39.647578 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:39.647468    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6" event={"ID":"afb70b71-1773-44c3-b293-5af891adb9e2","Type":"ContainerStarted","Data":"d774d472ea362ae17c54532d586889afcdb61c01b165afe5d01d88fc9e1de820"}
Sep 11 14:16:39.647578 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:39.647486    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6" event={"ID":"afb70b71-1773-44c3-b293-5af891adb9e2","Type":"ContainerStarted","Data":"64c13c1e03157640a367cfa7f4f10d6f2e029fdaf6c2b35689a1ad05d01699b1"}
Sep 11 14:16:39.676357 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:39.676305    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5fb7599bd4-tmwh6" podStartSLOduration=2.122394955 podStartE2EDuration="5.676286467s" totalImagesPullingTime="3.553891512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:39.674919667 +0000 UTC m=+95.889505328" watchObservedRunningTime="2026-09-11 14:16:39.676286467 +0000 UTC m=+95.890872128"
Sep 11 14:16:40.653780 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:40.653735    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt" event={"ID":"4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990","Type":"ContainerStarted","Data":"96b1075b85cf609b6030e0bd1d0fae899d786dc81c86d398c2df634224f16b10"}
Sep 11 14:16:40.690889 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:40.690831    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-phwxt" podStartSLOduration=34.103883434 podStartE2EDuration="35.690815793s" totalImagesPullingTime="1.586932359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:40.690390065 +0000 UTC m=+96.904975727" watchObservedRunningTime="2026-09-11 14:16:40.690815793 +0000 UTC m=+96.905401453"
Sep 11 14:16:42.520606 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:42.520574    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:16:42.522937 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:42.522919    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4e161a3f-4c64-4241-b8a7-455c2d3ca46f-metrics-tls\") pod \"dns-default-4kbd4\" (UID: \"4e161a3f-4c64-4241-b8a7-455c2d3ca46f\") " pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:16:42.551845 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:42.551781    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mnwpp"
Sep 11 14:16:42.591887 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:42.591856    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xhc84\""
Sep 11 14:16:42.599225 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:42.599203    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:16:42.926997 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:42.926971    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4kbd4"]
Sep 11 14:16:42.930359 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:16:42.930333    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e161a3f_4c64_4241_b8a7_455c2d3ca46f.slice/crio-197c2e196d2652ba17dde64fdd6cd149be73e65ae2b2ae2d792ed38f1d7e864b WatchSource:0}: Error finding container 197c2e196d2652ba17dde64fdd6cd149be73e65ae2b2ae2d792ed38f1d7e864b: Status 404 returned error can't find the container with id 197c2e196d2652ba17dde64fdd6cd149be73e65ae2b2ae2d792ed38f1d7e864b
Sep 11 14:16:43.225672 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:43.225591    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:43.228027 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:43.227992    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/363387d2-5943-4a23-b2e1-b6fc3e298981-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-dppg6\" (UID: \"363387d2-5943-4a23-b2e1-b6fc3e298981\") " pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:43.512998 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:43.512916    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-dppg6"
Sep 11 14:16:43.666506 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:43.666459    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4kbd4" event={"ID":"4e161a3f-4c64-4241-b8a7-455c2d3ca46f","Type":"ContainerStarted","Data":"197c2e196d2652ba17dde64fdd6cd149be73e65ae2b2ae2d792ed38f1d7e864b"}
Sep 11 14:16:43.831797 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:43.831701    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-dppg6"]
Sep 11 14:16:43.836032 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:16:43.836004    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363387d2_5943_4a23_b2e1_b6fc3e298981.slice/crio-46fcbe54f4bd9b5543ca78f14ec445fdb68f600d232dc4bf2a02cbfa52b47462 WatchSource:0}: Error finding container 46fcbe54f4bd9b5543ca78f14ec445fdb68f600d232dc4bf2a02cbfa52b47462: Status 404 returned error can't find the container with id 46fcbe54f4bd9b5543ca78f14ec445fdb68f600d232dc4bf2a02cbfa52b47462
Sep 11 14:16:44.672520 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:44.672478    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dppg6" event={"ID":"363387d2-5943-4a23-b2e1-b6fc3e298981","Type":"ContainerStarted","Data":"e38897bc976e8e4e309c3f24582b68d224c05e1e1d5b038b101f1492020573ba"}
Sep 11 14:16:44.672908 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:44.672540    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dppg6" event={"ID":"363387d2-5943-4a23-b2e1-b6fc3e298981","Type":"ContainerStarted","Data":"46fcbe54f4bd9b5543ca78f14ec445fdb68f600d232dc4bf2a02cbfa52b47462"}
Sep 11 14:16:45.681214 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:45.681177    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4kbd4" event={"ID":"4e161a3f-4c64-4241-b8a7-455c2d3ca46f","Type":"ContainerStarted","Data":"8ab57e86b41bfd8565e6efc84797fa4579c1830bb78e90e8094b08f2f828aa47"}
Sep 11 14:16:45.681620 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:45.681260    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4kbd4" event={"ID":"4e161a3f-4c64-4241-b8a7-455c2d3ca46f","Type":"ContainerStarted","Data":"1a6a107a7d9162d21446c1fbdc833840098785a6f004600542debd0228992ff8"}
Sep 11 14:16:45.681620 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:45.681293    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:16:45.683016 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:45.682993    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dppg6" event={"ID":"363387d2-5943-4a23-b2e1-b6fc3e298981","Type":"ContainerStarted","Data":"021e8a37166cd180105fd09f616f640f0f9a7f2f125c12b1f6780fa2b210f305"}
Sep 11 14:16:47.692406 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:47.692364    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-dppg6" event={"ID":"363387d2-5943-4a23-b2e1-b6fc3e298981","Type":"ContainerStarted","Data":"b39121b5ecf002aa9553bb32d9315e90accf5fb5ac6fb5628bfd49510680a09f"}
Sep 11 14:16:47.747178 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:47.747122    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-4kbd4" podStartSLOduration=67.847734126 podStartE2EDuration="1m9.747105794s" totalImagesPullingTime="1.899371668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:45.719258717 +0000 UTC m=+101.933844378" watchObservedRunningTime="2026-09-11 14:16:47.747105794 +0000 UTC m=+103.961691455"
Sep 11 14:16:55.689422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:55.689389    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4kbd4"
Sep 11 14:16:55.743578 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:55.743520    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-dppg6" podStartSLOduration=42.066944953 podStartE2EDuration="44.743505882s" totalImagesPullingTime="2.676560929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:16:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:16:47.752259344 +0000 UTC m=+103.966845005" watchObservedRunningTime="2026-09-11 14:16:55.743505882 +0000 UTC m=+111.958091542"
Sep 11 14:16:57.719591 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.719561    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m2d49"]
Sep 11 14:16:57.721747 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.721725    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.728748 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.728731    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 14:16:57.733356 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.733333    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tsp77\""
Sep 11 14:16:57.733635 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.733615    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 14:16:57.733694 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.733632    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 14:16:57.733914 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.733901    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 14:16:57.831702 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.831655    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/570b9b41-d435-45eb-b63f-a26da87357c4-metrics-client-ca\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.831702 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.831704    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.831933 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.831728    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g4x4\" (UniqueName: \"kubernetes.io/projected/570b9b41-d435-45eb-b63f-a26da87357c4-kube-api-access-7g4x4\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.831933 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.831786    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-tls\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.831933 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.831805    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.831933 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.831836    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/570b9b41-d435-45eb-b63f-a26da87357c4-root\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.831933 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.831866    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-wtmp\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.831933 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.831909    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/570b9b41-d435-45eb-b63f-a26da87357c4-sys\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.831933 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.831928    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-textfile\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933191 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933156    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/570b9b41-d435-45eb-b63f-a26da87357c4-metrics-client-ca\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933191 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933194    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933410 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933212    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g4x4\" (UniqueName: \"kubernetes.io/projected/570b9b41-d435-45eb-b63f-a26da87357c4-kube-api-access-7g4x4\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933410 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933360    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-tls\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933410 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933395    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933576 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933539    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/570b9b41-d435-45eb-b63f-a26da87357c4-root\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933713 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933601    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/570b9b41-d435-45eb-b63f-a26da87357c4-root\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933713 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933622    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-wtmp\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933713 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933675    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/570b9b41-d435-45eb-b63f-a26da87357c4-sys\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933907 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933741    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/570b9b41-d435-45eb-b63f-a26da87357c4-sys\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933907 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933744    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-textfile\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933907 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933741    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-wtmp\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933907 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933826    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-accelerators-collector-config\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.933907 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.933839    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/570b9b41-d435-45eb-b63f-a26da87357c4-metrics-client-ca\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.934132 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.934047    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-textfile\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.935994 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.935969    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.936143 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.936125    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/570b9b41-d435-45eb-b63f-a26da87357c4-node-exporter-tls\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:57.950604 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:57.950583    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g4x4\" (UniqueName: \"kubernetes.io/projected/570b9b41-d435-45eb-b63f-a26da87357c4-kube-api-access-7g4x4\") pod \"node-exporter-m2d49\" (UID: \"570b9b41-d435-45eb-b63f-a26da87357c4\") " pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:58.030782 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:58.030707    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m2d49"
Sep 11 14:16:58.040314 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:16:58.040287    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod570b9b41_d435_45eb_b63f_a26da87357c4.slice/crio-2d6f469214f5c33346ec7dff3fe8875193727d1be90bcf17a085c01e01d0e9f3 WatchSource:0}: Error finding container 2d6f469214f5c33346ec7dff3fe8875193727d1be90bcf17a085c01e01d0e9f3: Status 404 returned error can't find the container with id 2d6f469214f5c33346ec7dff3fe8875193727d1be90bcf17a085c01e01d0e9f3
Sep 11 14:16:58.731321 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:58.731266    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m2d49" event={"ID":"570b9b41-d435-45eb-b63f-a26da87357c4","Type":"ContainerStarted","Data":"2d6f469214f5c33346ec7dff3fe8875193727d1be90bcf17a085c01e01d0e9f3"}
Sep 11 14:16:59.736494 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:59.736459    2569 generic.go:356] "Generic (PLEG): container finished" podID="570b9b41-d435-45eb-b63f-a26da87357c4" containerID="4b9a6923a4ec0bae41fe09ff9cba1754e724aab2c149ecc4c976f197734d5c70" exitCode=0
Sep 11 14:16:59.736937 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:16:59.736550    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m2d49" event={"ID":"570b9b41-d435-45eb-b63f-a26da87357c4","Type":"ContainerDied","Data":"4b9a6923a4ec0bae41fe09ff9cba1754e724aab2c149ecc4c976f197734d5c70"}
Sep 11 14:17:00.742802 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:00.742769    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m2d49" event={"ID":"570b9b41-d435-45eb-b63f-a26da87357c4","Type":"ContainerStarted","Data":"af825375411ad809834419571c637d8b1419f96311b48596eb4bec73b01e45a9"}
Sep 11 14:17:00.743200 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:00.742820    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m2d49" event={"ID":"570b9b41-d435-45eb-b63f-a26da87357c4","Type":"ContainerStarted","Data":"31dc7504f8ef94714cc2d9ec456f732275a6714948f4360cc2b9a2fe34dfbc07"}
Sep 11 14:17:00.816975 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:00.816924    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m2d49" podStartSLOduration=2.939877376 podStartE2EDuration="3.816910122s" totalImagesPullingTime="807.229937ms" totalInitContainerRuntime="69.802809ms" isStatefulPod=true podCreationTimestamp="2026-09-11 14:16:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:17:00.816522905 +0000 UTC m=+117.031108565" watchObservedRunningTime="2026-09-11 14:17:00.816910122 +0000 UTC m=+117.031495783"
Sep 11 14:17:02.542833 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.542798    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d7974ff87-r4ds8"]
Sep 11 14:17:02.544770 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.544754    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.560228 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.560207    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-akc1daonfoi01\""
Sep 11 14:17:02.560351 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.560203    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-l7tq2\""
Sep 11 14:17:02.560351 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.560288    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 11 14:17:02.560351 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.560293    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 11 14:17:02.560524 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.560367    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 14:17:02.569084 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.569064    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 11 14:17:02.573481 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.573464    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbebf99e-97d6-47d1-acb1-af02e92b015b-client-ca-bundle\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.573547 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.573493    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dbebf99e-97d6-47d1-acb1-af02e92b015b-audit-log\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.573547 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.573514    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dbebf99e-97d6-47d1-acb1-af02e92b015b-secret-metrics-server-client-certs\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.573547 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.573537    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dbebf99e-97d6-47d1-acb1-af02e92b015b-secret-metrics-server-tls\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.573696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.573628    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbebf99e-97d6-47d1-acb1-af02e92b015b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.573696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.573666    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dbebf99e-97d6-47d1-acb1-af02e92b015b-metrics-server-audit-profiles\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.573771 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.573735    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffvws\" (UniqueName: \"kubernetes.io/projected/dbebf99e-97d6-47d1-acb1-af02e92b015b-kube-api-access-ffvws\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.583801 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.583780    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-595c9d4dcd-wtwwl"]
Sep 11 14:17:02.589600 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.589573    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d7974ff87-r4ds8"]
Sep 11 14:17:02.589719 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.589664    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.602193 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.602171    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 14:17:02.602408 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.602395    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 14:17:02.602478 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.602436    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 14:17:02.602625 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.602610    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jlnkm\""
Sep 11 14:17:02.603535 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.603520    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 14:17:02.603582 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.603523    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 14:17:02.603631 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.603604    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 14:17:02.607231 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.607214    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 14:17:02.611586 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.611560    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 14:17:02.628004 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.627985    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595c9d4dcd-wtwwl"]
Sep 11 14:17:02.674754 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.674714    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-serving-cert\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.674754 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.674761    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dbebf99e-97d6-47d1-acb1-af02e92b015b-secret-metrics-server-tls\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.674953 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.674781    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-service-ca\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.674953 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.674797    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-oauth-serving-cert\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.674953 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.674842    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbebf99e-97d6-47d1-acb1-af02e92b015b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.674953 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.674903    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dbebf99e-97d6-47d1-acb1-af02e92b015b-metrics-server-audit-profiles\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.675152 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.674957    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42t4c\" (UniqueName: \"kubernetes.io/projected/8e529f09-e98a-4d09-8a0c-27f1eb117c86-kube-api-access-42t4c\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.675152 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.675058    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffvws\" (UniqueName: \"kubernetes.io/projected/dbebf99e-97d6-47d1-acb1-af02e92b015b-kube-api-access-ffvws\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.675152 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.675077    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-config\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.675152 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.675094    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbebf99e-97d6-47d1-acb1-af02e92b015b-client-ca-bundle\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.675152 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.675108    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-trusted-ca-bundle\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.675152 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.675131    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dbebf99e-97d6-47d1-acb1-af02e92b015b-audit-log\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.675433 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.675186    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dbebf99e-97d6-47d1-acb1-af02e92b015b-secret-metrics-server-client-certs\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.675433 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.675216    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-oauth-config\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.675531 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.675479    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/dbebf99e-97d6-47d1-acb1-af02e92b015b-audit-log\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.675739 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.675718    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dbebf99e-97d6-47d1-acb1-af02e92b015b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.675959 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.675941    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/dbebf99e-97d6-47d1-acb1-af02e92b015b-metrics-server-audit-profiles\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.677542 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.677512    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/dbebf99e-97d6-47d1-acb1-af02e92b015b-secret-metrics-server-tls\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.677624 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.677557    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dbebf99e-97d6-47d1-acb1-af02e92b015b-client-ca-bundle\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.677833 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.677815    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/dbebf99e-97d6-47d1-acb1-af02e92b015b-secret-metrics-server-client-certs\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.697439 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.697416    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffvws\" (UniqueName: \"kubernetes.io/projected/dbebf99e-97d6-47d1-acb1-af02e92b015b-kube-api-access-ffvws\") pod \"metrics-server-7d7974ff87-r4ds8\" (UID: \"dbebf99e-97d6-47d1-acb1-af02e92b015b\") " pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.775943 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.775902    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-serving-cert\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.776067 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.775956    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-service-ca\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.776067 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.775984    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-oauth-serving-cert\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.776067 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.776035    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42t4c\" (UniqueName: \"kubernetes.io/projected/8e529f09-e98a-4d09-8a0c-27f1eb117c86-kube-api-access-42t4c\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.776195 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.776070    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-config\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.776195 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.776090    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-trusted-ca-bundle\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.776195 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.776119    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-oauth-config\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.776754 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.776728    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-oauth-serving-cert\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.776934 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.776783    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-config\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.776934 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.776739    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-service-ca\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.777120 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.777103    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-trusted-ca-bundle\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.778562 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.778541    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-serving-cert\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.778949 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.778933    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-oauth-config\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.795434 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.795390    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42t4c\" (UniqueName: \"kubernetes.io/projected/8e529f09-e98a-4d09-8a0c-27f1eb117c86-kube-api-access-42t4c\") pod \"console-595c9d4dcd-wtwwl\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") " pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:02.853324 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.853302    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:02.898973 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:02.898946    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:03.153012 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:03.152929    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d7974ff87-r4ds8"]
Sep 11 14:17:03.155859 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:17:03.155821    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbebf99e_97d6_47d1_acb1_af02e92b015b.slice/crio-cb2663f0e2b04d5c3f33a8ef62907c9d211e3f5a11096534959bb01c9532443b WatchSource:0}: Error finding container cb2663f0e2b04d5c3f33a8ef62907c9d211e3f5a11096534959bb01c9532443b: Status 404 returned error can't find the container with id cb2663f0e2b04d5c3f33a8ef62907c9d211e3f5a11096534959bb01c9532443b
Sep 11 14:17:03.215611 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:03.215573    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595c9d4dcd-wtwwl"]
Sep 11 14:17:03.238817 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:17:03.238794    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e529f09_e98a_4d09_8a0c_27f1eb117c86.slice/crio-0aae9e2c4c7216434844c4ea86ba6acc992352ead00abbfd6cc0ce6306708e36 WatchSource:0}: Error finding container 0aae9e2c4c7216434844c4ea86ba6acc992352ead00abbfd6cc0ce6306708e36: Status 404 returned error can't find the container with id 0aae9e2c4c7216434844c4ea86ba6acc992352ead00abbfd6cc0ce6306708e36
Sep 11 14:17:03.759312 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:03.759264    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595c9d4dcd-wtwwl" event={"ID":"8e529f09-e98a-4d09-8a0c-27f1eb117c86","Type":"ContainerStarted","Data":"0aae9e2c4c7216434844c4ea86ba6acc992352ead00abbfd6cc0ce6306708e36"}
Sep 11 14:17:03.761406 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:03.761376    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8" event={"ID":"dbebf99e-97d6-47d1-acb1-af02e92b015b","Type":"ContainerStarted","Data":"cb2663f0e2b04d5c3f33a8ef62907c9d211e3f5a11096534959bb01c9532443b"}
Sep 11 14:17:04.767143 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:04.767043    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8" event={"ID":"dbebf99e-97d6-47d1-acb1-af02e92b015b","Type":"ContainerStarted","Data":"e60279b8e779dfc9cc42b16d22f807c9348f32a755b02a2ddcb341ddaabb5c76"}
Sep 11 14:17:04.820100 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:04.820050    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8" podStartSLOduration=1.46417055 podStartE2EDuration="2.820034369s" totalImagesPullingTime="1.355863819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:17:04.818445749 +0000 UTC m=+121.033031409" watchObservedRunningTime="2026-09-11 14:17:04.820034369 +0000 UTC m=+121.034620030"
Sep 11 14:17:06.776297 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:06.776258    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595c9d4dcd-wtwwl" event={"ID":"8e529f09-e98a-4d09-8a0c-27f1eb117c86","Type":"ContainerStarted","Data":"441dc162f49fbc8d11b511bf6106ecef2ad5177ab4c4f6e7906e0f80562f58db"}
Sep 11 14:17:06.803688 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:06.803637    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-595c9d4dcd-wtwwl" podStartSLOduration=1.9994597139999999 podStartE2EDuration="4.803616315s" totalImagesPullingTime="2.804156601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:17:06.802785702 +0000 UTC m=+123.017371363" watchObservedRunningTime="2026-09-11 14:17:06.803616315 +0000 UTC m=+123.018201977"
Sep 11 14:17:12.899324 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:12.899287    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:12.899930 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:12.899354    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:12.903833 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:12.903812    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:13.804223 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:13.804196    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:17:14.066910 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:14.066782    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:17:14.069271 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:14.069250    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a377b10-7140-40c6-9e69-c228066e6001-metrics-certs\") pod \"network-metrics-daemon-wxmq8\" (UID: \"9a377b10-7140-40c6-9e69-c228066e6001\") " pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:17:14.195658 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:14.195624    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-lrm6v\""
Sep 11 14:17:14.201683 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:14.201663    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wxmq8"
Sep 11 14:17:14.485228 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:14.485197    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wxmq8"]
Sep 11 14:17:14.488548 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:17:14.488518    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a377b10_7140_40c6_9e69_c228066e6001.slice/crio-10590750b1b3e395b3841cf4afc99a927caa944f9250da0f42ec689cb3c606ef WatchSource:0}: Error finding container 10590750b1b3e395b3841cf4afc99a927caa944f9250da0f42ec689cb3c606ef: Status 404 returned error can't find the container with id 10590750b1b3e395b3841cf4afc99a927caa944f9250da0f42ec689cb3c606ef
Sep 11 14:17:14.802950 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:14.802855    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wxmq8" event={"ID":"9a377b10-7140-40c6-9e69-c228066e6001","Type":"ContainerStarted","Data":"10590750b1b3e395b3841cf4afc99a927caa944f9250da0f42ec689cb3c606ef"}
Sep 11 14:17:15.807397 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:15.807366    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wxmq8" event={"ID":"9a377b10-7140-40c6-9e69-c228066e6001","Type":"ContainerStarted","Data":"90010d7c394e79ea04aa695fdfdcc5abe6ebc39e813d9ae9a4cc105d1f8335bf"}
Sep 11 14:17:16.812924 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:16.812888    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wxmq8" event={"ID":"9a377b10-7140-40c6-9e69-c228066e6001","Type":"ContainerStarted","Data":"61fa647de6162752c4debf8190e9aed6b2f9414f570423c8d0f0393ddbc43023"}
Sep 11 14:17:22.853854 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:22.853807    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:22.854261 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:22.853904    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:41.900917 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:41.900820    2569 generic.go:356] "Generic (PLEG): container finished" podID="da9524fe-8b00-46c9-9683-271d619dba05" containerID="409b91d3fbf7c7638246835f5489d5e21ffd732f142a968e9b49c7d92f8646e7" exitCode=0
Sep 11 14:17:41.900917 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:41.900904    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j" event={"ID":"da9524fe-8b00-46c9-9683-271d619dba05","Type":"ContainerDied","Data":"409b91d3fbf7c7638246835f5489d5e21ffd732f142a968e9b49c7d92f8646e7"}
Sep 11 14:17:41.901320 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:41.901211    2569 scope.go:117] "RemoveContainer" containerID="409b91d3fbf7c7638246835f5489d5e21ffd732f142a968e9b49c7d92f8646e7"
Sep 11 14:17:41.939934 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:41.939863    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wxmq8" podStartSLOduration=155.757141031 podStartE2EDuration="2m36.939843457s" totalImagesPullingTime="1.182702426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:17:16.840685956 +0000 UTC m=+133.055271617" watchObservedRunningTime="2026-09-11 14:17:41.939843457 +0000 UTC m=+158.154429120"
Sep 11 14:17:42.860346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:42.860319    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:42.864158 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:42.864138    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d7974ff87-r4ds8"
Sep 11 14:17:42.907462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:17:42.907430    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-pqz5j" event={"ID":"da9524fe-8b00-46c9-9683-271d619dba05","Type":"ContainerStarted","Data":"a478be3fa2bb01a33a12d8f09c119c61f9f75073ac07f0a3a0badad0e291f1fa"}
Sep 11 14:20:04.172077 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:20:04.172034    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:20:04.174476 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:20:04.174450    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:20:04.182658 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:20:04.182639    2569 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 14:22:21.413623 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:21.413582    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-595c9d4dcd-wtwwl"]
Sep 11 14:22:46.432132 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.432075    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-595c9d4dcd-wtwwl" podUID="8e529f09-e98a-4d09-8a0c-27f1eb117c86" containerName="console" containerID="cri-o://441dc162f49fbc8d11b511bf6106ecef2ad5177ab4c4f6e7906e0f80562f58db" gracePeriod=15
Sep 11 14:22:46.674641 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.674614    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:22:46.718709 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.718659    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-oauth-serving-cert\") pod \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") "
Sep 11 14:22:46.718709 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.718689    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-config\") pod \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") "
Sep 11 14:22:46.718709 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.718704    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-trusted-ca-bundle\") pod \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") "
Sep 11 14:22:46.718934 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.718743    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-service-ca\") pod \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") "
Sep 11 14:22:46.719000 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.718928    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-serving-cert\") pod \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") "
Sep 11 14:22:46.719000 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.718971    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42t4c\" (UniqueName: \"kubernetes.io/projected/8e529f09-e98a-4d09-8a0c-27f1eb117c86-kube-api-access-42t4c\") pod \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") "
Sep 11 14:22:46.719116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.719000    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-oauth-config\") pod \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\" (UID: \"8e529f09-e98a-4d09-8a0c-27f1eb117c86\") "
Sep 11 14:22:46.719116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.719089    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8e529f09-e98a-4d09-8a0c-27f1eb117c86" (UID: "8e529f09-e98a-4d09-8a0c-27f1eb117c86"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:22:46.719213 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.719185    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-config" (OuterVolumeSpecName: "console-config") pod "8e529f09-e98a-4d09-8a0c-27f1eb117c86" (UID: "8e529f09-e98a-4d09-8a0c-27f1eb117c86"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:22:46.719213 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.719196    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-service-ca" (OuterVolumeSpecName: "service-ca") pod "8e529f09-e98a-4d09-8a0c-27f1eb117c86" (UID: "8e529f09-e98a-4d09-8a0c-27f1eb117c86"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:22:46.719309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.719204    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8e529f09-e98a-4d09-8a0c-27f1eb117c86" (UID: "8e529f09-e98a-4d09-8a0c-27f1eb117c86"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:22:46.720342 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.719611    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-oauth-serving-cert\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:22:46.720342 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.719640    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-config\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:22:46.720342 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.719657    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-trusted-ca-bundle\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:22:46.720342 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.719680    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e529f09-e98a-4d09-8a0c-27f1eb117c86-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:22:46.723934 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.722253    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8e529f09-e98a-4d09-8a0c-27f1eb117c86" (UID: "8e529f09-e98a-4d09-8a0c-27f1eb117c86"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:22:46.723934 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.722504    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e529f09-e98a-4d09-8a0c-27f1eb117c86-kube-api-access-42t4c" (OuterVolumeSpecName: "kube-api-access-42t4c") pod "8e529f09-e98a-4d09-8a0c-27f1eb117c86" (UID: "8e529f09-e98a-4d09-8a0c-27f1eb117c86"). InnerVolumeSpecName "kube-api-access-42t4c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:22:46.725210 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.725168    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8e529f09-e98a-4d09-8a0c-27f1eb117c86" (UID: "8e529f09-e98a-4d09-8a0c-27f1eb117c86"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:22:46.820462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.820438    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-serving-cert\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:22:46.820462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.820459    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42t4c\" (UniqueName: \"kubernetes.io/projected/8e529f09-e98a-4d09-8a0c-27f1eb117c86-kube-api-access-42t4c\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:22:46.820585 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.820469    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e529f09-e98a-4d09-8a0c-27f1eb117c86-console-oauth-config\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:22:46.928508 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.928469    2569 generic.go:356] "Generic (PLEG): container finished" podID="8e529f09-e98a-4d09-8a0c-27f1eb117c86" containerID="441dc162f49fbc8d11b511bf6106ecef2ad5177ab4c4f6e7906e0f80562f58db" exitCode=0
Sep 11 14:22:46.928629 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.928525    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595c9d4dcd-wtwwl" event={"ID":"8e529f09-e98a-4d09-8a0c-27f1eb117c86","Type":"ContainerDied","Data":"441dc162f49fbc8d11b511bf6106ecef2ad5177ab4c4f6e7906e0f80562f58db"}
Sep 11 14:22:46.928629 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.928534    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595c9d4dcd-wtwwl"
Sep 11 14:22:46.928629 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.928609    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595c9d4dcd-wtwwl" event={"ID":"8e529f09-e98a-4d09-8a0c-27f1eb117c86","Type":"ContainerDied","Data":"0aae9e2c4c7216434844c4ea86ba6acc992352ead00abbfd6cc0ce6306708e36"}
Sep 11 14:22:46.928727 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.928636    2569 scope.go:117] "RemoveContainer" containerID="441dc162f49fbc8d11b511bf6106ecef2ad5177ab4c4f6e7906e0f80562f58db"
Sep 11 14:22:46.937310 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.937291    2569 scope.go:117] "RemoveContainer" containerID="441dc162f49fbc8d11b511bf6106ecef2ad5177ab4c4f6e7906e0f80562f58db"
Sep 11 14:22:46.937580 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:22:46.937562    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"441dc162f49fbc8d11b511bf6106ecef2ad5177ab4c4f6e7906e0f80562f58db\": container with ID starting with 441dc162f49fbc8d11b511bf6106ecef2ad5177ab4c4f6e7906e0f80562f58db not found: ID does not exist" containerID="441dc162f49fbc8d11b511bf6106ecef2ad5177ab4c4f6e7906e0f80562f58db"
Sep 11 14:22:46.937626 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.937586    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"441dc162f49fbc8d11b511bf6106ecef2ad5177ab4c4f6e7906e0f80562f58db"} err="failed to get container status \"441dc162f49fbc8d11b511bf6106ecef2ad5177ab4c4f6e7906e0f80562f58db\": rpc error: code = NotFound desc = could not find container \"441dc162f49fbc8d11b511bf6106ecef2ad5177ab4c4f6e7906e0f80562f58db\": container with ID starting with 441dc162f49fbc8d11b511bf6106ecef2ad5177ab4c4f6e7906e0f80562f58db not found: ID does not exist"
Sep 11 14:22:46.957947 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.957926    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-595c9d4dcd-wtwwl"]
Sep 11 14:22:46.965636 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:46.965617    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-595c9d4dcd-wtwwl"]
Sep 11 14:22:48.269450 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:22:48.269416    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e529f09-e98a-4d09-8a0c-27f1eb117c86" path="/var/lib/kubelet/pods/8e529f09-e98a-4d09-8a0c-27f1eb117c86/volumes"
Sep 11 14:25:04.194388 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:04.194353    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:25:04.195461 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:04.195439    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:25:18.938767 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:18.938735    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc"]
Sep 11 14:25:18.939185 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:18.938981    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e529f09-e98a-4d09-8a0c-27f1eb117c86" containerName="console"
Sep 11 14:25:18.939185 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:18.938992    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e529f09-e98a-4d09-8a0c-27f1eb117c86" containerName="console"
Sep 11 14:25:18.939185 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:18.939051    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e529f09-e98a-4d09-8a0c-27f1eb117c86" containerName="console"
Sep 11 14:25:18.941664 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:18.941646    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc"
Sep 11 14:25:18.947841 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:25:18.947814    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 11 14:25:18.948463 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:25:18.948441    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"cert-manager-cainjector-559cdd8c87-kb5fc\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" podUID="c19c43da-4842-4ae0-9c7e-bb2471140f59" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc"
Sep 11 14:25:18.948528 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:25:18.948510    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"cert-manager\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 11 14:25:18.982242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:18.982216    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc"]
Sep 11 14:25:18.994771 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:18.994751    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-scs89\""
Sep 11 14:25:18.995941 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:18.995921    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c19c43da-4842-4ae0-9c7e-bb2471140f59-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kb5fc\" (UID: \"c19c43da-4842-4ae0-9c7e-bb2471140f59\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc"
Sep 11 14:25:18.996026 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:18.995980    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfb2j\" (UniqueName: \"kubernetes.io/projected/c19c43da-4842-4ae0-9c7e-bb2471140f59-kube-api-access-jfb2j\") pod \"cert-manager-cainjector-559cdd8c87-kb5fc\" (UID: \"c19c43da-4842-4ae0-9c7e-bb2471140f59\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc"
Sep 11 14:25:19.097089 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:19.097064    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c19c43da-4842-4ae0-9c7e-bb2471140f59-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kb5fc\" (UID: \"c19c43da-4842-4ae0-9c7e-bb2471140f59\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc"
Sep 11 14:25:19.097177 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:19.097104    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfb2j\" (UniqueName: \"kubernetes.io/projected/c19c43da-4842-4ae0-9c7e-bb2471140f59-kube-api-access-jfb2j\") pod \"cert-manager-cainjector-559cdd8c87-kb5fc\" (UID: \"c19c43da-4842-4ae0-9c7e-bb2471140f59\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc"
Sep 11 14:25:19.131844 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:19.131825    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c19c43da-4842-4ae0-9c7e-bb2471140f59-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-kb5fc\" (UID: \"c19c43da-4842-4ae0-9c7e-bb2471140f59\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc"
Sep 11 14:25:20.130398 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:25:20.130357    2569 projected.go:291] Couldn't get configMap cert-manager/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 11 14:25:20.181888 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:20.181843    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 14:25:20.376742 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:20.376716    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 14:25:20.381172 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:25:20.381123    2569 projected.go:196] Error preparing data for projected volume kube-api-access-jfb2j for pod cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc: failed to sync configmap cache: timed out waiting for the condition
Sep 11 14:25:20.381268 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:25:20.381190    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c19c43da-4842-4ae0-9c7e-bb2471140f59-kube-api-access-jfb2j podName:c19c43da-4842-4ae0-9c7e-bb2471140f59 nodeName:}" failed. No retries permitted until 2026-09-11 14:25:20.881169354 +0000 UTC m=+617.095755009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jfb2j" (UniqueName: "kubernetes.io/projected/c19c43da-4842-4ae0-9c7e-bb2471140f59-kube-api-access-jfb2j") pod "cert-manager-cainjector-559cdd8c87-kb5fc" (UID: "c19c43da-4842-4ae0-9c7e-bb2471140f59") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 14:25:20.909136 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:20.909103    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfb2j\" (UniqueName: \"kubernetes.io/projected/c19c43da-4842-4ae0-9c7e-bb2471140f59-kube-api-access-jfb2j\") pod \"cert-manager-cainjector-559cdd8c87-kb5fc\" (UID: \"c19c43da-4842-4ae0-9c7e-bb2471140f59\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc"
Sep 11 14:25:20.911591 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:20.911561    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfb2j\" (UniqueName: \"kubernetes.io/projected/c19c43da-4842-4ae0-9c7e-bb2471140f59-kube-api-access-jfb2j\") pod \"cert-manager-cainjector-559cdd8c87-kb5fc\" (UID: \"c19c43da-4842-4ae0-9c7e-bb2471140f59\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc"
Sep 11 14:25:21.050069 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:21.050037    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc"
Sep 11 14:25:21.422911 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:21.422857    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc"]
Sep 11 14:25:21.426140 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:25:21.426115    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc19c43da_4842_4ae0_9c7e_bb2471140f59.slice/crio-3381d5e79df002256e90ce0369a9458b9ab463bf5b77cf40f13f45adb55b2c9c WatchSource:0}: Error finding container 3381d5e79df002256e90ce0369a9458b9ab463bf5b77cf40f13f45adb55b2c9c: Status 404 returned error can't find the container with id 3381d5e79df002256e90ce0369a9458b9ab463bf5b77cf40f13f45adb55b2c9c
Sep 11 14:25:21.428388 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:21.428371    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:25:21.445092 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:21.445065    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc" event={"ID":"c19c43da-4842-4ae0-9c7e-bb2471140f59","Type":"ContainerStarted","Data":"3381d5e79df002256e90ce0369a9458b9ab463bf5b77cf40f13f45adb55b2c9c"}
Sep 11 14:25:25.461603 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:25.461558    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc" event={"ID":"c19c43da-4842-4ae0-9c7e-bb2471140f59","Type":"ContainerStarted","Data":"2099152a380e94a895c06f48659ae7c6d209509a173283acc044bc22b3ada5b9"}
Sep 11 14:25:29.678605 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:29.678546    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-kb5fc" podStartSLOduration=8.637140046 podStartE2EDuration="11.678528849s" totalImagesPullingTime="3.041388803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:25:25.498689329 +0000 UTC m=+621.713274990" watchObservedRunningTime="2026-09-11 14:25:29.678528849 +0000 UTC m=+625.893114536"
Sep 11 14:25:29.679026 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:29.678854    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-crh49"]
Sep 11 14:25:29.681822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:29.681806    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-crh49"
Sep 11 14:25:29.684651 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:29.684630    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-629jp\""
Sep 11 14:25:29.709938 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:29.709912    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-crh49"]
Sep 11 14:25:29.770642 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:29.770613    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3a248d4-1fba-4a4a-a45b-ceafc05ea34a-bound-sa-token\") pod \"cert-manager-55b4d954d5-crh49\" (UID: \"e3a248d4-1fba-4a4a-a45b-ceafc05ea34a\") " pod="cert-manager/cert-manager-55b4d954d5-crh49"
Sep 11 14:25:29.770747 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:29.770652    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk6cg\" (UniqueName: \"kubernetes.io/projected/e3a248d4-1fba-4a4a-a45b-ceafc05ea34a-kube-api-access-xk6cg\") pod \"cert-manager-55b4d954d5-crh49\" (UID: \"e3a248d4-1fba-4a4a-a45b-ceafc05ea34a\") " pod="cert-manager/cert-manager-55b4d954d5-crh49"
Sep 11 14:25:29.871436 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:29.871414    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3a248d4-1fba-4a4a-a45b-ceafc05ea34a-bound-sa-token\") pod \"cert-manager-55b4d954d5-crh49\" (UID: \"e3a248d4-1fba-4a4a-a45b-ceafc05ea34a\") " pod="cert-manager/cert-manager-55b4d954d5-crh49"
Sep 11 14:25:29.871522 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:29.871446    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk6cg\" (UniqueName: \"kubernetes.io/projected/e3a248d4-1fba-4a4a-a45b-ceafc05ea34a-kube-api-access-xk6cg\") pod \"cert-manager-55b4d954d5-crh49\" (UID: \"e3a248d4-1fba-4a4a-a45b-ceafc05ea34a\") " pod="cert-manager/cert-manager-55b4d954d5-crh49"
Sep 11 14:25:29.884652 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:29.884634    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3a248d4-1fba-4a4a-a45b-ceafc05ea34a-bound-sa-token\") pod \"cert-manager-55b4d954d5-crh49\" (UID: \"e3a248d4-1fba-4a4a-a45b-ceafc05ea34a\") " pod="cert-manager/cert-manager-55b4d954d5-crh49"
Sep 11 14:25:29.884831 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:29.884811    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk6cg\" (UniqueName: \"kubernetes.io/projected/e3a248d4-1fba-4a4a-a45b-ceafc05ea34a-kube-api-access-xk6cg\") pod \"cert-manager-55b4d954d5-crh49\" (UID: \"e3a248d4-1fba-4a4a-a45b-ceafc05ea34a\") " pod="cert-manager/cert-manager-55b4d954d5-crh49"
Sep 11 14:25:29.990768 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:29.990711    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-crh49"
Sep 11 14:25:30.283365 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:30.283341    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-crh49"]
Sep 11 14:25:30.285606 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:25:30.285579    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3a248d4_1fba_4a4a_a45b_ceafc05ea34a.slice/crio-cc3766da231021dba22de2ed4366f0cd4b0765ebf9bd6807ab616f728c3d0415 WatchSource:0}: Error finding container cc3766da231021dba22de2ed4366f0cd4b0765ebf9bd6807ab616f728c3d0415: Status 404 returned error can't find the container with id cc3766da231021dba22de2ed4366f0cd4b0765ebf9bd6807ab616f728c3d0415
Sep 11 14:25:30.480124 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:30.480087    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-crh49" event={"ID":"e3a248d4-1fba-4a4a-a45b-ceafc05ea34a","Type":"ContainerStarted","Data":"28b6d6b5e32e38d9b46eda2f40db615aad05157bb363b474f27acb7ef0e55bc9"}
Sep 11 14:25:30.480124 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:25:30.480127    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-crh49" event={"ID":"e3a248d4-1fba-4a4a-a45b-ceafc05ea34a","Type":"ContainerStarted","Data":"cc3766da231021dba22de2ed4366f0cd4b0765ebf9bd6807ab616f728c3d0415"}
Sep 11 14:26:00.460847 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.460795    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-crh49" podStartSLOduration=31.460779193 podStartE2EDuration="31.460779193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:25:30.507982626 +0000 UTC m=+626.722568287" watchObservedRunningTime="2026-09-11 14:26:00.460779193 +0000 UTC m=+656.675364853"
Sep 11 14:26:00.463194 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.461030    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"]
Sep 11 14:26:00.464047 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.464032    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:00.468431 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.468412    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 14:26:00.468681 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.468668    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 14:26:00.469919 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.469744    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 14:26:00.469919 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.469894    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mf6fd\""
Sep 11 14:26:00.470141 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.470121    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 14:26:00.471476 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.471460    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 14:26:00.483768 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.483746    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"]
Sep 11 14:26:00.570631 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.570600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16cf3c62-8b69-42ea-8847-9903d912b908-cert\") pod \"lws-controller-manager-55cb89464b-nqlbz\" (UID: \"16cf3c62-8b69-42ea-8847-9903d912b908\") " pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:00.570631 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.570632    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16cf3c62-8b69-42ea-8847-9903d912b908-manager-config\") pod \"lws-controller-manager-55cb89464b-nqlbz\" (UID: \"16cf3c62-8b69-42ea-8847-9903d912b908\") " pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:00.570848 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.570657    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16cf3c62-8b69-42ea-8847-9903d912b908-metrics-cert\") pod \"lws-controller-manager-55cb89464b-nqlbz\" (UID: \"16cf3c62-8b69-42ea-8847-9903d912b908\") " pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:00.570848 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.570680    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8brh\" (UniqueName: \"kubernetes.io/projected/16cf3c62-8b69-42ea-8847-9903d912b908-kube-api-access-v8brh\") pod \"lws-controller-manager-55cb89464b-nqlbz\" (UID: \"16cf3c62-8b69-42ea-8847-9903d912b908\") " pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:00.672030 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.671992    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16cf3c62-8b69-42ea-8847-9903d912b908-metrics-cert\") pod \"lws-controller-manager-55cb89464b-nqlbz\" (UID: \"16cf3c62-8b69-42ea-8847-9903d912b908\") " pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:00.672213 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.672049    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8brh\" (UniqueName: \"kubernetes.io/projected/16cf3c62-8b69-42ea-8847-9903d912b908-kube-api-access-v8brh\") pod \"lws-controller-manager-55cb89464b-nqlbz\" (UID: \"16cf3c62-8b69-42ea-8847-9903d912b908\") " pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:00.672213 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.672139    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16cf3c62-8b69-42ea-8847-9903d912b908-cert\") pod \"lws-controller-manager-55cb89464b-nqlbz\" (UID: \"16cf3c62-8b69-42ea-8847-9903d912b908\") " pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:00.672213 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.672167    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16cf3c62-8b69-42ea-8847-9903d912b908-manager-config\") pod \"lws-controller-manager-55cb89464b-nqlbz\" (UID: \"16cf3c62-8b69-42ea-8847-9903d912b908\") " pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:00.672723 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.672700    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/16cf3c62-8b69-42ea-8847-9903d912b908-manager-config\") pod \"lws-controller-manager-55cb89464b-nqlbz\" (UID: \"16cf3c62-8b69-42ea-8847-9903d912b908\") " pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:00.674531 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.674509    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/16cf3c62-8b69-42ea-8847-9903d912b908-cert\") pod \"lws-controller-manager-55cb89464b-nqlbz\" (UID: \"16cf3c62-8b69-42ea-8847-9903d912b908\") " pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:00.674637 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.674605    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/16cf3c62-8b69-42ea-8847-9903d912b908-metrics-cert\") pod \"lws-controller-manager-55cb89464b-nqlbz\" (UID: \"16cf3c62-8b69-42ea-8847-9903d912b908\") " pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:00.696738 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.696717    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8brh\" (UniqueName: \"kubernetes.io/projected/16cf3c62-8b69-42ea-8847-9903d912b908-kube-api-access-v8brh\") pod \"lws-controller-manager-55cb89464b-nqlbz\" (UID: \"16cf3c62-8b69-42ea-8847-9903d912b908\") " pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:00.773320 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:00.773254    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:01.061705 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:01.061638    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"]
Sep 11 14:26:01.064502 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:26:01.064479    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16cf3c62_8b69_42ea_8847_9903d912b908.slice/crio-ee6ebade5de30dfca7c3d17b16353cbe03357cadf22468882044ea42e3d5938f WatchSource:0}: Error finding container ee6ebade5de30dfca7c3d17b16353cbe03357cadf22468882044ea42e3d5938f: Status 404 returned error can't find the container with id ee6ebade5de30dfca7c3d17b16353cbe03357cadf22468882044ea42e3d5938f
Sep 11 14:26:01.586311 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:01.586277    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz" event={"ID":"16cf3c62-8b69-42ea-8847-9903d912b908","Type":"ContainerStarted","Data":"ee6ebade5de30dfca7c3d17b16353cbe03357cadf22468882044ea42e3d5938f"}
Sep 11 14:26:03.595062 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:03.595029    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz" event={"ID":"16cf3c62-8b69-42ea-8847-9903d912b908","Type":"ContainerStarted","Data":"3bbb74baa190f1197b0ac8a28244a3809c7e7ee2dff4551a9eae27c6c7110b48"}
Sep 11 14:26:03.595429 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:03.595133    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:03.621442 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:03.621396    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz" podStartSLOduration=1.162329346 podStartE2EDuration="3.621376373s" totalImagesPullingTime="2.459047027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:26:03.620992311 +0000 UTC m=+659.835577973" watchObservedRunningTime="2026-09-11 14:26:03.621376373 +0000 UTC m=+659.835962098"
Sep 11 14:26:12.929236 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:12.929200    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"]
Sep 11 14:26:12.932477 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:12.932462    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:12.949122 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:12.949100    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vsjmn\""
Sep 11 14:26:12.950094 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:12.950080    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 14:26:12.950617 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:12.950604    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 14:26:12.963228 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:12.963181    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 14:26:12.963335 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:12.963321    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 14:26:13.012443 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.012422    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"]
Sep 11 14:26:13.059388 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.059366    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-tmp\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.059475 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.059395    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.059475 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.059418    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2v88\" (UniqueName: \"kubernetes.io/projected/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-kube-api-access-b2v88\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.059475 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.059448    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-manifests\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.059475 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.059467    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.160653 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.160624    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-tmp\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.160754 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.160656    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.160754 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.160678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2v88\" (UniqueName: \"kubernetes.io/projected/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-kube-api-access-b2v88\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.160754 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.160710    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-manifests\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.160754 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.160732    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.161175 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.161147    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-manifests\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.163163 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.163135    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-tmp\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.163280 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.163263    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.163408 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.163392    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.177491 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.177467    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2v88\" (UniqueName: \"kubernetes.io/projected/f2965a64-11cf-48ce-8a2c-1bb8258dcfda-kube-api-access-b2v88\") pod \"opendatahub-operator-controller-manager-86d7f488b8-dcs9x\" (UID: \"f2965a64-11cf-48ce-8a2c-1bb8258dcfda\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.242355 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.242308    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:13.529260 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.529143    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"]
Sep 11 14:26:13.532203 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:26:13.532175    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2965a64_11cf_48ce_8a2c_1bb8258dcfda.slice/crio-73800a61ba08a0e2a73da8fe403ebd67cc436f3e4ecd2d94b97579d836649974 WatchSource:0}: Error finding container 73800a61ba08a0e2a73da8fe403ebd67cc436f3e4ecd2d94b97579d836649974: Status 404 returned error can't find the container with id 73800a61ba08a0e2a73da8fe403ebd67cc436f3e4ecd2d94b97579d836649974
Sep 11 14:26:13.632198 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:13.632166    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x" event={"ID":"f2965a64-11cf-48ce-8a2c-1bb8258dcfda","Type":"ContainerStarted","Data":"73800a61ba08a0e2a73da8fe403ebd67cc436f3e4ecd2d94b97579d836649974"}
Sep 11 14:26:14.602076 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:14.602044    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-55cb89464b-nqlbz"
Sep 11 14:26:16.646506 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:16.646474    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x" event={"ID":"f2965a64-11cf-48ce-8a2c-1bb8258dcfda","Type":"ContainerStarted","Data":"66cee7154b6cc958e39bdc6698958dad68d895c710179ceae67452b82983068b"}
Sep 11 14:26:17.651851 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:17.651821    2569 generic.go:356] "Generic (PLEG): container finished" podID="f2965a64-11cf-48ce-8a2c-1bb8258dcfda" containerID="66cee7154b6cc958e39bdc6698958dad68d895c710179ceae67452b82983068b" exitCode=0
Sep 11 14:26:17.652247 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:17.651890    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x" event={"ID":"f2965a64-11cf-48ce-8a2c-1bb8258dcfda","Type":"ContainerDied","Data":"66cee7154b6cc958e39bdc6698958dad68d895c710179ceae67452b82983068b"}
Sep 11 14:26:18.658760 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:18.658725    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x" event={"ID":"f2965a64-11cf-48ce-8a2c-1bb8258dcfda","Type":"ContainerStarted","Data":"f2eb9c76c7cbec9481ced592276444f6b3026cda21150f9096814cc23452076e"}
Sep 11 14:26:18.659201 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:18.658904    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:18.695302 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:18.695249    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x" podStartSLOduration=2.433396799 podStartE2EDuration="6.695231129s" totalImagesPullingTime="3.266662905s" totalInitContainerRuntime="995.171425ms" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:26:18.693713311 +0000 UTC m=+674.908298973" watchObservedRunningTime="2026-09-11 14:26:18.695231129 +0000 UTC m=+674.909816789"
Sep 11 14:26:29.664825 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:29.664795    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86d7f488b8-dcs9x"
Sep 11 14:26:44.506075 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.506040    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-96hn4"]
Sep 11 14:26:44.513765 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.513742    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-96hn4"
Sep 11 14:26:44.521154 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.521134    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 11 14:26:44.521263 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.521229    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fj8kt\""
Sep 11 14:26:44.565530 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.565503    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-96hn4"]
Sep 11 14:26:44.581463 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.581441    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6076f68-36d5-4740-8080-1f960cd009f1-cert\") pod \"odh-model-controller-7998c67dc4-96hn4\" (UID: \"a6076f68-36d5-4740-8080-1f960cd009f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-96hn4"
Sep 11 14:26:44.581567 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.581473    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlsr7\" (UniqueName: \"kubernetes.io/projected/a6076f68-36d5-4740-8080-1f960cd009f1-kube-api-access-wlsr7\") pod \"odh-model-controller-7998c67dc4-96hn4\" (UID: \"a6076f68-36d5-4740-8080-1f960cd009f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-96hn4"
Sep 11 14:26:44.682081 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.682054    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6076f68-36d5-4740-8080-1f960cd009f1-cert\") pod \"odh-model-controller-7998c67dc4-96hn4\" (UID: \"a6076f68-36d5-4740-8080-1f960cd009f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-96hn4"
Sep 11 14:26:44.682248 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.682094    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlsr7\" (UniqueName: \"kubernetes.io/projected/a6076f68-36d5-4740-8080-1f960cd009f1-kube-api-access-wlsr7\") pod \"odh-model-controller-7998c67dc4-96hn4\" (UID: \"a6076f68-36d5-4740-8080-1f960cd009f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-96hn4"
Sep 11 14:26:44.682248 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:26:44.682208    2569 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 11 14:26:44.682318 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:26:44.682278    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6076f68-36d5-4740-8080-1f960cd009f1-cert podName:a6076f68-36d5-4740-8080-1f960cd009f1 nodeName:}" failed. No retries permitted until 2026-09-11 14:26:45.182262633 +0000 UTC m=+701.396848276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/a6076f68-36d5-4740-8080-1f960cd009f1-cert") pod "odh-model-controller-7998c67dc4-96hn4" (UID: "a6076f68-36d5-4740-8080-1f960cd009f1") : secret "odh-model-controller-webhook-cert" not found
Sep 11 14:26:44.717541 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.717513    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlsr7\" (UniqueName: \"kubernetes.io/projected/a6076f68-36d5-4740-8080-1f960cd009f1-kube-api-access-wlsr7\") pod \"odh-model-controller-7998c67dc4-96hn4\" (UID: \"a6076f68-36d5-4740-8080-1f960cd009f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-96hn4"
Sep 11 14:26:44.732237 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.732205    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"]
Sep 11 14:26:44.734478 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.734457    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.747145 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:26:44.747110    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-gw-ca-root-cert\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" type="*v1.ConfigMap"
Sep 11 14:26:44.747312 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:26:44.747117    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 11 14:26:44.747312 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:26:44.747115    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 11 14:26:44.747312 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:26:44.747117    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"data-science-gateway-data-science-gateway-class-dockercfg-c28ql\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-c28ql\"" type="*v1.Secret"
Sep 11 14:26:44.783186 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.783093    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.783186 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.783135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsdg6\" (UniqueName: \"kubernetes.io/projected/6163db2b-ebad-4477-bf64-5fd2e363f0ab-kube-api-access-gsdg6\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.783186 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.783153    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.783383 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.783263    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.783383 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.783313    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.783383 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.783358    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.783472 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.783393    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.783472 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.783421    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.783472 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.783444    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.810400 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.810369    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"]
Sep 11 14:26:44.883748 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.883718    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.883969 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.883758    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.883969 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.883794    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.883969 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.883828    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.883969 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.883862    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.883969 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.883923    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.883969 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.883965    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.884278 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.883995    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsdg6\" (UniqueName: \"kubernetes.io/projected/6163db2b-ebad-4477-bf64-5fd2e363f0ab-kube-api-access-gsdg6\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.884278 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.884022    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.884278 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.884176    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.884278 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.884226    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.884480 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.884346    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.884480 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.884373    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.886549 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.886527    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.886828 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.886805    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:44.934774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:44.934747    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:45.187446 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:45.187415    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6076f68-36d5-4740-8080-1f960cd009f1-cert\") pod \"odh-model-controller-7998c67dc4-96hn4\" (UID: \"a6076f68-36d5-4740-8080-1f960cd009f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-96hn4"
Sep 11 14:26:45.189862 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:45.189834    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6076f68-36d5-4740-8080-1f960cd009f1-cert\") pod \"odh-model-controller-7998c67dc4-96hn4\" (UID: \"a6076f68-36d5-4740-8080-1f960cd009f1\") " pod="opendatahub/odh-model-controller-7998c67dc4-96hn4"
Sep 11 14:26:45.423138 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:45.423105    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-96hn4"
Sep 11 14:26:45.689110 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:45.689085    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-c28ql\""
Sep 11 14:26:45.715385 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:45.715357    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 14:26:45.724673 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:45.724625    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6163db2b-ebad-4477-bf64-5fd2e363f0ab-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:45.762546 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:26:45.762520    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6076f68_36d5_4740_8080_1f960cd009f1.slice/crio-ab73bd59024a8434e481d69ee6694062e6763bc013cd5c3eb9569be26967615a WatchSource:0}: Error finding container ab73bd59024a8434e481d69ee6694062e6763bc013cd5c3eb9569be26967615a: Status 404 returned error can't find the container with id ab73bd59024a8434e481d69ee6694062e6763bc013cd5c3eb9569be26967615a
Sep 11 14:26:45.767109 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:45.767077    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-96hn4"]
Sep 11 14:26:45.924503 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:26:45.924474    2569 projected.go:291] Couldn't get configMap openshift-ingress/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Sep 11 14:26:46.050697 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:46.050611    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 14:26:46.055297 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:26:46.055273    2569 projected.go:196] Error preparing data for projected volume kube-api-access-gsdg6 for pod openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk: failed to sync configmap cache: timed out waiting for the condition
Sep 11 14:26:46.055402 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:26:46.055375    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6163db2b-ebad-4477-bf64-5fd2e363f0ab-kube-api-access-gsdg6 podName:6163db2b-ebad-4477-bf64-5fd2e363f0ab nodeName:}" failed. No retries permitted until 2026-09-11 14:26:46.555353298 +0000 UTC m=+702.769938951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-gsdg6" (UniqueName: "kubernetes.io/projected/6163db2b-ebad-4477-bf64-5fd2e363f0ab-kube-api-access-gsdg6") pod "data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk" (UID: "6163db2b-ebad-4477-bf64-5fd2e363f0ab") : failed to sync configmap cache: timed out waiting for the condition
Sep 11 14:26:46.187958 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:46.187928    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 14:26:46.600186 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:46.600146    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsdg6\" (UniqueName: \"kubernetes.io/projected/6163db2b-ebad-4477-bf64-5fd2e363f0ab-kube-api-access-gsdg6\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:46.603559 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:46.603521    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsdg6\" (UniqueName: \"kubernetes.io/projected/6163db2b-ebad-4477-bf64-5fd2e363f0ab-kube-api-access-gsdg6\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk\" (UID: \"6163db2b-ebad-4477-bf64-5fd2e363f0ab\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:46.766035 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:46.765965    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-96hn4" event={"ID":"a6076f68-36d5-4740-8080-1f960cd009f1","Type":"ContainerStarted","Data":"ab73bd59024a8434e481d69ee6694062e6763bc013cd5c3eb9569be26967615a"}
Sep 11 14:26:46.845435 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:46.845403    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:47.181401 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:47.181155    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"]
Sep 11 14:26:47.184561 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:26:47.184528    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6163db2b_ebad_4477_bf64_5fd2e363f0ab.slice/crio-c066be77cfbd4a3c42c8a2f6cccc4ab7486d84003ca72bb756c289e0dda2a208 WatchSource:0}: Error finding container c066be77cfbd4a3c42c8a2f6cccc4ab7486d84003ca72bb756c289e0dda2a208: Status 404 returned error can't find the container with id c066be77cfbd4a3c42c8a2f6cccc4ab7486d84003ca72bb756c289e0dda2a208
Sep 11 14:26:47.772646 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:47.772610    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk" event={"ID":"6163db2b-ebad-4477-bf64-5fd2e363f0ab","Type":"ContainerStarted","Data":"c066be77cfbd4a3c42c8a2f6cccc4ab7486d84003ca72bb756c289e0dda2a208"}
Sep 11 14:26:48.786012 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:48.783115    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-96hn4" event={"ID":"a6076f68-36d5-4740-8080-1f960cd009f1","Type":"ContainerStarted","Data":"aa80b7e274ec63cf306d5f5e313894a7e333f59faecce439212a92b2a9596f59"}
Sep 11 14:26:48.786012 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:48.783411    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-96hn4"
Sep 11 14:26:48.810365 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:48.810303    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-96hn4" podStartSLOduration=1.97288144 podStartE2EDuration="4.810284039s" totalImagesPullingTime="2.837402599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:26:48.808445711 +0000 UTC m=+705.023031374" watchObservedRunningTime="2026-09-11 14:26:48.810284039 +0000 UTC m=+705.024869702"
Sep 11 14:26:50.778327 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:50.778289    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:26:50.778621 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:50.778364    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:26:50.778621 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:50.778392    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:26:51.798122 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:51.798081    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk" event={"ID":"6163db2b-ebad-4477-bf64-5fd2e363f0ab","Type":"ContainerStarted","Data":"76cfbf0588f35a667458fd6d914738e7456afc59342e4b55c494bfcba88f55bc"}
Sep 11 14:26:51.846829 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:51.846799    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:51.851122 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:51.851103    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:51.960194 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:51.960152    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk" podStartSLOduration=4.3694235169999995 podStartE2EDuration="7.960133129s" totalImagesPullingTime="3.590709612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:26:51.86896208 +0000 UTC m=+708.083547741" watchObservedRunningTime="2026-09-11 14:26:51.960133129 +0000 UTC m=+708.174718781"
Sep 11 14:26:52.801762 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:52.801726    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:52.802736 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:52.802711    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk"
Sep 11 14:26:58.311109 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:58.311035    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct"]
Sep 11 14:26:58.314193 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:58.314176    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct"
Sep 11 14:26:58.319231 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:58.319209    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jh8gl\""
Sep 11 14:26:58.320302 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:58.320260    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 14:26:58.335757 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:58.335729    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct"]
Sep 11 14:26:58.392475 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:58.392441    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xwbx\" (UniqueName: \"kubernetes.io/projected/8b6e945d-f7a1-4d1b-854d-638c1c869247-kube-api-access-8xwbx\") pod \"llmisvc-controller-manager-777c6bd7d5-74rct\" (UID: \"8b6e945d-f7a1-4d1b-854d-638c1c869247\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct"
Sep 11 14:26:58.392630 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:58.392496    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b6e945d-f7a1-4d1b-854d-638c1c869247-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-74rct\" (UID: \"8b6e945d-f7a1-4d1b-854d-638c1c869247\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct"
Sep 11 14:26:58.493696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:58.493651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b6e945d-f7a1-4d1b-854d-638c1c869247-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-74rct\" (UID: \"8b6e945d-f7a1-4d1b-854d-638c1c869247\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct"
Sep 11 14:26:58.493859 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:58.493730    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xwbx\" (UniqueName: \"kubernetes.io/projected/8b6e945d-f7a1-4d1b-854d-638c1c869247-kube-api-access-8xwbx\") pod \"llmisvc-controller-manager-777c6bd7d5-74rct\" (UID: \"8b6e945d-f7a1-4d1b-854d-638c1c869247\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct"
Sep 11 14:26:58.496360 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:58.496335    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b6e945d-f7a1-4d1b-854d-638c1c869247-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-74rct\" (UID: \"8b6e945d-f7a1-4d1b-854d-638c1c869247\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct"
Sep 11 14:26:58.517822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:58.517799    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xwbx\" (UniqueName: \"kubernetes.io/projected/8b6e945d-f7a1-4d1b-854d-638c1c869247-kube-api-access-8xwbx\") pod \"llmisvc-controller-manager-777c6bd7d5-74rct\" (UID: \"8b6e945d-f7a1-4d1b-854d-638c1c869247\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct"
Sep 11 14:26:58.623260 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:58.623189    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct"
Sep 11 14:26:58.903234 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:58.903208    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct"]
Sep 11 14:26:58.904076 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:26:58.904048    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8b6e945d_f7a1_4d1b_854d_638c1c869247.slice/crio-dfe05415479cf4f22640508394119b03cbb567466b2bb4fa9472c4ed92abc19d WatchSource:0}: Error finding container dfe05415479cf4f22640508394119b03cbb567466b2bb4fa9472c4ed92abc19d: Status 404 returned error can't find the container with id dfe05415479cf4f22640508394119b03cbb567466b2bb4fa9472c4ed92abc19d
Sep 11 14:26:59.790335 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:59.790303    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-96hn4"
Sep 11 14:26:59.830972 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:26:59.830918    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct" event={"ID":"8b6e945d-f7a1-4d1b-854d-638c1c869247","Type":"ContainerStarted","Data":"dfe05415479cf4f22640508394119b03cbb567466b2bb4fa9472c4ed92abc19d"}
Sep 11 14:27:01.841736 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:27:01.841651    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct" event={"ID":"8b6e945d-f7a1-4d1b-854d-638c1c869247","Type":"ContainerStarted","Data":"7ea87f5a54e71121c05eadc43bc2637c8ddcdb7c9fbe1ec752368a582a64f7d9"}
Sep 11 14:27:01.842107 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:27:01.841766    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct"
Sep 11 14:27:32.848792 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:27:32.848758    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct"
Sep 11 14:27:32.871306 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:27:32.871255    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74rct" podStartSLOduration=32.32852962 podStartE2EDuration="34.871239885s" totalImagesPullingTime="2.542710265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:26:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:27:01.883233683 +0000 UTC m=+718.097819344" watchObservedRunningTime="2026-09-11 14:27:32.871239885 +0000 UTC m=+749.085825572"
Sep 11 14:28:02.813525 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:02.813489    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"]
Sep 11 14:28:02.816661 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:02.816637    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:02.822195 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:02.822173    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-h5nnm\""
Sep 11 14:28:02.823282 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:02.823257    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 14:28:02.823409 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:02.823301    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 14:28:02.874893 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:02.874847    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkk26\" (UniqueName: \"kubernetes.io/projected/746f02ef-39c7-4bc9-99c0-18409c0fe6f3-kube-api-access-zkk26\") pod \"limitador-operator-controller-manager-74495c69f8-mb2px\" (UID: \"746f02ef-39c7-4bc9-99c0-18409c0fe6f3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:02.922057 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:02.922034    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"]
Sep 11 14:28:02.975936 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:02.975911    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkk26\" (UniqueName: \"kubernetes.io/projected/746f02ef-39c7-4bc9-99c0-18409c0fe6f3-kube-api-access-zkk26\") pod \"limitador-operator-controller-manager-74495c69f8-mb2px\" (UID: \"746f02ef-39c7-4bc9-99c0-18409c0fe6f3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:03.012282 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:03.012252    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkk26\" (UniqueName: \"kubernetes.io/projected/746f02ef-39c7-4bc9-99c0-18409c0fe6f3-kube-api-access-zkk26\") pod \"limitador-operator-controller-manager-74495c69f8-mb2px\" (UID: \"746f02ef-39c7-4bc9-99c0-18409c0fe6f3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:03.127172 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:03.127107    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:03.447401 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:03.447367    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"]
Sep 11 14:28:03.452590 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:28:03.452562    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746f02ef_39c7_4bc9_99c0_18409c0fe6f3.slice/crio-21202e45485ed4e11d0c7c6aeaa8942733cf2c1cbdec1106392715f89c0cebc5 WatchSource:0}: Error finding container 21202e45485ed4e11d0c7c6aeaa8942733cf2c1cbdec1106392715f89c0cebc5: Status 404 returned error can't find the container with id 21202e45485ed4e11d0c7c6aeaa8942733cf2c1cbdec1106392715f89c0cebc5
Sep 11 14:28:04.089213 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:04.089177    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px" event={"ID":"746f02ef-39c7-4bc9-99c0-18409c0fe6f3","Type":"ContainerStarted","Data":"21202e45485ed4e11d0c7c6aeaa8942733cf2c1cbdec1106392715f89c0cebc5"}
Sep 11 14:28:07.105561 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:07.105523    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px" event={"ID":"746f02ef-39c7-4bc9-99c0-18409c0fe6f3","Type":"ContainerStarted","Data":"81a0b9fed133bd4585c47ff9f987d85cc58f3b00b24c6221211b606fcf7522dd"}
Sep 11 14:28:07.106017 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:07.105670    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:07.164754 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:07.164709    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px" podStartSLOduration=2.5762055139999998 podStartE2EDuration="5.164694919s" totalImagesPullingTime="2.588489405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:28:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:28:07.163289614 +0000 UTC m=+783.377875297" watchObservedRunningTime="2026-09-11 14:28:07.164694919 +0000 UTC m=+783.379280580"
Sep 11 14:28:12.413496 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:12.413462    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j5sc"]
Sep 11 14:28:12.416733 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:12.416718    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j5sc"
Sep 11 14:28:12.421300 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:12.421278    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 14:28:12.421460 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:12.421394    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8m8fv\""
Sep 11 14:28:12.456251 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:12.456226    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqwrl\" (UniqueName: \"kubernetes.io/projected/0798736c-4466-4e22-8ae7-ae2b4a2cf168-kube-api-access-tqwrl\") pod \"dns-operator-controller-manager-7b84cd7c9c-4j5sc\" (UID: \"0798736c-4466-4e22-8ae7-ae2b4a2cf168\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j5sc"
Sep 11 14:28:12.473037 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:12.473016    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j5sc"]
Sep 11 14:28:12.557158 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:12.557135    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqwrl\" (UniqueName: \"kubernetes.io/projected/0798736c-4466-4e22-8ae7-ae2b4a2cf168-kube-api-access-tqwrl\") pod \"dns-operator-controller-manager-7b84cd7c9c-4j5sc\" (UID: \"0798736c-4466-4e22-8ae7-ae2b4a2cf168\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j5sc"
Sep 11 14:28:12.570849 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:12.570818    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqwrl\" (UniqueName: \"kubernetes.io/projected/0798736c-4466-4e22-8ae7-ae2b4a2cf168-kube-api-access-tqwrl\") pod \"dns-operator-controller-manager-7b84cd7c9c-4j5sc\" (UID: \"0798736c-4466-4e22-8ae7-ae2b4a2cf168\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j5sc"
Sep 11 14:28:12.726729 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:12.726706    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j5sc"
Sep 11 14:28:13.016401 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:13.010535    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j5sc"]
Sep 11 14:28:13.131808 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:13.131783    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j5sc" event={"ID":"0798736c-4466-4e22-8ae7-ae2b4a2cf168","Type":"ContainerStarted","Data":"a2d65a8c5fde47f49f7bbfae02eb3e8fe45afa469a71c19d74c0f223a4803343"}
Sep 11 14:28:15.144459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:15.144423    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j5sc" event={"ID":"0798736c-4466-4e22-8ae7-ae2b4a2cf168","Type":"ContainerStarted","Data":"231c81674a14b3345da8bf3671d1f9cc1a52f1b09a09dad2267c8ac7a082ae46"}
Sep 11 14:28:15.144923 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:15.144548    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j5sc"
Sep 11 14:28:15.180942 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:15.180901    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j5sc" podStartSLOduration=1.5916941310000001 podStartE2EDuration="3.180864443s" totalImagesPullingTime="1.589170312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:28:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:28:15.180525324 +0000 UTC m=+791.395110986" watchObservedRunningTime="2026-09-11 14:28:15.180864443 +0000 UTC m=+791.395450103"
Sep 11 14:28:18.112203 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.112175    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:18.163043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.163013    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"]
Sep 11 14:28:18.166344 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.166322    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"
Sep 11 14:28:18.177776 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.177752    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 14:28:18.178548 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.178532    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 14:28:18.178796 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.178781    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-df2n6\""
Sep 11 14:28:18.184665 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.184644    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"]
Sep 11 14:28:18.305388 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.305361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/44d6cade-a717-48fb-b297-de2a4ee0249b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-b585l\" (UID: \"44d6cade-a717-48fb-b297-de2a4ee0249b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"
Sep 11 14:28:18.305554 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.305425    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/44d6cade-a717-48fb-b297-de2a4ee0249b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-b585l\" (UID: \"44d6cade-a717-48fb-b297-de2a4ee0249b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"
Sep 11 14:28:18.305554 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.305455    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vf6mx\" (UniqueName: \"kubernetes.io/projected/44d6cade-a717-48fb-b297-de2a4ee0249b-kube-api-access-vf6mx\") pod \"kuadrant-console-plugin-fbdd4f445-b585l\" (UID: \"44d6cade-a717-48fb-b297-de2a4ee0249b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"
Sep 11 14:28:18.406561 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.406495    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/44d6cade-a717-48fb-b297-de2a4ee0249b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-b585l\" (UID: \"44d6cade-a717-48fb-b297-de2a4ee0249b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"
Sep 11 14:28:18.406561 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.406544    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/44d6cade-a717-48fb-b297-de2a4ee0249b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-b585l\" (UID: \"44d6cade-a717-48fb-b297-de2a4ee0249b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"
Sep 11 14:28:18.406561 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.406563    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vf6mx\" (UniqueName: \"kubernetes.io/projected/44d6cade-a717-48fb-b297-de2a4ee0249b-kube-api-access-vf6mx\") pod \"kuadrant-console-plugin-fbdd4f445-b585l\" (UID: \"44d6cade-a717-48fb-b297-de2a4ee0249b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"
Sep 11 14:28:18.407227 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.407200    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/44d6cade-a717-48fb-b297-de2a4ee0249b-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-b585l\" (UID: \"44d6cade-a717-48fb-b297-de2a4ee0249b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"
Sep 11 14:28:18.409053 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.409027    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/44d6cade-a717-48fb-b297-de2a4ee0249b-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-b585l\" (UID: \"44d6cade-a717-48fb-b297-de2a4ee0249b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"
Sep 11 14:28:18.423543 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.423519    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vf6mx\" (UniqueName: \"kubernetes.io/projected/44d6cade-a717-48fb-b297-de2a4ee0249b-kube-api-access-vf6mx\") pod \"kuadrant-console-plugin-fbdd4f445-b585l\" (UID: \"44d6cade-a717-48fb-b297-de2a4ee0249b\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"
Sep 11 14:28:18.475545 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.475518    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"
Sep 11 14:28:18.760383 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:18.760360    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l"]
Sep 11 14:28:18.762546 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:28:18.762517    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44d6cade_a717_48fb_b297_de2a4ee0249b.slice/crio-e8cf4562d92d348f51e80e9f19207744094c65a11540d7d1beddb0302afeb040 WatchSource:0}: Error finding container e8cf4562d92d348f51e80e9f19207744094c65a11540d7d1beddb0302afeb040: Status 404 returned error can't find the container with id e8cf4562d92d348f51e80e9f19207744094c65a11540d7d1beddb0302afeb040
Sep 11 14:28:19.161350 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:19.161270    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l" event={"ID":"44d6cade-a717-48fb-b297-de2a4ee0249b","Type":"ContainerStarted","Data":"e8cf4562d92d348f51e80e9f19207744094c65a11540d7d1beddb0302afeb040"}
Sep 11 14:28:24.187314 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:24.187279    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l" event={"ID":"44d6cade-a717-48fb-b297-de2a4ee0249b","Type":"ContainerStarted","Data":"041dee2e077560734c115ca5bee7f726a8c50c2d118accde39da5ea1c155ea48"}
Sep 11 14:28:26.150048 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:26.149977    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-4j5sc"
Sep 11 14:28:26.187627 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:26.187578    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-b585l" podStartSLOduration=3.5836587030000002 podStartE2EDuration="8.187564558s" totalImagesPullingTime="4.603905855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:28:24.21848471 +0000 UTC m=+800.433070370" watchObservedRunningTime="2026-09-11 14:28:26.187564558 +0000 UTC m=+802.402150231"
Sep 11 14:28:29.843188 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:29.843144    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"]
Sep 11 14:28:29.843610 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:29.843350    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px" podUID="746f02ef-39c7-4bc9-99c0-18409c0fe6f3" containerName="manager" containerID="cri-o://81a0b9fed133bd4585c47ff9f987d85cc58f3b00b24c6221211b606fcf7522dd" gracePeriod=2
Sep 11 14:28:29.869758 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:29.869729    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"]
Sep 11 14:28:29.872202 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:28:29.872165    2569 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"746f02ef-39c7-4bc9-99c0-18409c0fe6f3\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-74495c69f8-mb2px\": pods \"limitador-operator-controller-manager-74495c69f8-mb2px\" not found" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:29.907258 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:29.907235    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-w8svv"]
Sep 11 14:28:29.907529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:29.907517    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="746f02ef-39c7-4bc9-99c0-18409c0fe6f3" containerName="manager"
Sep 11 14:28:29.907579 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:29.907530    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="746f02ef-39c7-4bc9-99c0-18409c0fe6f3" containerName="manager"
Sep 11 14:28:29.907613 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:29.907590    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="746f02ef-39c7-4bc9-99c0-18409c0fe6f3" containerName="manager"
Sep 11 14:28:29.910413 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:29.910398    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w8svv"
Sep 11 14:28:29.936786 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:29.936760    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-w8svv"]
Sep 11 14:28:30.002135 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.002105    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nztnl\" (UniqueName: \"kubernetes.io/projected/92a82021-ea31-41f5-b980-cb58edeaeaeb-kube-api-access-nztnl\") pod \"limitador-operator-controller-manager-74495c69f8-w8svv\" (UID: \"92a82021-ea31-41f5-b980-cb58edeaeaeb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w8svv"
Sep 11 14:28:30.005098 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:28:30.005070    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mb2px\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" podUID="746f02ef-39c7-4bc9-99c0-18409c0fe6f3" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:30.093793 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.093741    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:30.100215 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:28:30.100189    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mb2px\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" podUID="746f02ef-39c7-4bc9-99c0-18409c0fe6f3" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:30.102512 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.102486    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nztnl\" (UniqueName: \"kubernetes.io/projected/92a82021-ea31-41f5-b980-cb58edeaeaeb-kube-api-access-nztnl\") pod \"limitador-operator-controller-manager-74495c69f8-w8svv\" (UID: \"92a82021-ea31-41f5-b980-cb58edeaeaeb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w8svv"
Sep 11 14:28:30.128445 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.128415    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nztnl\" (UniqueName: \"kubernetes.io/projected/92a82021-ea31-41f5-b980-cb58edeaeaeb-kube-api-access-nztnl\") pod \"limitador-operator-controller-manager-74495c69f8-w8svv\" (UID: \"92a82021-ea31-41f5-b980-cb58edeaeaeb\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w8svv"
Sep 11 14:28:30.203762 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.203736    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zkk26\" (UniqueName: \"kubernetes.io/projected/746f02ef-39c7-4bc9-99c0-18409c0fe6f3-kube-api-access-zkk26\") pod \"746f02ef-39c7-4bc9-99c0-18409c0fe6f3\" (UID: \"746f02ef-39c7-4bc9-99c0-18409c0fe6f3\") "
Sep 11 14:28:30.205982 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.205952    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/746f02ef-39c7-4bc9-99c0-18409c0fe6f3-kube-api-access-zkk26" (OuterVolumeSpecName: "kube-api-access-zkk26") pod "746f02ef-39c7-4bc9-99c0-18409c0fe6f3" (UID: "746f02ef-39c7-4bc9-99c0-18409c0fe6f3"). InnerVolumeSpecName "kube-api-access-zkk26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:28:30.215019 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.214986    2569 generic.go:356] "Generic (PLEG): container finished" podID="746f02ef-39c7-4bc9-99c0-18409c0fe6f3" containerID="81a0b9fed133bd4585c47ff9f987d85cc58f3b00b24c6221211b606fcf7522dd" exitCode=0
Sep 11 14:28:30.215134 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.215042    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:30.215134 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.215094    2569 scope.go:117] "RemoveContainer" containerID="81a0b9fed133bd4585c47ff9f987d85cc58f3b00b24c6221211b606fcf7522dd"
Sep 11 14:28:30.221398 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:28:30.221371    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mb2px\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" podUID="746f02ef-39c7-4bc9-99c0-18409c0fe6f3" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:30.222046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.222026    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w8svv"
Sep 11 14:28:30.223059 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.223042    2569 scope.go:117] "RemoveContainer" containerID="81a0b9fed133bd4585c47ff9f987d85cc58f3b00b24c6221211b606fcf7522dd"
Sep 11 14:28:30.223325 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:28:30.223304    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81a0b9fed133bd4585c47ff9f987d85cc58f3b00b24c6221211b606fcf7522dd\": container with ID starting with 81a0b9fed133bd4585c47ff9f987d85cc58f3b00b24c6221211b606fcf7522dd not found: ID does not exist" containerID="81a0b9fed133bd4585c47ff9f987d85cc58f3b00b24c6221211b606fcf7522dd"
Sep 11 14:28:30.223377 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.223334    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81a0b9fed133bd4585c47ff9f987d85cc58f3b00b24c6221211b606fcf7522dd"} err="failed to get container status \"81a0b9fed133bd4585c47ff9f987d85cc58f3b00b24c6221211b606fcf7522dd\": rpc error: code = NotFound desc = could not find container \"81a0b9fed133bd4585c47ff9f987d85cc58f3b00b24c6221211b606fcf7522dd\": container with ID starting with 81a0b9fed133bd4585c47ff9f987d85cc58f3b00b24c6221211b606fcf7522dd not found: ID does not exist"
Sep 11 14:28:30.225123 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:28:30.225101    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-mb2px\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" podUID="746f02ef-39c7-4bc9-99c0-18409c0fe6f3" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-mb2px"
Sep 11 14:28:30.271782 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.271754    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="746f02ef-39c7-4bc9-99c0-18409c0fe6f3" path="/var/lib/kubelet/pods/746f02ef-39c7-4bc9-99c0-18409c0fe6f3/volumes"
Sep 11 14:28:30.304387 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.304365    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zkk26\" (UniqueName: \"kubernetes.io/projected/746f02ef-39c7-4bc9-99c0-18409c0fe6f3-kube-api-access-zkk26\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:28:30.523450 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:30.523388    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-w8svv"]
Sep 11 14:28:30.525500 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:28:30.525468    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a82021_ea31_41f5_b980_cb58edeaeaeb.slice/crio-25a9a1b4e8fd3fada29448fc282873eaf30efc39daa9ab12838547e864d872ec WatchSource:0}: Error finding container 25a9a1b4e8fd3fada29448fc282873eaf30efc39daa9ab12838547e864d872ec: Status 404 returned error can't find the container with id 25a9a1b4e8fd3fada29448fc282873eaf30efc39daa9ab12838547e864d872ec
Sep 11 14:28:31.221183 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:31.221150    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w8svv" event={"ID":"92a82021-ea31-41f5-b980-cb58edeaeaeb","Type":"ContainerStarted","Data":"e7db096f0ec6350a726495adc7934ce4138f51b87572d6b9a3973f36919cc301"}
Sep 11 14:28:31.221583 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:31.221208    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w8svv" event={"ID":"92a82021-ea31-41f5-b980-cb58edeaeaeb","Type":"ContainerStarted","Data":"25a9a1b4e8fd3fada29448fc282873eaf30efc39daa9ab12838547e864d872ec"}
Sep 11 14:28:31.221583 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:31.221238    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w8svv"
Sep 11 14:28:42.228383 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:42.228352    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w8svv"
Sep 11 14:28:42.284128 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:42.284073    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-w8svv" podStartSLOduration=13.284058768 podStartE2EDuration="13.284058768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:28:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:28:31.261470501 +0000 UTC m=+807.476056162" watchObservedRunningTime="2026-09-11 14:28:42.284058768 +0000 UTC m=+818.498644429"
Sep 11 14:28:59.002726 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.002693    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"]
Sep 11 14:28:59.005827 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.005812    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.008413 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.008394    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-rw5hh\""
Sep 11 14:28:59.024255 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.024225    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"]
Sep 11 14:28:59.026866 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.026835    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.027008 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.026907    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.027008 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.026962    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.027128 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.027043    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.027128 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.027087    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.027128 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.027123    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.027289 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.027156    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.027289 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.027192    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.027289 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.027218    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpzt4\" (UniqueName: \"kubernetes.io/projected/e9b66d6c-5f70-4d95-83b4-dea81610cae9-kube-api-access-lpzt4\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128001    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128053    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128080    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128096    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpzt4\" (UniqueName: \"kubernetes.io/projected/e9b66d6c-5f70-4d95-83b4-dea81610cae9-kube-api-access-lpzt4\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128132    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128165    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128186    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128533 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128470    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128533 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128479    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128533 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128485    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128656 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128557    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128656 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128607    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128720 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128656    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.128961 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.128942    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.130556 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.130539    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.131019 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.131002    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.142336 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.139336    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpzt4\" (UniqueName: \"kubernetes.io/projected/e9b66d6c-5f70-4d95-83b4-dea81610cae9-kube-api-access-lpzt4\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.145513 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.145488    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9b66d6c-5f70-4d95-83b4-dea81610cae9-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-4p9dz\" (UID: \"e9b66d6c-5f70-4d95-83b4-dea81610cae9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.316908 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.316789    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:28:59.611146 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.611055    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"]
Sep 11 14:28:59.613981 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:28:59.613954    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9b66d6c_5f70_4d95_83b4_dea81610cae9.slice/crio-35f69cfbbc13e4db5dad78c446a99d6a90d65bccdcdf31bde808c40fb5027d0b WatchSource:0}: Error finding container 35f69cfbbc13e4db5dad78c446a99d6a90d65bccdcdf31bde808c40fb5027d0b: Status 404 returned error can't find the container with id 35f69cfbbc13e4db5dad78c446a99d6a90d65bccdcdf31bde808c40fb5027d0b
Sep 11 14:28:59.616025 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.615988    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:28:59.616088 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.616060    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:28:59.616124 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:28:59.616089    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:29:00.344039 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:00.343995    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz" event={"ID":"e9b66d6c-5f70-4d95-83b4-dea81610cae9","Type":"ContainerStarted","Data":"2d4f1d7423d6ee8a5ffd1d48acb7820c66adf60d4dfaf1d7236d0de1351b8926"}
Sep 11 14:29:00.344507 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:00.344058    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz" event={"ID":"e9b66d6c-5f70-4d95-83b4-dea81610cae9","Type":"ContainerStarted","Data":"35f69cfbbc13e4db5dad78c446a99d6a90d65bccdcdf31bde808c40fb5027d0b"}
Sep 11 14:29:00.376479 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:00.376432    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz" podStartSLOduration=2.376415422 podStartE2EDuration="2.376415422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:28:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:29:00.37513605 +0000 UTC m=+836.589721710" watchObservedRunningTime="2026-09-11 14:29:00.376415422 +0000 UTC m=+836.591001082"
Sep 11 14:29:01.317949 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:01.317918    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:29:01.322565 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:01.322540    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:29:01.350305 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:01.350271    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:29:01.351627 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:01.351602    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:29:13.657477 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:13.657439    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:29:13.662253 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:13.662233    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"
Sep 11 14:29:13.665029 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:13.665010    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 14:29:13.668981 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:13.668957    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:29:13.701659 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:13.701631    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:29:13.758932 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:13.758906    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld92b\" (UniqueName: \"kubernetes.io/projected/d90ffe1a-711b-46d6-88a9-60fff0ab4432-kube-api-access-ld92b\") pod \"limitador-limitador-84994f7ffc-rwwjc\" (UID: \"d90ffe1a-711b-46d6-88a9-60fff0ab4432\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"
Sep 11 14:29:13.759060 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:13.758940    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d90ffe1a-711b-46d6-88a9-60fff0ab4432-config-file\") pod \"limitador-limitador-84994f7ffc-rwwjc\" (UID: \"d90ffe1a-711b-46d6-88a9-60fff0ab4432\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"
Sep 11 14:29:13.860329 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:13.860298    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld92b\" (UniqueName: \"kubernetes.io/projected/d90ffe1a-711b-46d6-88a9-60fff0ab4432-kube-api-access-ld92b\") pod \"limitador-limitador-84994f7ffc-rwwjc\" (UID: \"d90ffe1a-711b-46d6-88a9-60fff0ab4432\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"
Sep 11 14:29:13.860455 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:13.860332    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d90ffe1a-711b-46d6-88a9-60fff0ab4432-config-file\") pod \"limitador-limitador-84994f7ffc-rwwjc\" (UID: \"d90ffe1a-711b-46d6-88a9-60fff0ab4432\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"
Sep 11 14:29:13.861001 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:13.860984    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d90ffe1a-711b-46d6-88a9-60fff0ab4432-config-file\") pod \"limitador-limitador-84994f7ffc-rwwjc\" (UID: \"d90ffe1a-711b-46d6-88a9-60fff0ab4432\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"
Sep 11 14:29:13.874844 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:13.874817    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld92b\" (UniqueName: \"kubernetes.io/projected/d90ffe1a-711b-46d6-88a9-60fff0ab4432-kube-api-access-ld92b\") pod \"limitador-limitador-84994f7ffc-rwwjc\" (UID: \"d90ffe1a-711b-46d6-88a9-60fff0ab4432\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"
Sep 11 14:29:13.973994 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:13.973960    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"
Sep 11 14:29:14.252492 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:14.252470    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:29:14.254454 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:29:14.254425    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd90ffe1a_711b_46d6_88a9_60fff0ab4432.slice/crio-762a88bd5e370b128dcedd21af492501e879ae83fea3c0fd1203ca545e3f00fb WatchSource:0}: Error finding container 762a88bd5e370b128dcedd21af492501e879ae83fea3c0fd1203ca545e3f00fb: Status 404 returned error can't find the container with id 762a88bd5e370b128dcedd21af492501e879ae83fea3c0fd1203ca545e3f00fb
Sep 11 14:29:14.406648 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:14.406614    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-rwwjc" event={"ID":"d90ffe1a-711b-46d6-88a9-60fff0ab4432","Type":"ContainerStarted","Data":"762a88bd5e370b128dcedd21af492501e879ae83fea3c0fd1203ca545e3f00fb"}
Sep 11 14:29:16.416908 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:16.416811    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-rwwjc" event={"ID":"d90ffe1a-711b-46d6-88a9-60fff0ab4432","Type":"ContainerStarted","Data":"2aa71cecbc2346fe4eff54eef4e1f7498de47b62ba662219fdb068733726c53f"}
Sep 11 14:29:16.417229 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:16.416930    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"
Sep 11 14:29:16.437039 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:16.436991    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-rwwjc" podStartSLOduration=1.7510637230000001 podStartE2EDuration="3.436976329s" totalImagesPullingTime="1.685912606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:29:16.436406169 +0000 UTC m=+852.650991831" watchObservedRunningTime="2026-09-11 14:29:16.436976329 +0000 UTC m=+852.651561996"
Sep 11 14:29:27.422039 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:29:27.422006    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"
Sep 11 14:30:04.223342 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:04.223277    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:30:04.223342 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:04.223277    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:30:31.223661 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:31.223623    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:30:40.797456 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:40.797418    2569 generic.go:356] "Generic (PLEG): container finished" podID="e9b66d6c-5f70-4d95-83b4-dea81610cae9" containerID="2d4f1d7423d6ee8a5ffd1d48acb7820c66adf60d4dfaf1d7236d0de1351b8926" exitCode=0
Sep 11 14:30:40.797895 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:40.797500    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz" event={"ID":"e9b66d6c-5f70-4d95-83b4-dea81610cae9","Type":"ContainerDied","Data":"2d4f1d7423d6ee8a5ffd1d48acb7820c66adf60d4dfaf1d7236d0de1351b8926"}
Sep 11 14:30:40.798014 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:40.797997    2569 scope.go:117] "RemoveContainer" containerID="2d4f1d7423d6ee8a5ffd1d48acb7820c66adf60d4dfaf1d7236d0de1351b8926"
Sep 11 14:30:40.799036 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:40.799006    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:30:40.799156 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:40.799085    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:30:40.799156 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:40.799134    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:30:41.803507 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:41.803467    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz" event={"ID":"e9b66d6c-5f70-4d95-83b4-dea81610cae9","Type":"ContainerStarted","Data":"cf0f6114731eaa35f89bc2472ba093d22c6acdb23e57adf4d8cc54a5a22cc4de"}
Sep 11 14:30:42.317544 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:42.317513    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:30:42.318583 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:42.318554    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4p9dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 11 14:30:42.318706 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:42.318612    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz" podUID="e9b66d6c-5f70-4d95-83b4-dea81610cae9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 11 14:30:43.317193 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:43.317154    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4p9dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 11 14:30:43.317578 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:43.317205    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz" podUID="e9b66d6c-5f70-4d95-83b4-dea81610cae9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 11 14:30:44.317772 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:44.317735    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4p9dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 11 14:30:44.318204 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:44.317791    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz" podUID="e9b66d6c-5f70-4d95-83b4-dea81610cae9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 11 14:30:45.317684 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:45.317648    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4p9dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 11 14:30:45.317856 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:45.317718    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz" podUID="e9b66d6c-5f70-4d95-83b4-dea81610cae9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 11 14:30:46.317520 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:46.317485    2569 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-4p9dz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 11 14:30:46.317700 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:46.317545    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz" podUID="e9b66d6c-5f70-4d95-83b4-dea81610cae9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 11 14:30:46.351100 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:46.350318    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:30:47.321013 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:47.320981    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:30:47.321774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:47.321758    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-4p9dz"
Sep 11 14:30:50.239169 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:50.239132    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:30:55.720954 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:30:55.720914    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:31:02.413449 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:02.413409    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:31:22.548201 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:22.548160    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:31:32.647584 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:32.647505    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:31:34.759140 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:34.759081    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"]
Sep 11 14:31:34.761543 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:34.761527    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:34.765275 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:31:34.765234    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" podUID="1afef77b-c976-4a14-973d-2f8a9d2f02c2" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:34.766159 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:31:34.766136    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-n6hc4\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"default-dockercfg-n6hc4\"" type="*v1.Secret"
Sep 11 14:31:34.766426 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:31:34.766403    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 11 14:31:34.766518 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:31:34.766403    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 11 14:31:34.768944 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:31:34.768917    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"facebook-opt-125m-simulated-kserve-self-signed-certs\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" type="*v1.Secret"
Sep 11 14:31:34.824611 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:34.824579    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"]
Sep 11 14:31:34.949908 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:34.949838    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1afef77b-c976-4a14-973d-2f8a9d2f02c2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:34.949908 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:34.949907    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1afef77b-c976-4a14-973d-2f8a9d2f02c2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:34.950183 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:34.949944    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1afef77b-c976-4a14-973d-2f8a9d2f02c2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:34.950183 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:34.949971    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmpxr\" (UniqueName: \"kubernetes.io/projected/1afef77b-c976-4a14-973d-2f8a9d2f02c2-kube-api-access-tmpxr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:34.950183 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:34.950015    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1afef77b-c976-4a14-973d-2f8a9d2f02c2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:34.950183 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:34.950034    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1afef77b-c976-4a14-973d-2f8a9d2f02c2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:35.051162 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:35.051079    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1afef77b-c976-4a14-973d-2f8a9d2f02c2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:35.051162 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:35.051120    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1afef77b-c976-4a14-973d-2f8a9d2f02c2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:35.051334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:35.051237    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1afef77b-c976-4a14-973d-2f8a9d2f02c2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:35.051334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:35.051277    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmpxr\" (UniqueName: \"kubernetes.io/projected/1afef77b-c976-4a14-973d-2f8a9d2f02c2-kube-api-access-tmpxr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:35.051334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:35.051303    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1afef77b-c976-4a14-973d-2f8a9d2f02c2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:35.051334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:35.051332    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1afef77b-c976-4a14-973d-2f8a9d2f02c2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:35.051512 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:35.051492    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1afef77b-c976-4a14-973d-2f8a9d2f02c2-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:35.051561 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:35.051546    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1afef77b-c976-4a14-973d-2f8a9d2f02c2-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:35.051704 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:35.051685    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1afef77b-c976-4a14-973d-2f8a9d2f02c2-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:35.053652 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:35.053625    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1afef77b-c976-4a14-973d-2f8a9d2f02c2-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:35.747370 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:35.747334    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-n6hc4\""
Sep 11 14:31:35.774451 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:35.774416    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 14:31:36.051952 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:31:36.051851    2569 secret.go:189] Couldn't get secret llm/facebook-opt-125m-simulated-kserve-self-signed-certs: failed to sync secret cache: timed out waiting for the condition
Sep 11 14:31:36.051952 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:31:36.051939    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1afef77b-c976-4a14-973d-2f8a9d2f02c2-tls-certs podName:1afef77b-c976-4a14-973d-2f8a9d2f02c2 nodeName:}" failed. No retries permitted until 2026-09-11 14:31:36.551919164 +0000 UTC m=+992.766504834 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1afef77b-c976-4a14-973d-2f8a9d2f02c2-tls-certs") pod "facebook-opt-125m-simulated-kserve-74b68447df-cgsxf" (UID: "1afef77b-c976-4a14-973d-2f8a9d2f02c2") : failed to sync secret cache: timed out waiting for the condition
Sep 11 14:31:36.133580 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:36.133552    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 11 14:31:36.271612 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:36.271580    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 14:31:36.280008 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:36.279985    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmpxr\" (UniqueName: \"kubernetes.io/projected/1afef77b-c976-4a14-973d-2f8a9d2f02c2-kube-api-access-tmpxr\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:36.564108 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:36.564081    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1afef77b-c976-4a14-973d-2f8a9d2f02c2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:36.566722 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:36.566701    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1afef77b-c976-4a14-973d-2f8a9d2f02c2-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cgsxf\" (UID: \"1afef77b-c976-4a14-973d-2f8a9d2f02c2\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:36.571606 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:36.571584    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:36.866757 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:36.866670    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"]
Sep 11 14:31:36.872410 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:31:36.872382    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1afef77b_c976_4a14_973d_2f8a9d2f02c2.slice/crio-4e259cf1cc85e8cb0aac056b060584e70231ee41d26c09daf8d815a48862de00 WatchSource:0}: Error finding container 4e259cf1cc85e8cb0aac056b060584e70231ee41d26c09daf8d815a48862de00: Status 404 returned error can't find the container with id 4e259cf1cc85e8cb0aac056b060584e70231ee41d26c09daf8d815a48862de00
Sep 11 14:31:36.880431 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:36.874266    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:31:37.047991 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:37.047952    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf" event={"ID":"1afef77b-c976-4a14-973d-2f8a9d2f02c2","Type":"ContainerStarted","Data":"4e259cf1cc85e8cb0aac056b060584e70231ee41d26c09daf8d815a48862de00"}
Sep 11 14:31:38.054450 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:38.054410    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf" event={"ID":"1afef77b-c976-4a14-973d-2f8a9d2f02c2","Type":"ContainerStarted","Data":"6ca582116fd7a6927711da246a21c67bc1f26a6cd3ab77415476137b51fc9449"}
Sep 11 14:31:40.038369 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:40.038318    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf" podStartSLOduration=4.980544082 podStartE2EDuration="6.038300304s" totalImagesPullingTime="1.057756222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:31:38.107607669 +0000 UTC m=+994.322193331" watchObservedRunningTime="2026-09-11 14:31:40.038300304 +0000 UTC m=+996.252885968"
Sep 11 14:31:40.039194 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:40.039172    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:31:45.031474 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:45.031442    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:31:46.571830 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:46.571789    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:46.572337 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:46.571868    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:46.587774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:46.587747    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:31:47.104703 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:31:47.104677    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cgsxf"
Sep 11 14:32:50.978427 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:50.978395    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"]
Sep 11 14:32:50.980664 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:50.980638    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:50.988784 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:50.988766    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d4444b-openshift-default-dockercfg-htk6p\""
Sep 11 14:32:51.017814 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.017783    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"]
Sep 11 14:32:51.082132 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.082097    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-workload-socket\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.082132 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.082134    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-token\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.082373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.082160    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-envoy\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.082373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.082186    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-podinfo\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.082373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.082306    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-credential-socket\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.082526 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.082372    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istiod-ca-cert\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.082526 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.082403    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l5rc\" (UniqueName: \"kubernetes.io/projected/412d77cc-45a0-4b12-a76c-095dec3aaeb6-kube-api-access-7l5rc\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.082526 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.082441    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-data\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.082526 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.082501    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-workload-certs\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.183601 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.183560    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istiod-ca-cert\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.183601 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.183599    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l5rc\" (UniqueName: \"kubernetes.io/projected/412d77cc-45a0-4b12-a76c-095dec3aaeb6-kube-api-access-7l5rc\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.183822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.183618    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-data\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.183822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.183656    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-workload-certs\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.183822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.183682    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-workload-socket\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.183822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.183697    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-token\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.183822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.183729    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-envoy\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.183822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.183757    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-podinfo\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.184140 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.183829    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-credential-socket\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.184192 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.184173    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-workload-certs\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.184230 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.184210    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-credential-socket\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.184282 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.184260    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-workload-socket\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.184429 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.184407    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istiod-ca-cert\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.184523 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.184508    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-data\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.186292 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.186272    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-envoy\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.186492 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.186475    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-podinfo\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.218213 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.218186    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-token\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.232253 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.232195    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l5rc\" (UniqueName: \"kubernetes.io/projected/412d77cc-45a0-4b12-a76c-095dec3aaeb6-kube-api-access-7l5rc\") pod \"e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") " pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.290104 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.290071    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:51.590645 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.590580    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"]
Sep 11 14:32:51.594768 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:32:51.594736    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod412d77cc_45a0_4b12_a76c_095dec3aaeb6.slice/crio-44c6f7614025a9b713e9fecf09f017b36d7f13eb6595f75bc5427ca0effe9791 WatchSource:0}: Error finding container 44c6f7614025a9b713e9fecf09f017b36d7f13eb6595f75bc5427ca0effe9791: Status 404 returned error can't find the container with id 44c6f7614025a9b713e9fecf09f017b36d7f13eb6595f75bc5427ca0effe9791
Sep 11 14:32:51.596769 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.596738    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:32:51.596845 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.596799    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:32:51.596845 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:51.596830    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:32:52.391455 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:52.391412    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v" event={"ID":"412d77cc-45a0-4b12-a76c-095dec3aaeb6","Type":"ContainerStarted","Data":"f0679f145ac95dae66bdc903b01aeb60e2bb2b67d7b4139d591dc0eca00fbcd6"}
Sep 11 14:32:52.391832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:52.391519    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v" event={"ID":"412d77cc-45a0-4b12-a76c-095dec3aaeb6","Type":"ContainerStarted","Data":"44c6f7614025a9b713e9fecf09f017b36d7f13eb6595f75bc5427ca0effe9791"}
Sep 11 14:32:52.428387 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:52.428333    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v" podStartSLOduration=2.428314167 podStartE2EDuration="2.428314167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:32:52.427506839 +0000 UTC m=+1068.642092495" watchObservedRunningTime="2026-09-11 14:32:52.428314167 +0000 UTC m=+1068.642899831"
Sep 11 14:32:53.290993 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:53.290949    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:53.295820 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:53.295793    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:53.396535 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:53.396502    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:53.397494 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:53.397475    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:32:54.600843 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:54.600806    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:32:59.819244 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:59.819156    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"]
Sep 11 14:32:59.821866 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:59.821848    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:32:59.827988 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:59.827961    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-c322a2-openshift-default-dockercfg-rnxds\""
Sep 11 14:32:59.919926 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:59.919868    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"]
Sep 11 14:32:59.963951 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:59.963917    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-podinfo\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:32:59.964123 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:59.963956    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-token\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:32:59.964123 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:59.964001    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-workload-certs\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:32:59.964123 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:59.964029    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-workload-socket\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:32:59.964123 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:59.964049    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-envoy\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:32:59.964123 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:59.964081    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnzcc\" (UniqueName: \"kubernetes.io/projected/65b55159-1f35-43bf-9de8-cec855b3fd31-kube-api-access-lnzcc\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:32:59.964123 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:59.964117    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-credential-socket\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:32:59.964347 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:59.964170    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-data\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:32:59.964347 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:32:59.964272    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65b55159-1f35-43bf-9de8-cec855b3fd31-istiod-ca-cert\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.064978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.064942    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-data\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.065156 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.065008    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65b55159-1f35-43bf-9de8-cec855b3fd31-istiod-ca-cert\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.065156 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.065036    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-podinfo\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.065156 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.065053    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-token\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.065156 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.065078    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-workload-certs\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.065156 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.065110    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-workload-socket\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.065156 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.065134    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-envoy\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.065464 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.065434    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-data\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.065519 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.065439    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnzcc\" (UniqueName: \"kubernetes.io/projected/65b55159-1f35-43bf-9de8-cec855b3fd31-kube-api-access-lnzcc\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.065519 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.065496    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-workload-socket\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.065617 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.065522    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-credential-socket\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.065617 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.065567    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-workload-certs\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.065817 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.065797    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-credential-socket\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.065916 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.065827    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65b55159-1f35-43bf-9de8-cec855b3fd31-istiod-ca-cert\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.067528 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.067507    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-envoy\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.067739 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.067722    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-podinfo\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.079426 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.079372    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-token\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.079711 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.079694    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnzcc\" (UniqueName: \"kubernetes.io/projected/65b55159-1f35-43bf-9de8-cec855b3fd31-kube-api-access-lnzcc\") pod \"e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") " pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.132721 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.132694    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:00.430147 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.430120    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"]
Sep 11 14:33:00.432782 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:33:00.432753    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b55159_1f35_43bf_9de8_cec855b3fd31.slice/crio-6ad4f7387a85f1c9c7725f4c5acc48e97afacc4603bf28cf57ee3d1baff5a9e4 WatchSource:0}: Error finding container 6ad4f7387a85f1c9c7725f4c5acc48e97afacc4603bf28cf57ee3d1baff5a9e4: Status 404 returned error can't find the container with id 6ad4f7387a85f1c9c7725f4c5acc48e97afacc4603bf28cf57ee3d1baff5a9e4
Sep 11 14:33:00.434730 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.434701    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:00.434787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.434771    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:00.434822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:00.434797    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:01.436507 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:01.436466    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r" event={"ID":"65b55159-1f35-43bf-9de8-cec855b3fd31","Type":"ContainerStarted","Data":"a436363ead26175e850d37d8df83482b79756e427b12074919007b6a16479c37"}
Sep 11 14:33:01.436979 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:01.436531    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r" event={"ID":"65b55159-1f35-43bf-9de8-cec855b3fd31","Type":"ContainerStarted","Data":"6ad4f7387a85f1c9c7725f4c5acc48e97afacc4603bf28cf57ee3d1baff5a9e4"}
Sep 11 14:33:01.492729 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:01.492681    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r" podStartSLOduration=2.492665018 podStartE2EDuration="2.492665018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:32:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:01.489102494 +0000 UTC m=+1077.703688155" watchObservedRunningTime="2026-09-11 14:33:01.492665018 +0000 UTC m=+1077.707250679"
Sep 11 14:33:02.133360 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.133326    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:02.138267 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.138242    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:02.217523 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.217491    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"]
Sep 11 14:33:02.220590 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.220574    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.224185 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.224165    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-a0941cbc-kserve-self-signed-certs\""
Sep 11 14:33:02.262828 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.262800    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"]
Sep 11 14:33:02.284909 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.283133    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s28wc\" (UniqueName: \"kubernetes.io/projected/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-kube-api-access-s28wc\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.284909 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.283204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-tls-certs\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.284909 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.283243    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-tmp-dir\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.284909 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.283319    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-home\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.284909 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.283354    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-model-cache\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.284909 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.283394    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-dshm\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.384908 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.384805    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s28wc\" (UniqueName: \"kubernetes.io/projected/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-kube-api-access-s28wc\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.384908 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.384850    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-tls-certs\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.384908 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.384892    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-tmp-dir\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.385189 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.384942    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-home\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.385189 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.384962    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-model-cache\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.385189 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.384999    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-dshm\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.385433 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.385409    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-home\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.385504 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.385443    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-tmp-dir\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.385504 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.385451    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-model-cache\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.387360 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.387335    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-dshm\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.387635 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.387612    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-tls-certs\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.412045 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.412023    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s28wc\" (UniqueName: \"kubernetes.io/projected/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-kube-api-access-s28wc\") pod \"e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") " pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.440638 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.440612    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:02.441480 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.441463    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:02.531163 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.531126    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:02.895593 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:02.895545    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"]
Sep 11 14:33:02.898506 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:33:02.898481    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod59fbfeb3_2caa_494c_ab07_cbaa69b361ae.slice/crio-4715c9c3d3dc4d959b47e18995fd9c9b15bf62622287129cb4c84cfb8c2d519b WatchSource:0}: Error finding container 4715c9c3d3dc4d959b47e18995fd9c9b15bf62622287129cb4c84cfb8c2d519b: Status 404 returned error can't find the container with id 4715c9c3d3dc4d959b47e18995fd9c9b15bf62622287129cb4c84cfb8c2d519b
Sep 11 14:33:03.451306 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:03.450623    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk" event={"ID":"59fbfeb3-2caa-494c-ab07-cbaa69b361ae","Type":"ContainerStarted","Data":"0a526bf15a3c6a20a21204169fb63bba4e30cade6fc616308308f6d616ae3aaf"}
Sep 11 14:33:03.451306 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:03.450669    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk" event={"ID":"59fbfeb3-2caa-494c-ab07-cbaa69b361ae","Type":"ContainerStarted","Data":"4715c9c3d3dc4d959b47e18995fd9c9b15bf62622287129cb4c84cfb8c2d519b"}
Sep 11 14:33:03.577980 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:03.577914    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk" podStartSLOduration=1.5778916619999999 podStartE2EDuration="1.577891662s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:33:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:03.575564862 +0000 UTC m=+1079.790150527" watchObservedRunningTime="2026-09-11 14:33:03.577891662 +0000 UTC m=+1079.792477316"
Sep 11 14:33:04.828911 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:04.825997    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"]
Sep 11 14:33:04.847900 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:04.845261    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:04.889100 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:04.889067    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ac43663d-openshift-default-dockercfg-fr5b6\""
Sep 11 14:33:04.906657 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:04.906629    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26747395-6fe2-4a93-84d0-140148a3b107-istio-podinfo\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:04.906782 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:04.906663    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26747395-6fe2-4a93-84d0-140148a3b107-istio-token\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:04.906782 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:04.906691    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gknh8\" (UniqueName: \"kubernetes.io/projected/26747395-6fe2-4a93-84d0-140148a3b107-kube-api-access-gknh8\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:04.906862 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:04.906790    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-istio-envoy\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:04.906862 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:04.906824    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-istio-data\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:04.906960 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:04.906898    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-credential-socket\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:04.906960 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:04.906946    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-workload-socket\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:04.907044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:04.906961    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-workload-certs\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:04.907044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:04.907020    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26747395-6fe2-4a93-84d0-140148a3b107-istiod-ca-cert\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:04.927515 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:04.927479    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"]
Sep 11 14:33:05.007805 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.007766    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26747395-6fe2-4a93-84d0-140148a3b107-istiod-ca-cert\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.007805 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.007806    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26747395-6fe2-4a93-84d0-140148a3b107-istio-podinfo\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.008106 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.007824    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26747395-6fe2-4a93-84d0-140148a3b107-istio-token\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.008106 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.007864    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gknh8\" (UniqueName: \"kubernetes.io/projected/26747395-6fe2-4a93-84d0-140148a3b107-kube-api-access-gknh8\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.008106 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.007922    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-istio-envoy\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.008106 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.007947    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-istio-data\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.008106 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.007997    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-credential-socket\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.008106 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.008044    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-workload-socket\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.008106 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.008087    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-workload-certs\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.008529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.008503    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-credential-socket\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.008529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.008519    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-workload-socket\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.008648 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.008562    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-workload-certs\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.008648 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.008586    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-istio-data\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.008648 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.008629    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26747395-6fe2-4a93-84d0-140148a3b107-istiod-ca-cert\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.010425 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.010403    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-istio-envoy\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.010526 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.010476    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26747395-6fe2-4a93-84d0-140148a3b107-istio-podinfo\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.084390 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.084315    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gknh8\" (UniqueName: \"kubernetes.io/projected/26747395-6fe2-4a93-84d0-140148a3b107-kube-api-access-gknh8\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.085980 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.085960    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26747395-6fe2-4a93-84d0-140148a3b107-istio-token\") pod \"e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") " pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.160121 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.160081    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:05.492043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.489311    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"]
Sep 11 14:33:05.502055 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:33:05.502030    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26747395_6fe2_4a93_84d0_140148a3b107.slice/crio-64f3bdd3294b3183300bfaed84b899aa96406fbb9ac95bad2f90fe16caa1c645 WatchSource:0}: Error finding container 64f3bdd3294b3183300bfaed84b899aa96406fbb9ac95bad2f90fe16caa1c645: Status 404 returned error can't find the container with id 64f3bdd3294b3183300bfaed84b899aa96406fbb9ac95bad2f90fe16caa1c645
Sep 11 14:33:05.504177 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.504146    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:05.504233 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.504220    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:05.504275 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:05.504251    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:06.466662 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:06.466628    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g" event={"ID":"26747395-6fe2-4a93-84d0-140148a3b107","Type":"ContainerStarted","Data":"8c6c2ee4e14c5ec4b82204f1af6680e3a0d2d12de99e29727ea58b5ed56e6c32"}
Sep 11 14:33:06.467046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:06.466678    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g" event={"ID":"26747395-6fe2-4a93-84d0-140148a3b107","Type":"ContainerStarted","Data":"64f3bdd3294b3183300bfaed84b899aa96406fbb9ac95bad2f90fe16caa1c645"}
Sep 11 14:33:07.160574 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:07.160539    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:07.165576 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:07.165552    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:07.223353 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:07.223281    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g" podStartSLOduration=3.223259196 podStartE2EDuration="3.223259196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:33:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:06.569478355 +0000 UTC m=+1082.784064010" watchObservedRunningTime="2026-09-11 14:33:07.223259196 +0000 UTC m=+1083.437844856"
Sep 11 14:33:07.471426 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:07.471397    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:07.472810 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:07.472790    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:10.278398 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.278366    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"]
Sep 11 14:33:10.282530 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.282507    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.290152 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.288387    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-5b0917-openshift-default-dockercfg-tn9nc\""
Sep 11 14:33:10.351655 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.351619    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"]
Sep 11 14:33:10.364890 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.364840    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-envoy\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.365036 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.364896    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-credential-socket\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.365036 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.364939    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd79113-8d59-4e44-872c-f7692fe708a8-istiod-ca-cert\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.365036 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.364967    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-workload-socket\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.365036 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.364993    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r7tq\" (UniqueName: \"kubernetes.io/projected/9dd79113-8d59-4e44-872c-f7692fe708a8-kube-api-access-9r7tq\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.365257 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.365054    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-workload-certs\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.365257 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.365108    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-podinfo\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.365257 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.365250    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-data\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.365406 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.365284    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-token\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.466555 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.466516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-envoy\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.466555 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.466559    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-credential-socket\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.466804 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.466582    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd79113-8d59-4e44-872c-f7692fe708a8-istiod-ca-cert\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.466804 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.466601    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-workload-socket\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.466804 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.466621    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r7tq\" (UniqueName: \"kubernetes.io/projected/9dd79113-8d59-4e44-872c-f7692fe708a8-kube-api-access-9r7tq\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.466804 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.466636    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-workload-certs\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.466804 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.466655    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-podinfo\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.466804 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.466740    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-data\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.466804 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.466769    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-token\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.467177 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.467093    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-workload-socket\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.467177 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.467167    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-workload-certs\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.467389 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.467367    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-credential-socket\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.467458 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.467369    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-data\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.467509 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.467489    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd79113-8d59-4e44-872c-f7692fe708a8-istiod-ca-cert\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.469162 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.469135    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-envoy\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.469728 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.469701    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-podinfo\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.498549 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.498518    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-token\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.499998 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.499973    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r7tq\" (UniqueName: \"kubernetes.io/projected/9dd79113-8d59-4e44-872c-f7692fe708a8-kube-api-access-9r7tq\") pod \"e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") " pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.595130 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.595047    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:10.940466 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:10.940430    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:33:11.008235 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:33:11.008204    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dd79113_8d59_4e44_872c_f7692fe708a8.slice/crio-e0236abb9d08e6f98a27df0ec7f8e002f717f206a74bf40b789aee2945e51caa WatchSource:0}: Error finding container e0236abb9d08e6f98a27df0ec7f8e002f717f206a74bf40b789aee2945e51caa: Status 404 returned error can't find the container with id e0236abb9d08e6f98a27df0ec7f8e002f717f206a74bf40b789aee2945e51caa
Sep 11 14:33:11.008571 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:11.008553    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"]
Sep 11 14:33:11.010516 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:11.010470    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:11.010589 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:11.010565    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:11.010625 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:11.010609    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:11.492038 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:11.491993    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" event={"ID":"9dd79113-8d59-4e44-872c-f7692fe708a8","Type":"ContainerStarted","Data":"80a38b78473e792fc77c71954ec1ca52990427b13af13c16431b622b21b0d16f"}
Sep 11 14:33:11.492481 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:11.492048    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" event={"ID":"9dd79113-8d59-4e44-872c-f7692fe708a8","Type":"ContainerStarted","Data":"e0236abb9d08e6f98a27df0ec7f8e002f717f206a74bf40b789aee2945e51caa"}
Sep 11 14:33:11.595512 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:11.595485    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:12.499203 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:12.499168    2569 generic.go:356] "Generic (PLEG): container finished" podID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerID="f0679f145ac95dae66bdc903b01aeb60e2bb2b67d7b4139d591dc0eca00fbcd6" exitCode=0
Sep 11 14:33:12.499728 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:12.499246    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v" event={"ID":"412d77cc-45a0-4b12-a76c-095dec3aaeb6","Type":"ContainerDied","Data":"f0679f145ac95dae66bdc903b01aeb60e2bb2b67d7b4139d591dc0eca00fbcd6"}
Sep 11 14:33:12.499815 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:12.499782    2569 scope.go:117] "RemoveContainer" containerID="f0679f145ac95dae66bdc903b01aeb60e2bb2b67d7b4139d591dc0eca00fbcd6"
Sep 11 14:33:12.500917 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:12.500853    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:12.501000 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:12.500971    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:12.501044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:12.501015    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:12.531903 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:12.531835    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" podStartSLOduration=2.531815233 podStartE2EDuration="2.531815233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:33:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:11.620189902 +0000 UTC m=+1087.834775562" watchObservedRunningTime="2026-09-11 14:33:12.531815233 +0000 UTC m=+1088.746400895"
Sep 11 14:33:12.533224 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:12.533090    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:12.533224 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:12.533157    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:12.550077 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:12.549913    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:12.601986 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:12.601953    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:13.506840 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:13.506806    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v" event={"ID":"412d77cc-45a0-4b12-a76c-095dec3aaeb6","Type":"ContainerStarted","Data":"b24ad8ceabb84d09569359fe449a6f8a0ddeeb731418a7ed880a3ccc0e5ebcf9"}
Sep 11 14:33:13.507522 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:13.507500    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:13.508512 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:13.508493    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:13.518909 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:13.518883    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:33:14.291052 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:14.291019    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:33:14.291228 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:14.291193    2569 patch_prober.go:28] interesting pod/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 14:33:14.291272 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:14.291236    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v" podUID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 14:33:15.291324 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:15.291281    2569 patch_prober.go:28] interesting pod/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 14:33:15.291725 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:15.291349    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v" podUID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 14:33:16.290716 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:16.290682    2569 patch_prober.go:28] interesting pod/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 14:33:16.290912 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:16.290735    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v" podUID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 14:33:17.291170 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:17.291135    2569 patch_prober.go:28] interesting pod/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 14:33:17.291567 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:17.291200    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v" podUID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 14:33:18.291200 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:18.291165    2569 patch_prober.go:28] interesting pod/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Sep 11 14:33:18.291609 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:18.291219    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v" podUID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Sep 11 14:33:19.323858 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:19.323806    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:33:19.324379 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:19.324328    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:33:19.325105 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:19.325083    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:33:28.665631 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:28.665599    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr"]
Sep 11 14:33:28.670107 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:28.670079    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr"
Sep 11 14:33:28.673705 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:28.673679    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:33:28.674400 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:28.674380    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:33:28.691183 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:28.690978    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr"]
Sep 11 14:33:28.761920 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:28.761847    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd35305-c1eb-444b-9283-5a6d00627071-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ac43663d-4bskr\" (UID: \"8fd35305-c1eb-444b-9283-5a6d00627071\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr"
Sep 11 14:33:28.863415 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:28.863380    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd35305-c1eb-444b-9283-5a6d00627071-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ac43663d-4bskr\" (UID: \"8fd35305-c1eb-444b-9283-5a6d00627071\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr"
Sep 11 14:33:28.864287 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:28.864261    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd35305-c1eb-444b-9283-5a6d00627071-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ac43663d-4bskr\" (UID: \"8fd35305-c1eb-444b-9283-5a6d00627071\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr"
Sep 11 14:33:28.982903 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:28.982795    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr"
Sep 11 14:33:29.313662 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:29.313578    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr"]
Sep 11 14:33:29.318472 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:33:29.318445    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd35305_c1eb_444b_9283_5a6d00627071.slice/crio-3bdb027e3a19109a2e4506688623b293f8a7306394c5aee27f5b878a6a188437 WatchSource:0}: Error finding container 3bdb027e3a19109a2e4506688623b293f8a7306394c5aee27f5b878a6a188437: Status 404 returned error can't find the container with id 3bdb027e3a19109a2e4506688623b293f8a7306394c5aee27f5b878a6a188437
Sep 11 14:33:29.607260 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:29.607170    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr" event={"ID":"8fd35305-c1eb-444b-9283-5a6d00627071","Type":"ContainerStarted","Data":"3bdb027e3a19109a2e4506688623b293f8a7306394c5aee27f5b878a6a188437"}
Sep 11 14:33:30.752396 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:30.752355    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:33:31.619802 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:31.619770    2569 generic.go:356] "Generic (PLEG): container finished" podID="26747395-6fe2-4a93-84d0-140148a3b107" containerID="8c6c2ee4e14c5ec4b82204f1af6680e3a0d2d12de99e29727ea58b5ed56e6c32" exitCode=0
Sep 11 14:33:31.620050 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:31.619835    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g" event={"ID":"26747395-6fe2-4a93-84d0-140148a3b107","Type":"ContainerDied","Data":"8c6c2ee4e14c5ec4b82204f1af6680e3a0d2d12de99e29727ea58b5ed56e6c32"}
Sep 11 14:33:31.620461 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:31.620357    2569 scope.go:117] "RemoveContainer" containerID="8c6c2ee4e14c5ec4b82204f1af6680e3a0d2d12de99e29727ea58b5ed56e6c32"
Sep 11 14:33:31.621665 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:31.621630    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:31.621754 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:31.621718    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:31.621803 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:31.621765    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:31.622045 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:31.622024    2569 generic.go:356] "Generic (PLEG): container finished" podID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerID="a436363ead26175e850d37d8df83482b79756e427b12074919007b6a16479c37" exitCode=0
Sep 11 14:33:31.622114 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:31.622077    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r" event={"ID":"65b55159-1f35-43bf-9de8-cec855b3fd31","Type":"ContainerDied","Data":"a436363ead26175e850d37d8df83482b79756e427b12074919007b6a16479c37"}
Sep 11 14:33:31.622418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:31.622403    2569 scope.go:117] "RemoveContainer" containerID="a436363ead26175e850d37d8df83482b79756e427b12074919007b6a16479c37"
Sep 11 14:33:31.623519 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:31.623489    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:31.623593 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:31.623554    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:31.623651 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:31.623601    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:32.441246 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:32.441148    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:32.646928 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:32.646419    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r" event={"ID":"65b55159-1f35-43bf-9de8-cec855b3fd31","Type":"ContainerStarted","Data":"5cab801b095d3b0c45e61ba5ecd8ddeb02c0dd1bf575b7708101d4898da2123d"}
Sep 11 14:33:32.657039 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:32.656942    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g" event={"ID":"26747395-6fe2-4a93-84d0-140148a3b107","Type":"ContainerStarted","Data":"271685454d45c42f3e468c53464f2b86bc5967f666da56329ee807a269d3a479"}
Sep 11 14:33:33.135901 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:33.135506    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:33.135901 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:33.135661    2569 patch_prober.go:28] interesting pod/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 11 14:33:33.135901 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:33.135712    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r" podUID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 11 14:33:33.161496 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:33.161454    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:33.161928 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:33.161903    2569 patch_prober.go:28] interesting pod/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 14:33:33.162115 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:33.162091    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g" podUID="26747395-6fe2-4a93-84d0-140148a3b107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 14:33:34.134215 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:34.134170    2569 patch_prober.go:28] interesting pod/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 11 14:33:34.134690 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:34.134240    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r" podUID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 11 14:33:34.160808 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:34.160758    2569 patch_prober.go:28] interesting pod/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 14:33:34.161027 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:34.160830    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g" podUID="26747395-6fe2-4a93-84d0-140148a3b107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 14:33:34.684410 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:34.684369    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr" event={"ID":"8fd35305-c1eb-444b-9283-5a6d00627071","Type":"ContainerStarted","Data":"8e0eabe97f3ff4591072c9cf0b40a95a6e7af407e06cda7c93efbb5c054359a2"}
Sep 11 14:33:35.023783 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:33:35.023740    2569 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd35305_c1eb_444b_9283_5a6d00627071.slice/crio-8e0eabe97f3ff4591072c9cf0b40a95a6e7af407e06cda7c93efbb5c054359a2.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fd35305_c1eb_444b_9283_5a6d00627071.slice/crio-conmon-8e0eabe97f3ff4591072c9cf0b40a95a6e7af407e06cda7c93efbb5c054359a2.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 14:33:35.134076 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:35.134033    2569 patch_prober.go:28] interesting pod/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 11 14:33:35.134285 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:35.134103    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r" podUID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 11 14:33:35.161695 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:35.161553    2569 patch_prober.go:28] interesting pod/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 14:33:35.161695 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:35.161622    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g" podUID="26747395-6fe2-4a93-84d0-140148a3b107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 14:33:35.693485 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:35.693267    2569 generic.go:356] "Generic (PLEG): container finished" podID="8fd35305-c1eb-444b-9283-5a6d00627071" containerID="8e0eabe97f3ff4591072c9cf0b40a95a6e7af407e06cda7c93efbb5c054359a2" exitCode=0
Sep 11 14:33:35.693485 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:35.693319    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr" event={"ID":"8fd35305-c1eb-444b-9283-5a6d00627071","Type":"ContainerDied","Data":"8e0eabe97f3ff4591072c9cf0b40a95a6e7af407e06cda7c93efbb5c054359a2"}
Sep 11 14:33:36.133940 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:36.133819    2569 patch_prober.go:28] interesting pod/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 11 14:33:36.134221 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:36.134184    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r" podUID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 11 14:33:36.160700 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:36.160664    2569 patch_prober.go:28] interesting pod/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 14:33:36.161311 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:36.161274    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g" podUID="26747395-6fe2-4a93-84d0-140148a3b107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 14:33:37.079831 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:37.079732    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr"
Sep 11 14:33:37.134900 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:37.133700    2569 patch_prober.go:28] interesting pod/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 11 14:33:37.134900 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:37.133759    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r" podUID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 11 14:33:37.160906 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:37.160697    2569 patch_prober.go:28] interesting pod/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 11 14:33:37.160906 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:37.160779    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g" podUID="26747395-6fe2-4a93-84d0-140148a3b107" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 11 14:33:37.216289 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:37.216246    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd35305-c1eb-444b-9283-5a6d00627071-maas-api-service-ca\") pod \"8fd35305-c1eb-444b-9283-5a6d00627071\" (UID: \"8fd35305-c1eb-444b-9283-5a6d00627071\") "
Sep 11 14:33:37.216913 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:37.216858    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8fd35305-c1eb-444b-9283-5a6d00627071-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8fd35305-c1eb-444b-9283-5a6d00627071" (UID: "8fd35305-c1eb-444b-9283-5a6d00627071"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:33:37.317387 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:37.317302    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8fd35305-c1eb-444b-9283-5a6d00627071-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:33:37.471364 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:37.471324    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:37.709813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:37.709778    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr" event={"ID":"8fd35305-c1eb-444b-9283-5a6d00627071","Type":"ContainerDied","Data":"3bdb027e3a19109a2e4506688623b293f8a7306394c5aee27f5b878a6a188437"}
Sep 11 14:33:37.709813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:37.709826    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3bdb027e3a19109a2e4506688623b293f8a7306394c5aee27f5b878a6a188437"
Sep 11 14:33:37.710046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:37.709834    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr"
Sep 11 14:33:38.138664 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:38.138581    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:38.139061 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:38.139007    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:38.139834 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:38.139809    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:33:38.166858 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:38.166831    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:38.168136 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:38.168117    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:33:41.732708 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:41.732672    2569 generic.go:356] "Generic (PLEG): container finished" podID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerID="80a38b78473e792fc77c71954ec1ca52990427b13af13c16431b622b21b0d16f" exitCode=0
Sep 11 14:33:41.733127 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:41.732757    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" event={"ID":"9dd79113-8d59-4e44-872c-f7692fe708a8","Type":"ContainerDied","Data":"80a38b78473e792fc77c71954ec1ca52990427b13af13c16431b622b21b0d16f"}
Sep 11 14:33:41.733288 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:41.733270    2569 scope.go:117] "RemoveContainer" containerID="80a38b78473e792fc77c71954ec1ca52990427b13af13c16431b622b21b0d16f"
Sep 11 14:33:41.734500 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:41.734473    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:41.734558 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:41.734542    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:41.734591 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:41.734573    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:33:42.743603 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:42.743561    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" event={"ID":"9dd79113-8d59-4e44-872c-f7692fe708a8","Type":"ContainerStarted","Data":"9ab47873550ef7dd7a8f6b0e0c9250a229afdf5020f7b16b8d7933fb508f40ac"}
Sep 11 14:33:43.507893 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:43.507851    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:43.595655 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:43.595616    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:43.596626 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:43.596600    2569 patch_prober.go:28] interesting pod/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 11 14:33:43.596746 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:43.596663    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 11 14:33:44.596390 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:44.596353    2569 patch_prober.go:28] interesting pod/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 11 14:33:44.596786 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:44.596405    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 11 14:33:45.596039 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:45.595999    2569 patch_prober.go:28] interesting pod/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 11 14:33:45.596221 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:45.596060    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 11 14:33:46.595691 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:46.595656    2569 patch_prober.go:28] interesting pod/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 11 14:33:46.596085 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:46.595721    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 11 14:33:47.596300 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:47.596250    2569 patch_prober.go:28] interesting pod/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 11 14:33:47.596681 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:47.596331    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 11 14:33:48.599281 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:48.599245    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:48.600155 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:48.600134    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:33:56.058514 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.058465    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"]
Sep 11 14:33:56.059039 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.058832    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8fd35305-c1eb-444b-9283-5a6d00627071" containerName="revoke-keys"
Sep 11 14:33:56.059039 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.058843    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8fd35305-c1eb-444b-9283-5a6d00627071" containerName="revoke-keys"
Sep 11 14:33:56.059039 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.058921    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8fd35305-c1eb-444b-9283-5a6d00627071" containerName="revoke-keys"
Sep 11 14:33:56.060826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.060804    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.063705 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.063670    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-a0941cbc-kserve-self-signed-certs\""
Sep 11 14:33:56.082335 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.082312    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"]
Sep 11 14:33:56.194171 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.194131    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-home\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.194345 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.194190    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-729fw\" (UniqueName: \"kubernetes.io/projected/b53b1926-303a-4466-95a0-ed036e7db973-kube-api-access-729fw\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.194345 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.194209    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-tmp-dir\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.194345 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.194330    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b53b1926-303a-4466-95a0-ed036e7db973-tls-certs\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.194451 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.194416    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-dshm\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.194496 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.194479    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-model-cache\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.295169 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.295131    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-dshm\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.295331 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.295181    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-model-cache\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.295331 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.295211    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-home\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.295331 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.295244    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-729fw\" (UniqueName: \"kubernetes.io/projected/b53b1926-303a-4466-95a0-ed036e7db973-kube-api-access-729fw\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.295331 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.295261    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-tmp-dir\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.295331 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.295294    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b53b1926-303a-4466-95a0-ed036e7db973-tls-certs\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.295650 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.295626    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-home\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.295709 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.295635    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-model-cache\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.295709 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.295671    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-tmp-dir\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.297615 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.297583    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-dshm\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.297923 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.297904    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b53b1926-303a-4466-95a0-ed036e7db973-tls-certs\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.308340 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.308316    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-729fw\" (UniqueName: \"kubernetes.io/projected/b53b1926-303a-4466-95a0-ed036e7db973-kube-api-access-729fw\") pod \"e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") " pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.371565 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.371463    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:33:56.653674 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.653649    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"]
Sep 11 14:33:56.656420 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:33:56.656393    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb53b1926_303a_4466_95a0_ed036e7db973.slice/crio-e46fef4233df1fe2a4594a433ac676f90f63824d02fa6c9067bfdaf33c9247fc WatchSource:0}: Error finding container e46fef4233df1fe2a4594a433ac676f90f63824d02fa6c9067bfdaf33c9247fc: Status 404 returned error can't find the container with id e46fef4233df1fe2a4594a433ac676f90f63824d02fa6c9067bfdaf33c9247fc
Sep 11 14:33:56.818197 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.818158    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n" event={"ID":"b53b1926-303a-4466-95a0-ed036e7db973","Type":"ContainerStarted","Data":"c5ce875c6aaaa953ca7e11a616f5a0d17fc4089b151bae3f577ba6345fe2fecb"}
Sep 11 14:33:56.818197 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.818198    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n" event={"ID":"b53b1926-303a-4466-95a0-ed036e7db973","Type":"ContainerStarted","Data":"e46fef4233df1fe2a4594a433ac676f90f63824d02fa6c9067bfdaf33c9247fc"}
Sep 11 14:33:56.855626 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:56.855574    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n" podStartSLOduration=0.85555734 podStartE2EDuration="855.55734ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:33:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:33:56.854413225 +0000 UTC m=+1133.068998885" watchObservedRunningTime="2026-09-11 14:33:56.85555734 +0000 UTC m=+1133.070143052"
Sep 11 14:33:59.833692 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:59.833653    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr"]
Sep 11 14:33:59.844012 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:33:59.843981    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ac43663d-4bskr"]
Sep 11 14:34:00.041333 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:00.041294    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"]
Sep 11 14:34:00.041582 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:00.041525    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g" podUID="26747395-6fe2-4a93-84d0-140148a3b107" containerName="istio-proxy" containerID="cri-o://271685454d45c42f3e468c53464f2b86bc5967f666da56329ee807a269d3a479" gracePeriod=30
Sep 11 14:34:00.270810 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:00.270769    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8fd35305-c1eb-444b-9283-5a6d00627071" path="/var/lib/kubelet/pods/8fd35305-c1eb-444b-9283-5a6d00627071/volumes"
Sep 11 14:34:05.290802 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.290777    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:34:05.384131 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384046    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26747395-6fe2-4a93-84d0-140148a3b107-istio-podinfo\") pod \"26747395-6fe2-4a93-84d0-140148a3b107\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") "
Sep 11 14:34:05.384131 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384091    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-istio-envoy\") pod \"26747395-6fe2-4a93-84d0-140148a3b107\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") "
Sep 11 14:34:05.384131 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384119    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-workload-certs\") pod \"26747395-6fe2-4a93-84d0-140148a3b107\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") "
Sep 11 14:34:05.384409 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384170    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-credential-socket\") pod \"26747395-6fe2-4a93-84d0-140148a3b107\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") "
Sep 11 14:34:05.384409 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384201    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gknh8\" (UniqueName: \"kubernetes.io/projected/26747395-6fe2-4a93-84d0-140148a3b107-kube-api-access-gknh8\") pod \"26747395-6fe2-4a93-84d0-140148a3b107\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") "
Sep 11 14:34:05.384409 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384222    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-istio-data\") pod \"26747395-6fe2-4a93-84d0-140148a3b107\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") "
Sep 11 14:34:05.384409 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384272    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-workload-socket\") pod \"26747395-6fe2-4a93-84d0-140148a3b107\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") "
Sep 11 14:34:05.384409 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384313    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26747395-6fe2-4a93-84d0-140148a3b107-istio-token\") pod \"26747395-6fe2-4a93-84d0-140148a3b107\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") "
Sep 11 14:34:05.384409 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384368    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26747395-6fe2-4a93-84d0-140148a3b107-istiod-ca-cert\") pod \"26747395-6fe2-4a93-84d0-140148a3b107\" (UID: \"26747395-6fe2-4a93-84d0-140148a3b107\") "
Sep 11 14:34:05.384702 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384483    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "26747395-6fe2-4a93-84d0-140148a3b107" (UID: "26747395-6fe2-4a93-84d0-140148a3b107"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:34:05.384702 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384488    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "26747395-6fe2-4a93-84d0-140148a3b107" (UID: "26747395-6fe2-4a93-84d0-140148a3b107"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:34:05.384702 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384510    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-istio-data" (OuterVolumeSpecName: "istio-data") pod "26747395-6fe2-4a93-84d0-140148a3b107" (UID: "26747395-6fe2-4a93-84d0-140148a3b107"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:34:05.384702 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384671    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "26747395-6fe2-4a93-84d0-140148a3b107" (UID: "26747395-6fe2-4a93-84d0-140148a3b107"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:34:05.384924 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384773    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26747395-6fe2-4a93-84d0-140148a3b107-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "26747395-6fe2-4a93-84d0-140148a3b107" (UID: "26747395-6fe2-4a93-84d0-140148a3b107"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:34:05.384924 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384869    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-credential-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:05.384924 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384915    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-istio-data\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:05.385081 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384929    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-workload-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:05.385081 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384941    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26747395-6fe2-4a93-84d0-140148a3b107-istiod-ca-cert\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:05.385081 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.384954    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-workload-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:05.386683 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.386661    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26747395-6fe2-4a93-84d0-140148a3b107-istio-token" (OuterVolumeSpecName: "istio-token") pod "26747395-6fe2-4a93-84d0-140148a3b107" (UID: "26747395-6fe2-4a93-84d0-140148a3b107"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:34:05.386764 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.386746    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "26747395-6fe2-4a93-84d0-140148a3b107" (UID: "26747395-6fe2-4a93-84d0-140148a3b107"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:34:05.386855 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.386834    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26747395-6fe2-4a93-84d0-140148a3b107-kube-api-access-gknh8" (OuterVolumeSpecName: "kube-api-access-gknh8") pod "26747395-6fe2-4a93-84d0-140148a3b107" (UID: "26747395-6fe2-4a93-84d0-140148a3b107"). InnerVolumeSpecName "kube-api-access-gknh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:34:05.386913 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.386845    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26747395-6fe2-4a93-84d0-140148a3b107-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "26747395-6fe2-4a93-84d0-140148a3b107" (UID: "26747395-6fe2-4a93-84d0-140148a3b107"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 14:34:05.486264 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.486228    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26747395-6fe2-4a93-84d0-140148a3b107-istio-envoy\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:05.486264 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.486259    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gknh8\" (UniqueName: \"kubernetes.io/projected/26747395-6fe2-4a93-84d0-140148a3b107-kube-api-access-gknh8\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:05.486264 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.486270    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26747395-6fe2-4a93-84d0-140148a3b107-istio-token\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:05.486497 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.486279    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26747395-6fe2-4a93-84d0-140148a3b107-istio-podinfo\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:05.871189 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.871140    2569 generic.go:356] "Generic (PLEG): container finished" podID="26747395-6fe2-4a93-84d0-140148a3b107" containerID="271685454d45c42f3e468c53464f2b86bc5967f666da56329ee807a269d3a479" exitCode=0
Sep 11 14:34:05.871354 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.871191    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g" event={"ID":"26747395-6fe2-4a93-84d0-140148a3b107","Type":"ContainerDied","Data":"271685454d45c42f3e468c53464f2b86bc5967f666da56329ee807a269d3a479"}
Sep 11 14:34:05.871354 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.871205    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"
Sep 11 14:34:05.871354 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.871275    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g" event={"ID":"26747395-6fe2-4a93-84d0-140148a3b107","Type":"ContainerDied","Data":"64f3bdd3294b3183300bfaed84b899aa96406fbb9ac95bad2f90fe16caa1c645"}
Sep 11 14:34:05.871354 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.871305    2569 scope.go:117] "RemoveContainer" containerID="271685454d45c42f3e468c53464f2b86bc5967f666da56329ee807a269d3a479"
Sep 11 14:34:05.881396 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.881378    2569 scope.go:117] "RemoveContainer" containerID="8c6c2ee4e14c5ec4b82204f1af6680e3a0d2d12de99e29727ea58b5ed56e6c32"
Sep 11 14:34:05.891371 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.891348    2569 scope.go:117] "RemoveContainer" containerID="271685454d45c42f3e468c53464f2b86bc5967f666da56329ee807a269d3a479"
Sep 11 14:34:05.891844 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:34:05.891823    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"271685454d45c42f3e468c53464f2b86bc5967f666da56329ee807a269d3a479\": container with ID starting with 271685454d45c42f3e468c53464f2b86bc5967f666da56329ee807a269d3a479 not found: ID does not exist" containerID="271685454d45c42f3e468c53464f2b86bc5967f666da56329ee807a269d3a479"
Sep 11 14:34:05.891938 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.891853    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271685454d45c42f3e468c53464f2b86bc5967f666da56329ee807a269d3a479"} err="failed to get container status \"271685454d45c42f3e468c53464f2b86bc5967f666da56329ee807a269d3a479\": rpc error: code = NotFound desc = could not find container \"271685454d45c42f3e468c53464f2b86bc5967f666da56329ee807a269d3a479\": container with ID starting with 271685454d45c42f3e468c53464f2b86bc5967f666da56329ee807a269d3a479 not found: ID does not exist"
Sep 11 14:34:05.891938 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.891913    2569 scope.go:117] "RemoveContainer" containerID="8c6c2ee4e14c5ec4b82204f1af6680e3a0d2d12de99e29727ea58b5ed56e6c32"
Sep 11 14:34:05.892187 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:34:05.892166    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c6c2ee4e14c5ec4b82204f1af6680e3a0d2d12de99e29727ea58b5ed56e6c32\": container with ID starting with 8c6c2ee4e14c5ec4b82204f1af6680e3a0d2d12de99e29727ea58b5ed56e6c32 not found: ID does not exist" containerID="8c6c2ee4e14c5ec4b82204f1af6680e3a0d2d12de99e29727ea58b5ed56e6c32"
Sep 11 14:34:05.892236 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.892196    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c6c2ee4e14c5ec4b82204f1af6680e3a0d2d12de99e29727ea58b5ed56e6c32"} err="failed to get container status \"8c6c2ee4e14c5ec4b82204f1af6680e3a0d2d12de99e29727ea58b5ed56e6c32\": rpc error: code = NotFound desc = could not find container \"8c6c2ee4e14c5ec4b82204f1af6680e3a0d2d12de99e29727ea58b5ed56e6c32\": container with ID starting with 8c6c2ee4e14c5ec4b82204f1af6680e3a0d2d12de99e29727ea58b5ed56e6c32 not found: ID does not exist"
Sep 11 14:34:05.965592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:05.965551    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:34:06.008438 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:06.008400    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"]
Sep 11 14:34:06.053432 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:06.053391    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ac43663d-openshift-default-86764c76d4-zfm5g"]
Sep 11 14:34:06.270430 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:06.270395    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26747395-6fe2-4a93-84d0-140148a3b107" path="/var/lib/kubelet/pods/26747395-6fe2-4a93-84d0-140148a3b107/volumes"
Sep 11 14:34:06.372251 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:06.372213    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:34:06.372251 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:06.372257    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:34:06.385161 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:06.385133    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:34:06.889319 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:06.889287    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:34:12.572166 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.572128    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"]
Sep 11 14:34:12.572559 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.572474    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26747395-6fe2-4a93-84d0-140148a3b107" containerName="istio-proxy"
Sep 11 14:34:12.572559 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.572484    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="26747395-6fe2-4a93-84d0-140148a3b107" containerName="istio-proxy"
Sep 11 14:34:12.572559 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.572557    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="26747395-6fe2-4a93-84d0-140148a3b107" containerName="istio-proxy"
Sep 11 14:34:12.572677 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.572563    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="26747395-6fe2-4a93-84d0-140148a3b107" containerName="istio-proxy"
Sep 11 14:34:12.578322 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.578303    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"
Sep 11 14:34:12.583861 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.583841    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-d7531909\""
Sep 11 14:34:12.584514 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.584494    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-d7531909-dockercfg-rbn7n\""
Sep 11 14:34:12.611789 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.611763    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"]
Sep 11 14:34:12.657997 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.657964    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxfv4\" (UniqueName: \"kubernetes.io/projected/bd98281a-330a-4686-8cb5-fd4da2b4b3c6-kube-api-access-sxfv4\") pod \"payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf\" (UID: \"bd98281a-330a-4686-8cb5-fd4da2b4b3c6\") " pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"
Sep 11 14:34:12.657997 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.657997    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd98281a-330a-4686-8cb5-fd4da2b4b3c6-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf\" (UID: \"bd98281a-330a-4686-8cb5-fd4da2b4b3c6\") " pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"
Sep 11 14:34:12.758646 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.758609    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxfv4\" (UniqueName: \"kubernetes.io/projected/bd98281a-330a-4686-8cb5-fd4da2b4b3c6-kube-api-access-sxfv4\") pod \"payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf\" (UID: \"bd98281a-330a-4686-8cb5-fd4da2b4b3c6\") " pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"
Sep 11 14:34:12.758646 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.758649    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd98281a-330a-4686-8cb5-fd4da2b4b3c6-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf\" (UID: \"bd98281a-330a-4686-8cb5-fd4da2b4b3c6\") " pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"
Sep 11 14:34:12.759393 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.759373    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd98281a-330a-4686-8cb5-fd4da2b4b3c6-plugins-config-volume\") pod \"payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf\" (UID: \"bd98281a-330a-4686-8cb5-fd4da2b4b3c6\") " pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"
Sep 11 14:34:12.776996 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.776971    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxfv4\" (UniqueName: \"kubernetes.io/projected/bd98281a-330a-4686-8cb5-fd4da2b4b3c6-kube-api-access-sxfv4\") pod \"payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf\" (UID: \"bd98281a-330a-4686-8cb5-fd4da2b4b3c6\") " pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"
Sep 11 14:34:12.888577 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:12.888489    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"
Sep 11 14:34:13.176422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:13.176397    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"]
Sep 11 14:34:13.177925 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:34:13.177894    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd98281a_330a_4686_8cb5_fd4da2b4b3c6.slice/crio-f9eccb50bc8bc55771fedd331caa7be82f6f67671f82aee70988c4af3b964742 WatchSource:0}: Error finding container f9eccb50bc8bc55771fedd331caa7be82f6f67671f82aee70988c4af3b964742: Status 404 returned error can't find the container with id f9eccb50bc8bc55771fedd331caa7be82f6f67671f82aee70988c4af3b964742
Sep 11 14:34:13.915723 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:13.915672    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf" event={"ID":"bd98281a-330a-4686-8cb5-fd4da2b4b3c6","Type":"ContainerStarted","Data":"f9eccb50bc8bc55771fedd331caa7be82f6f67671f82aee70988c4af3b964742"}
Sep 11 14:34:15.931627 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:15.931592    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf" event={"ID":"bd98281a-330a-4686-8cb5-fd4da2b4b3c6","Type":"ContainerStarted","Data":"b2074c07824a766cd6893238522e5f30e2d39c34b09c3ca6e5e28af93faaec6a"}
Sep 11 14:34:15.932045 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:15.931707    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"
Sep 11 14:34:16.033221 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:16.033164    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf" podStartSLOduration=2.170529953 podStartE2EDuration="4.033146022s" totalImagesPullingTime="1.862616069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:34:16.030523055 +0000 UTC m=+1152.245108718" watchObservedRunningTime="2026-09-11 14:34:16.033146022 +0000 UTC m=+1152.247731707"
Sep 11 14:34:22.065594 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.065560    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2"]
Sep 11 14:34:22.065997 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.065919    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26747395-6fe2-4a93-84d0-140148a3b107" containerName="istio-proxy"
Sep 11 14:34:22.065997 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.065931    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="26747395-6fe2-4a93-84d0-140148a3b107" containerName="istio-proxy"
Sep 11 14:34:22.075127 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.075102    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2"
Sep 11 14:34:22.227573 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.227545    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:34:22.227750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.227611    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:34:22.229455 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.229434    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2"]
Sep 11 14:34:22.248284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.248258    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/666ec9c1-a7b0-4340-ab52-eff0e8aea3b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2\" (UID: \"666ec9c1-a7b0-4340-ab52-eff0e8aea3b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2"
Sep 11 14:34:22.349482 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.349407    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/666ec9c1-a7b0-4340-ab52-eff0e8aea3b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2\" (UID: \"666ec9c1-a7b0-4340-ab52-eff0e8aea3b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2"
Sep 11 14:34:22.350041 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.350023    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/666ec9c1-a7b0-4340-ab52-eff0e8aea3b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2\" (UID: \"666ec9c1-a7b0-4340-ab52-eff0e8aea3b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2"
Sep 11 14:34:22.385027 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.385007    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2"
Sep 11 14:34:22.679773 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.679697    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2"]
Sep 11 14:34:22.682136 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:34:22.682109    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666ec9c1_a7b0_4340_ab52_eff0e8aea3b4.slice/crio-32c7bac13bb9c44b33447bd61b6b24b3662a33ba9a719afad2e37f5482c1c3e8 WatchSource:0}: Error finding container 32c7bac13bb9c44b33447bd61b6b24b3662a33ba9a719afad2e37f5482c1c3e8: Status 404 returned error can't find the container with id 32c7bac13bb9c44b33447bd61b6b24b3662a33ba9a719afad2e37f5482c1c3e8
Sep 11 14:34:22.969680 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.969642    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2" event={"ID":"666ec9c1-a7b0-4340-ab52-eff0e8aea3b4","Type":"ContainerStarted","Data":"5e9f6bee0daa4421f51a305e04081d76013336e5db3f7a7f230e7d0b886cff6e"}
Sep 11 14:34:22.969785 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:22.969698    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2" event={"ID":"666ec9c1-a7b0-4340-ab52-eff0e8aea3b4","Type":"ContainerStarted","Data":"32c7bac13bb9c44b33447bd61b6b24b3662a33ba9a719afad2e37f5482c1c3e8"}
Sep 11 14:34:23.014181 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:23.014140    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2" podStartSLOduration=1.014123801 podStartE2EDuration="1.014123801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:34:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:34:23.013179674 +0000 UTC m=+1159.227765334" watchObservedRunningTime="2026-09-11 14:34:23.014123801 +0000 UTC m=+1159.228709461"
Sep 11 14:34:23.976477 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:23.976438    2569 generic.go:356] "Generic (PLEG): container finished" podID="666ec9c1-a7b0-4340-ab52-eff0e8aea3b4" containerID="5e9f6bee0daa4421f51a305e04081d76013336e5db3f7a7f230e7d0b886cff6e" exitCode=0
Sep 11 14:34:23.976863 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:23.976518    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2" event={"ID":"666ec9c1-a7b0-4340-ab52-eff0e8aea3b4","Type":"ContainerDied","Data":"5e9f6bee0daa4421f51a305e04081d76013336e5db3f7a7f230e7d0b886cff6e"}
Sep 11 14:34:25.119004 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:25.118973    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2"
Sep 11 14:34:25.175594 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:25.175564    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/666ec9c1-a7b0-4340-ab52-eff0e8aea3b4-maas-api-service-ca\") pod \"666ec9c1-a7b0-4340-ab52-eff0e8aea3b4\" (UID: \"666ec9c1-a7b0-4340-ab52-eff0e8aea3b4\") "
Sep 11 14:34:25.175972 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:25.175952    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/666ec9c1-a7b0-4340-ab52-eff0e8aea3b4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "666ec9c1-a7b0-4340-ab52-eff0e8aea3b4" (UID: "666ec9c1-a7b0-4340-ab52-eff0e8aea3b4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:34:25.276541 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:25.276451    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/666ec9c1-a7b0-4340-ab52-eff0e8aea3b4-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:25.987857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:25.987827    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2"
Sep 11 14:34:25.987857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:25.987841    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2" event={"ID":"666ec9c1-a7b0-4340-ab52-eff0e8aea3b4","Type":"ContainerDied","Data":"32c7bac13bb9c44b33447bd61b6b24b3662a33ba9a719afad2e37f5482c1c3e8"}
Sep 11 14:34:25.988084 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:25.987912    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32c7bac13bb9c44b33447bd61b6b24b3662a33ba9a719afad2e37f5482c1c3e8"
Sep 11 14:34:26.939917 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:26.939867    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"
Sep 11 14:34:29.849065 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:29.849027    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:34:31.522687 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.522655    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"]
Sep 11 14:34:31.523120 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.523073    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="666ec9c1-a7b0-4340-ab52-eff0e8aea3b4" containerName="revoke-keys"
Sep 11 14:34:31.523120 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.523085    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="666ec9c1-a7b0-4340-ab52-eff0e8aea3b4" containerName="revoke-keys"
Sep 11 14:34:31.523192 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.523149    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="666ec9c1-a7b0-4340-ab52-eff0e8aea3b4" containerName="revoke-keys"
Sep 11 14:34:31.526091 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.526075    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.548991 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.548968    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d4444b\"/\"kube-root-ca.crt\""
Sep 11 14:34:31.549143 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.548968    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-d4444b\"/\"openshift-service-ca.crt\""
Sep 11 14:34:31.550046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.550019    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d4444b\"/\"test-model-d4444b-kserve-self-signed-certs\""
Sep 11 14:34:31.557700 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.557679    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-d4444b\"/\"default-dockercfg-966hw\""
Sep 11 14:34:31.601641 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.601610    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"]
Sep 11 14:34:31.636938 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.636909    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-model-cache\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.637050 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.636952    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41f8d2ed-fe68-4896-90fc-79de7a899a29-tls-certs\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.637101 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.637044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xjgz\" (UniqueName: \"kubernetes.io/projected/41f8d2ed-fe68-4896-90fc-79de7a899a29-kube-api-access-7xjgz\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.637134 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.637104    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-dshm\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.637185 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.637169    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-home\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.637234 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.637220    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-tmp-dir\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.738437 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.738389    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-home\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.738607 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.738466    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-tmp-dir\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.738607 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.738543    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-model-cache\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.738607 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.738582    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41f8d2ed-fe68-4896-90fc-79de7a899a29-tls-certs\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.738758 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.738733    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xjgz\" (UniqueName: \"kubernetes.io/projected/41f8d2ed-fe68-4896-90fc-79de7a899a29-kube-api-access-7xjgz\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.738810 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.738800    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-dshm\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.738988 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.738963    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-home\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.739090 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.739038    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-model-cache\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.739209 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.739189    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-tmp-dir\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.741641 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.741602    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-dshm\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.742013 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.741991    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41f8d2ed-fe68-4896-90fc-79de7a899a29-tls-certs\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.750733 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.750706    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xjgz\" (UniqueName: \"kubernetes.io/projected/41f8d2ed-fe68-4896-90fc-79de7a899a29-kube-api-access-7xjgz\") pod \"test-model-d4444b-kserve-fdc45fbdf-ghhdq\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") " pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:31.834925 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:31.834824    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:32.146144 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:32.146117    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"]
Sep 11 14:34:32.148792 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:34:32.148750    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod41f8d2ed_fe68_4896_90fc_79de7a899a29.slice/crio-3216f753b15efd08cf7ed4566c4728c1a57db81234887c979aead2736fe147b1 WatchSource:0}: Error finding container 3216f753b15efd08cf7ed4566c4728c1a57db81234887c979aead2736fe147b1: Status 404 returned error can't find the container with id 3216f753b15efd08cf7ed4566c4728c1a57db81234887c979aead2736fe147b1
Sep 11 14:34:33.024768 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.024734    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq" event={"ID":"41f8d2ed-fe68-4896-90fc-79de7a899a29","Type":"ContainerStarted","Data":"ae588c1dc03a2fb884ce8c5e0db80a13887b109d4448e143b54f33642fa02f14"}
Sep 11 14:34:33.025160 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.024781    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq" event={"ID":"41f8d2ed-fe68-4896-90fc-79de7a899a29","Type":"ContainerStarted","Data":"3216f753b15efd08cf7ed4566c4728c1a57db81234887c979aead2736fe147b1"}
Sep 11 14:34:33.054715 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.054670    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq" podStartSLOduration=2.05465476 podStartE2EDuration="2.05465476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:34:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:34:33.053365821 +0000 UTC m=+1169.267951482" watchObservedRunningTime="2026-09-11 14:34:33.05465476 +0000 UTC m=+1169.269240422"
Sep 11 14:34:33.314821 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.314743    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"]
Sep 11 14:34:33.315002 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.314971    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf" podUID="bd98281a-330a-4686-8cb5-fd4da2b4b3c6" containerName="payload-processing" containerID="cri-o://b2074c07824a766cd6893238522e5f30e2d39c34b09c3ca6e5e28af93faaec6a" gracePeriod=30
Sep 11 14:34:33.579292 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.579234    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"
Sep 11 14:34:33.621709 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.621671    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2"]
Sep 11 14:34:33.625667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.625645    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d7531909-5hnd2"]
Sep 11 14:34:33.658475 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.658449    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxfv4\" (UniqueName: \"kubernetes.io/projected/bd98281a-330a-4686-8cb5-fd4da2b4b3c6-kube-api-access-sxfv4\") pod \"bd98281a-330a-4686-8cb5-fd4da2b4b3c6\" (UID: \"bd98281a-330a-4686-8cb5-fd4da2b4b3c6\") "
Sep 11 14:34:33.658585 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.658521    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd98281a-330a-4686-8cb5-fd4da2b4b3c6-plugins-config-volume\") pod \"bd98281a-330a-4686-8cb5-fd4da2b4b3c6\" (UID: \"bd98281a-330a-4686-8cb5-fd4da2b4b3c6\") "
Sep 11 14:34:33.658919 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.658863    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd98281a-330a-4686-8cb5-fd4da2b4b3c6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bd98281a-330a-4686-8cb5-fd4da2b4b3c6" (UID: "bd98281a-330a-4686-8cb5-fd4da2b4b3c6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:34:33.660777 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.660758    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd98281a-330a-4686-8cb5-fd4da2b4b3c6-kube-api-access-sxfv4" (OuterVolumeSpecName: "kube-api-access-sxfv4") pod "bd98281a-330a-4686-8cb5-fd4da2b4b3c6" (UID: "bd98281a-330a-4686-8cb5-fd4da2b4b3c6"). InnerVolumeSpecName "kube-api-access-sxfv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:34:33.759642 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.759609    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bd98281a-330a-4686-8cb5-fd4da2b4b3c6-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:33.759642 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:33.759641    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxfv4\" (UniqueName: \"kubernetes.io/projected/bd98281a-330a-4686-8cb5-fd4da2b4b3c6-kube-api-access-sxfv4\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:34.032197 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.032164    2569 generic.go:356] "Generic (PLEG): container finished" podID="bd98281a-330a-4686-8cb5-fd4da2b4b3c6" containerID="b2074c07824a766cd6893238522e5f30e2d39c34b09c3ca6e5e28af93faaec6a" exitCode=0
Sep 11 14:34:34.032673 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.032208    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"
Sep 11 14:34:34.032673 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.032252    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf" event={"ID":"bd98281a-330a-4686-8cb5-fd4da2b4b3c6","Type":"ContainerDied","Data":"b2074c07824a766cd6893238522e5f30e2d39c34b09c3ca6e5e28af93faaec6a"}
Sep 11 14:34:34.032673 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.032313    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf" event={"ID":"bd98281a-330a-4686-8cb5-fd4da2b4b3c6","Type":"ContainerDied","Data":"f9eccb50bc8bc55771fedd331caa7be82f6f67671f82aee70988c4af3b964742"}
Sep 11 14:34:34.032673 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.032347    2569 scope.go:117] "RemoveContainer" containerID="b2074c07824a766cd6893238522e5f30e2d39c34b09c3ca6e5e28af93faaec6a"
Sep 11 14:34:34.041414 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.041398    2569 scope.go:117] "RemoveContainer" containerID="b2074c07824a766cd6893238522e5f30e2d39c34b09c3ca6e5e28af93faaec6a"
Sep 11 14:34:34.041686 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:34:34.041663    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2074c07824a766cd6893238522e5f30e2d39c34b09c3ca6e5e28af93faaec6a\": container with ID starting with b2074c07824a766cd6893238522e5f30e2d39c34b09c3ca6e5e28af93faaec6a not found: ID does not exist" containerID="b2074c07824a766cd6893238522e5f30e2d39c34b09c3ca6e5e28af93faaec6a"
Sep 11 14:34:34.041780 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.041733    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2074c07824a766cd6893238522e5f30e2d39c34b09c3ca6e5e28af93faaec6a"} err="failed to get container status \"b2074c07824a766cd6893238522e5f30e2d39c34b09c3ca6e5e28af93faaec6a\": rpc error: code = NotFound desc = could not find container \"b2074c07824a766cd6893238522e5f30e2d39c34b09c3ca6e5e28af93faaec6a\": container with ID starting with b2074c07824a766cd6893238522e5f30e2d39c34b09c3ca6e5e28af93faaec6a not found: ID does not exist"
Sep 11 14:34:34.054505 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.054480    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"]
Sep 11 14:34:34.063726 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.063694    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-d7531909-8cd857946-bw7rf"]
Sep 11 14:34:34.270408 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.270378    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="666ec9c1-a7b0-4340-ab52-eff0e8aea3b4" path="/var/lib/kubelet/pods/666ec9c1-a7b0-4340-ab52-eff0e8aea3b4/volumes"
Sep 11 14:34:34.270727 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.270714    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd98281a-330a-4686-8cb5-fd4da2b4b3c6" path="/var/lib/kubelet/pods/bd98281a-330a-4686-8cb5-fd4da2b4b3c6/volumes"
Sep 11 14:34:34.679180 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.679148    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"]
Sep 11 14:34:34.679540 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.679526    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd98281a-330a-4686-8cb5-fd4da2b4b3c6" containerName="payload-processing"
Sep 11 14:34:34.679608 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.679541    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd98281a-330a-4686-8cb5-fd4da2b4b3c6" containerName="payload-processing"
Sep 11 14:34:34.679654 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.679610    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd98281a-330a-4686-8cb5-fd4da2b4b3c6" containerName="payload-processing"
Sep 11 14:34:34.683984 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.683968    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.686960 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.686938    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c9e2e6b4-openshift-default-dockercfg-cwksc\""
Sep 11 14:34:34.714790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.714768    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"]
Sep 11 14:34:34.769667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.768963    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-envoy\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.769667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.769007    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-token\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.769667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.769053    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-credential-socket\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.769667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.769094    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-podinfo\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.769667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.769130    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-workload-certs\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.769667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.769188    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-workload-socket\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.769667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.769238    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d81cec1-945d-4f24-84b6-b7211edf2efe-istiod-ca-cert\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.769667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.769303    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrlxw\" (UniqueName: \"kubernetes.io/projected/8d81cec1-945d-4f24-84b6-b7211edf2efe-kube-api-access-jrlxw\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.769667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.769331    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-data\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.828297 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.828264    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"]
Sep 11 14:34:34.870188 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.870156    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-credential-socket\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.870357 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.870199    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-podinfo\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.870465 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.870443    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-workload-certs\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.870525 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.870504    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-workload-socket\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.870676 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.870547    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-credential-socket\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.870676 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.870558    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d81cec1-945d-4f24-84b6-b7211edf2efe-istiod-ca-cert\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.870676 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.870652    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrlxw\" (UniqueName: \"kubernetes.io/projected/8d81cec1-945d-4f24-84b6-b7211edf2efe-kube-api-access-jrlxw\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.870826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.870686    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-data\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.870826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.870753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-envoy\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.870826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.870767    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-workload-certs\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.870826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.870779    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-token\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.870826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.870790    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-workload-socket\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.871155 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.871131    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-data\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.871444 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.871420    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d81cec1-945d-4f24-84b6-b7211edf2efe-istiod-ca-cert\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.872939 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.872921    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-podinfo\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.873261 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.873243    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-envoy\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.885566 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.885534    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrlxw\" (UniqueName: \"kubernetes.io/projected/8d81cec1-945d-4f24-84b6-b7211edf2efe-kube-api-access-jrlxw\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.885665 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.885637    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-token\") pod \"e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") " pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:34.994551 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:34.994462    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:35.294119 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:35.294094    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"]
Sep 11 14:34:35.296062 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:34:35.296036    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d81cec1_945d_4f24_84b6_b7211edf2efe.slice/crio-fae5333cb3c02622378bbdb757d8820cd523ff15a0f8e42e762a298b1f699354 WatchSource:0}: Error finding container fae5333cb3c02622378bbdb757d8820cd523ff15a0f8e42e762a298b1f699354: Status 404 returned error can't find the container with id fae5333cb3c02622378bbdb757d8820cd523ff15a0f8e42e762a298b1f699354
Sep 11 14:34:35.298414 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:35.298383    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:34:35.298483 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:35.298447    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:34:35.298483 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:35.298474    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:34:36.052923 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:36.052865    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" event={"ID":"8d81cec1-945d-4f24-84b6-b7211edf2efe","Type":"ContainerStarted","Data":"3acf57c4ebbba0d381d3c6931f0bba36f49dc6578e064f7bd1d2a08368099ddc"}
Sep 11 14:34:36.053164 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:36.052945    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" event={"ID":"8d81cec1-945d-4f24-84b6-b7211edf2efe","Type":"ContainerStarted","Data":"fae5333cb3c02622378bbdb757d8820cd523ff15a0f8e42e762a298b1f699354"}
Sep 11 14:34:36.118151 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:36.118101    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" podStartSLOduration=2.118083926 podStartE2EDuration="2.118083926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:34:36.117541253 +0000 UTC m=+1172.332126927" watchObservedRunningTime="2026-09-11 14:34:36.118083926 +0000 UTC m=+1172.332669586"
Sep 11 14:34:36.995193 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:36.995162    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:37.000368 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:37.000346    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:37.057649 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:37.057614    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:37.058593 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:37.058568    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:37.900390 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:37.900354    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h"]
Sep 11 14:34:37.903745 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:37.903728    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h"
Sep 11 14:34:37.908166 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:37.908142    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:34:37.908963 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:37.908947    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:34:37.996807 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:37.996777    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h"]
Sep 11 14:34:37.999087 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:37.999065    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c72fa0-3e02-47c2-8c56-a02dcf700da3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-c322a2-krv8h\" (UID: \"74c72fa0-3e02-47c2-8c56-a02dcf700da3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h"
Sep 11 14:34:38.100162 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:38.100121    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c72fa0-3e02-47c2-8c56-a02dcf700da3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-c322a2-krv8h\" (UID: \"74c72fa0-3e02-47c2-8c56-a02dcf700da3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h"
Sep 11 14:34:38.100826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:38.100802    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c72fa0-3e02-47c2-8c56-a02dcf700da3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-c322a2-krv8h\" (UID: \"74c72fa0-3e02-47c2-8c56-a02dcf700da3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h"
Sep 11 14:34:38.215079 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:38.215043    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h"
Sep 11 14:34:38.540836 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:38.540751    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h"]
Sep 11 14:34:38.555899 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:34:38.546708    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c72fa0_3e02_47c2_8c56_a02dcf700da3.slice/crio-2a5887030c3fc4b3796fdfde28330e72c39cf59253e62016ff2c4b1c72767b9d WatchSource:0}: Error finding container 2a5887030c3fc4b3796fdfde28330e72c39cf59253e62016ff2c4b1c72767b9d: Status 404 returned error can't find the container with id 2a5887030c3fc4b3796fdfde28330e72c39cf59253e62016ff2c4b1c72767b9d
Sep 11 14:34:38.950887 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:38.950841    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"]
Sep 11 14:34:39.068517 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:39.068472    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h" event={"ID":"74c72fa0-3e02-47c2-8c56-a02dcf700da3","Type":"ContainerStarted","Data":"45ddf19229d94d53c6349a12aca4ae9992cb3d9cf30b56c6b785fd2eb9d021c3"}
Sep 11 14:34:39.068976 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:39.068537    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h" event={"ID":"74c72fa0-3e02-47c2-8c56-a02dcf700da3","Type":"ContainerStarted","Data":"2a5887030c3fc4b3796fdfde28330e72c39cf59253e62016ff2c4b1c72767b9d"}
Sep 11 14:34:40.074893 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:40.074844    2569 generic.go:356] "Generic (PLEG): container finished" podID="74c72fa0-3e02-47c2-8c56-a02dcf700da3" containerID="45ddf19229d94d53c6349a12aca4ae9992cb3d9cf30b56c6b785fd2eb9d021c3" exitCode=0
Sep 11 14:34:40.075309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:40.074934    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h" event={"ID":"74c72fa0-3e02-47c2-8c56-a02dcf700da3","Type":"ContainerDied","Data":"45ddf19229d94d53c6349a12aca4ae9992cb3d9cf30b56c6b785fd2eb9d021c3"}
Sep 11 14:34:41.221301 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:41.221277    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h"
Sep 11 14:34:41.334485 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:41.333404    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c72fa0-3e02-47c2-8c56-a02dcf700da3-maas-api-service-ca\") pod \"74c72fa0-3e02-47c2-8c56-a02dcf700da3\" (UID: \"74c72fa0-3e02-47c2-8c56-a02dcf700da3\") "
Sep 11 14:34:41.334485 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:41.334019    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74c72fa0-3e02-47c2-8c56-a02dcf700da3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "74c72fa0-3e02-47c2-8c56-a02dcf700da3" (UID: "74c72fa0-3e02-47c2-8c56-a02dcf700da3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:34:41.334894 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:41.334817    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c72fa0-3e02-47c2-8c56-a02dcf700da3-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:41.835295 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:41.835256    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:41.835462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:41.835312    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:41.848105 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:41.848078    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:42.088394 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:42.088314    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h"
Sep 11 14:34:42.088394 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:42.088347    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h" event={"ID":"74c72fa0-3e02-47c2-8c56-a02dcf700da3","Type":"ContainerDied","Data":"2a5887030c3fc4b3796fdfde28330e72c39cf59253e62016ff2c4b1c72767b9d"}
Sep 11 14:34:42.088394 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:42.088397    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2a5887030c3fc4b3796fdfde28330e72c39cf59253e62016ff2c4b1c72767b9d"
Sep 11 14:34:42.100314 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:42.100295    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:34:46.086155 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:46.086111    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:34:49.753062 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:49.753014    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h"]
Sep 11 14:34:49.760926 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:49.760896    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-c322a2-krv8h"]
Sep 11 14:34:49.852341 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:49.852298    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n" podUID="b53b1926-303a-4466-95a0-ed036e7db973" containerName="main" containerID="cri-o://c5ce875c6aaaa953ca7e11a616f5a0d17fc4089b151bae3f577ba6345fe2fecb" gracePeriod=45
Sep 11 14:34:50.115358 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.115332    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:34:50.157025 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.156988    2569 generic.go:356] "Generic (PLEG): container finished" podID="b53b1926-303a-4466-95a0-ed036e7db973" containerID="c5ce875c6aaaa953ca7e11a616f5a0d17fc4089b151bae3f577ba6345fe2fecb" exitCode=0
Sep 11 14:34:50.157220 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.157066    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"
Sep 11 14:34:50.157220 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.157083    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n" event={"ID":"b53b1926-303a-4466-95a0-ed036e7db973","Type":"ContainerDied","Data":"c5ce875c6aaaa953ca7e11a616f5a0d17fc4089b151bae3f577ba6345fe2fecb"}
Sep 11 14:34:50.157220 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.157132    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n" event={"ID":"b53b1926-303a-4466-95a0-ed036e7db973","Type":"ContainerDied","Data":"e46fef4233df1fe2a4594a433ac676f90f63824d02fa6c9067bfdaf33c9247fc"}
Sep 11 14:34:50.157220 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.157155    2569 scope.go:117] "RemoveContainer" containerID="c5ce875c6aaaa953ca7e11a616f5a0d17fc4089b151bae3f577ba6345fe2fecb"
Sep 11 14:34:50.167440 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.167420    2569 scope.go:117] "RemoveContainer" containerID="c5ce875c6aaaa953ca7e11a616f5a0d17fc4089b151bae3f577ba6345fe2fecb"
Sep 11 14:34:50.167739 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:34:50.167720    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5ce875c6aaaa953ca7e11a616f5a0d17fc4089b151bae3f577ba6345fe2fecb\": container with ID starting with c5ce875c6aaaa953ca7e11a616f5a0d17fc4089b151bae3f577ba6345fe2fecb not found: ID does not exist" containerID="c5ce875c6aaaa953ca7e11a616f5a0d17fc4089b151bae3f577ba6345fe2fecb"
Sep 11 14:34:50.167819 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.167745    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ce875c6aaaa953ca7e11a616f5a0d17fc4089b151bae3f577ba6345fe2fecb"} err="failed to get container status \"c5ce875c6aaaa953ca7e11a616f5a0d17fc4089b151bae3f577ba6345fe2fecb\": rpc error: code = NotFound desc = could not find container \"c5ce875c6aaaa953ca7e11a616f5a0d17fc4089b151bae3f577ba6345fe2fecb\": container with ID starting with c5ce875c6aaaa953ca7e11a616f5a0d17fc4089b151bae3f577ba6345fe2fecb not found: ID does not exist"
Sep 11 14:34:50.222575 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.222541    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-729fw\" (UniqueName: \"kubernetes.io/projected/b53b1926-303a-4466-95a0-ed036e7db973-kube-api-access-729fw\") pod \"b53b1926-303a-4466-95a0-ed036e7db973\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") "
Sep 11 14:34:50.222750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.222641    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-model-cache\") pod \"b53b1926-303a-4466-95a0-ed036e7db973\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") "
Sep 11 14:34:50.222750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.222685    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-tmp-dir\") pod \"b53b1926-303a-4466-95a0-ed036e7db973\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") "
Sep 11 14:34:50.222750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.222727    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-home\") pod \"b53b1926-303a-4466-95a0-ed036e7db973\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") "
Sep 11 14:34:50.222951 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.222772    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-dshm\") pod \"b53b1926-303a-4466-95a0-ed036e7db973\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") "
Sep 11 14:34:50.222951 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.222801    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b53b1926-303a-4466-95a0-ed036e7db973-tls-certs\") pod \"b53b1926-303a-4466-95a0-ed036e7db973\" (UID: \"b53b1926-303a-4466-95a0-ed036e7db973\") "
Sep 11 14:34:50.223063 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.222961    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-model-cache" (OuterVolumeSpecName: "model-cache") pod "b53b1926-303a-4466-95a0-ed036e7db973" (UID: "b53b1926-303a-4466-95a0-ed036e7db973"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:34:50.223063 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.223032    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-home" (OuterVolumeSpecName: "home") pod "b53b1926-303a-4466-95a0-ed036e7db973" (UID: "b53b1926-303a-4466-95a0-ed036e7db973"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:34:50.223242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.223200    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-model-cache\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:50.223242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.223224    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-home\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:50.223347 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.223283    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b53b1926-303a-4466-95a0-ed036e7db973" (UID: "b53b1926-303a-4466-95a0-ed036e7db973"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:34:50.225043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.225006    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-dshm" (OuterVolumeSpecName: "dshm") pod "b53b1926-303a-4466-95a0-ed036e7db973" (UID: "b53b1926-303a-4466-95a0-ed036e7db973"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:34:50.225143 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.225072    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b53b1926-303a-4466-95a0-ed036e7db973-kube-api-access-729fw" (OuterVolumeSpecName: "kube-api-access-729fw") pod "b53b1926-303a-4466-95a0-ed036e7db973" (UID: "b53b1926-303a-4466-95a0-ed036e7db973"). InnerVolumeSpecName "kube-api-access-729fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:34:50.225193 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.225164    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b53b1926-303a-4466-95a0-ed036e7db973-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b53b1926-303a-4466-95a0-ed036e7db973" (UID: "b53b1926-303a-4466-95a0-ed036e7db973"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:34:50.270592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.270407    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74c72fa0-3e02-47c2-8c56-a02dcf700da3" path="/var/lib/kubelet/pods/74c72fa0-3e02-47c2-8c56-a02dcf700da3/volumes"
Sep 11 14:34:50.324906 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.324797    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-729fw\" (UniqueName: \"kubernetes.io/projected/b53b1926-303a-4466-95a0-ed036e7db973-kube-api-access-729fw\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:50.324906 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.324836    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-tmp-dir\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:50.324906 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.324851    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b53b1926-303a-4466-95a0-ed036e7db973-dshm\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:50.324906 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.324862    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b53b1926-303a-4466-95a0-ed036e7db973-tls-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:50.490244 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.490206    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"]
Sep 11 14:34:50.508010 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:50.507984    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-a0941cbc-kserve-fb468b4bb-d2m4n"]
Sep 11 14:34:52.270115 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:52.270086    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b53b1926-303a-4466-95a0-ed036e7db973" path="/var/lib/kubelet/pods/b53b1926-303a-4466-95a0-ed036e7db973/volumes"
Sep 11 14:34:53.970273 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:53.970217    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk" podUID="59fbfeb3-2caa-494c-ab07-cbaa69b361ae" containerName="main" containerID="cri-o://0a526bf15a3c6a20a21204169fb63bba4e30cade6fc616308308f6d616ae3aaf" gracePeriod=45
Sep 11 14:34:54.181787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.181735    2569 generic.go:356] "Generic (PLEG): container finished" podID="59fbfeb3-2caa-494c-ab07-cbaa69b361ae" containerID="0a526bf15a3c6a20a21204169fb63bba4e30cade6fc616308308f6d616ae3aaf" exitCode=0
Sep 11 14:34:54.181787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.181779    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk" event={"ID":"59fbfeb3-2caa-494c-ab07-cbaa69b361ae","Type":"ContainerDied","Data":"0a526bf15a3c6a20a21204169fb63bba4e30cade6fc616308308f6d616ae3aaf"}
Sep 11 14:34:54.237885 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.237835    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:34:54.369889 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.369849    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-tls-certs\") pod \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") "
Sep 11 14:34:54.370084 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.369930    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s28wc\" (UniqueName: \"kubernetes.io/projected/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-kube-api-access-s28wc\") pod \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") "
Sep 11 14:34:54.370084 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.369983    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-model-cache\") pod \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") "
Sep 11 14:34:54.370084 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.370025    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-home\") pod \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") "
Sep 11 14:34:54.370084 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.370052    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-tmp-dir\") pod \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") "
Sep 11 14:34:54.370320 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.370094    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-dshm\") pod \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\" (UID: \"59fbfeb3-2caa-494c-ab07-cbaa69b361ae\") "
Sep 11 14:34:54.370378 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.370316    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-model-cache" (OuterVolumeSpecName: "model-cache") pod "59fbfeb3-2caa-494c-ab07-cbaa69b361ae" (UID: "59fbfeb3-2caa-494c-ab07-cbaa69b361ae"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:34:54.370378 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.370323    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "59fbfeb3-2caa-494c-ab07-cbaa69b361ae" (UID: "59fbfeb3-2caa-494c-ab07-cbaa69b361ae"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:34:54.370859 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.370571    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-home" (OuterVolumeSpecName: "home") pod "59fbfeb3-2caa-494c-ab07-cbaa69b361ae" (UID: "59fbfeb3-2caa-494c-ab07-cbaa69b361ae"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:34:54.370859 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.370622    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-model-cache\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:54.370859 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.370772    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-tmp-dir\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:54.372288 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.372259    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-kube-api-access-s28wc" (OuterVolumeSpecName: "kube-api-access-s28wc") pod "59fbfeb3-2caa-494c-ab07-cbaa69b361ae" (UID: "59fbfeb3-2caa-494c-ab07-cbaa69b361ae"). InnerVolumeSpecName "kube-api-access-s28wc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:34:54.372381 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.372357    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "59fbfeb3-2caa-494c-ab07-cbaa69b361ae" (UID: "59fbfeb3-2caa-494c-ab07-cbaa69b361ae"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:34:54.372827 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.372808    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-dshm" (OuterVolumeSpecName: "dshm") pod "59fbfeb3-2caa-494c-ab07-cbaa69b361ae" (UID: "59fbfeb3-2caa-494c-ab07-cbaa69b361ae"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:34:54.472226 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.472155    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-tls-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:54.472226 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.472180    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s28wc\" (UniqueName: \"kubernetes.io/projected/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-kube-api-access-s28wc\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:54.472226 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.472188    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-home\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:54.472226 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:54.472196    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59fbfeb3-2caa-494c-ab07-cbaa69b361ae-dshm\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:34:55.188635 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:55.188596    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk" event={"ID":"59fbfeb3-2caa-494c-ab07-cbaa69b361ae","Type":"ContainerDied","Data":"4715c9c3d3dc4d959b47e18995fd9c9b15bf62622287129cb4c84cfb8c2d519b"}
Sep 11 14:34:55.189109 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:55.188639    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"
Sep 11 14:34:55.189109 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:55.188659    2569 scope.go:117] "RemoveContainer" containerID="0a526bf15a3c6a20a21204169fb63bba4e30cade6fc616308308f6d616ae3aaf"
Sep 11 14:34:55.221440 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:55.221414    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"]
Sep 11 14:34:55.226514 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:55.226489    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-a0941cbc-kserve-69f7446596-7jhqk"]
Sep 11 14:34:56.197735 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:56.197658    2569 generic.go:356] "Generic (PLEG): container finished" podID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerID="3acf57c4ebbba0d381d3c6931f0bba36f49dc6578e064f7bd1d2a08368099ddc" exitCode=0
Sep 11 14:34:56.198152 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:56.197732    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" event={"ID":"8d81cec1-945d-4f24-84b6-b7211edf2efe","Type":"ContainerDied","Data":"3acf57c4ebbba0d381d3c6931f0bba36f49dc6578e064f7bd1d2a08368099ddc"}
Sep 11 14:34:56.198202 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:56.198163    2569 scope.go:117] "RemoveContainer" containerID="3acf57c4ebbba0d381d3c6931f0bba36f49dc6578e064f7bd1d2a08368099ddc"
Sep 11 14:34:56.199215 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:56.199187    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:34:56.199277 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:56.199255    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:34:56.199314 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:56.199287    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:34:56.274527 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:56.274152    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59fbfeb3-2caa-494c-ab07-cbaa69b361ae" path="/var/lib/kubelet/pods/59fbfeb3-2caa-494c-ab07-cbaa69b361ae/volumes"
Sep 11 14:34:57.205636 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:57.205601    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" event={"ID":"8d81cec1-945d-4f24-84b6-b7211edf2efe","Type":"ContainerStarted","Data":"1fc20264413ab17cc68533661a4ab7876f73e384837d4c218f29212fc873912f"}
Sep 11 14:34:57.995149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:57.995114    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:34:57.995322 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:57.995298    2569 patch_prober.go:28] interesting pod/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 14:34:57.995373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:57.995351    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 14:34:58.995740 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:58.995703    2569 patch_prober.go:28] interesting pod/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 14:34:58.996171 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:58.995761    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 14:34:59.251039 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:59.250931    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"]
Sep 11 14:34:59.251528 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:59.251495    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r" podUID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerName="istio-proxy" containerID="cri-o://5cab801b095d3b0c45e61ba5ecd8ddeb02c0dd1bf575b7708101d4898da2123d" gracePeriod=30
Sep 11 14:34:59.995341 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:59.995305    2569 patch_prober.go:28] interesting pod/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 14:34:59.995574 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:34:59.995365    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 14:35:00.995706 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:00.995667    2569 patch_prober.go:28] interesting pod/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 14:35:00.996132 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:00.995726    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 14:35:01.995168 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:01.995131    2569 patch_prober.go:28] interesting pod/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 11 14:35:01.995358 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:01.995204    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 11 14:35:02.999622 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:02.999588    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:35:03.000045 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:02.999978    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:35:03.000720 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:03.000703    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:35:03.626243 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:03.626207    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:35:04.257834 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.257804    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:35:04.261523 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.261492    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:35:04.527389 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.527365    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:35:04.676131 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.676093    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-envoy\") pod \"65b55159-1f35-43bf-9de8-cec855b3fd31\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") "
Sep 11 14:35:04.676288 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.676145    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-credential-socket\") pod \"65b55159-1f35-43bf-9de8-cec855b3fd31\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") "
Sep 11 14:35:04.676288 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.676221    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-workload-socket\") pod \"65b55159-1f35-43bf-9de8-cec855b3fd31\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") "
Sep 11 14:35:04.676288 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.676247    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65b55159-1f35-43bf-9de8-cec855b3fd31-istiod-ca-cert\") pod \"65b55159-1f35-43bf-9de8-cec855b3fd31\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") "
Sep 11 14:35:04.676448 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.676287    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-podinfo\") pod \"65b55159-1f35-43bf-9de8-cec855b3fd31\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") "
Sep 11 14:35:04.676448 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.676363    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-workload-certs\") pod \"65b55159-1f35-43bf-9de8-cec855b3fd31\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") "
Sep 11 14:35:04.676448 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.676390    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnzcc\" (UniqueName: \"kubernetes.io/projected/65b55159-1f35-43bf-9de8-cec855b3fd31-kube-api-access-lnzcc\") pod \"65b55159-1f35-43bf-9de8-cec855b3fd31\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") "
Sep 11 14:35:04.676448 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.676423    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65b55159-1f35-43bf-9de8-cec855b3fd31" (UID: "65b55159-1f35-43bf-9de8-cec855b3fd31"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:04.676644 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.676440    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65b55159-1f35-43bf-9de8-cec855b3fd31" (UID: "65b55159-1f35-43bf-9de8-cec855b3fd31"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:04.676644 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.676467    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-token\") pod \"65b55159-1f35-43bf-9de8-cec855b3fd31\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") "
Sep 11 14:35:04.676746 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.676648    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65b55159-1f35-43bf-9de8-cec855b3fd31" (UID: "65b55159-1f35-43bf-9de8-cec855b3fd31"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:04.676746 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.676731    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b55159-1f35-43bf-9de8-cec855b3fd31-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65b55159-1f35-43bf-9de8-cec855b3fd31" (UID: "65b55159-1f35-43bf-9de8-cec855b3fd31"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:35:04.676862 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.676822    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-data\") pod \"65b55159-1f35-43bf-9de8-cec855b3fd31\" (UID: \"65b55159-1f35-43bf-9de8-cec855b3fd31\") "
Sep 11 14:35:04.677165 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.677143    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-credential-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:04.677364 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.677222    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-workload-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:04.677364 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.677237    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65b55159-1f35-43bf-9de8-cec855b3fd31-istiod-ca-cert\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:04.677364 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.677249    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-workload-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:04.677364 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.677324    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-data" (OuterVolumeSpecName: "istio-data") pod "65b55159-1f35-43bf-9de8-cec855b3fd31" (UID: "65b55159-1f35-43bf-9de8-cec855b3fd31"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:04.678703 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.678680    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-token" (OuterVolumeSpecName: "istio-token") pod "65b55159-1f35-43bf-9de8-cec855b3fd31" (UID: "65b55159-1f35-43bf-9de8-cec855b3fd31"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:35:04.679134 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.679105    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65b55159-1f35-43bf-9de8-cec855b3fd31" (UID: "65b55159-1f35-43bf-9de8-cec855b3fd31"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:04.679134 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.679108    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b55159-1f35-43bf-9de8-cec855b3fd31-kube-api-access-lnzcc" (OuterVolumeSpecName: "kube-api-access-lnzcc") pod "65b55159-1f35-43bf-9de8-cec855b3fd31" (UID: "65b55159-1f35-43bf-9de8-cec855b3fd31"). InnerVolumeSpecName "kube-api-access-lnzcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:35:04.679429 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.679192    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65b55159-1f35-43bf-9de8-cec855b3fd31" (UID: "65b55159-1f35-43bf-9de8-cec855b3fd31"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 14:35:04.778762 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.778591    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnzcc\" (UniqueName: \"kubernetes.io/projected/65b55159-1f35-43bf-9de8-cec855b3fd31-kube-api-access-lnzcc\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:04.778762 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.778626    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-token\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:04.778762 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.778642    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-data\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:04.778762 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.778654    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-envoy\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:04.778762 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:04.778669    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65b55159-1f35-43bf-9de8-cec855b3fd31-istio-podinfo\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:05.250020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:05.249983    2569 generic.go:356] "Generic (PLEG): container finished" podID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerID="5cab801b095d3b0c45e61ba5ecd8ddeb02c0dd1bf575b7708101d4898da2123d" exitCode=0
Sep 11 14:35:05.250192 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:05.250027    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r" event={"ID":"65b55159-1f35-43bf-9de8-cec855b3fd31","Type":"ContainerDied","Data":"5cab801b095d3b0c45e61ba5ecd8ddeb02c0dd1bf575b7708101d4898da2123d"}
Sep 11 14:35:05.250192 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:05.250064    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r" event={"ID":"65b55159-1f35-43bf-9de8-cec855b3fd31","Type":"ContainerDied","Data":"6ad4f7387a85f1c9c7725f4c5acc48e97afacc4603bf28cf57ee3d1baff5a9e4"}
Sep 11 14:35:05.250192 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:05.250084    2569 scope.go:117] "RemoveContainer" containerID="5cab801b095d3b0c45e61ba5ecd8ddeb02c0dd1bf575b7708101d4898da2123d"
Sep 11 14:35:05.250192 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:05.250029    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"
Sep 11 14:35:05.259658 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:05.259639    2569 scope.go:117] "RemoveContainer" containerID="a436363ead26175e850d37d8df83482b79756e427b12074919007b6a16479c37"
Sep 11 14:35:05.267803 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:05.267785    2569 scope.go:117] "RemoveContainer" containerID="5cab801b095d3b0c45e61ba5ecd8ddeb02c0dd1bf575b7708101d4898da2123d"
Sep 11 14:35:05.268059 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:35:05.268040    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cab801b095d3b0c45e61ba5ecd8ddeb02c0dd1bf575b7708101d4898da2123d\": container with ID starting with 5cab801b095d3b0c45e61ba5ecd8ddeb02c0dd1bf575b7708101d4898da2123d not found: ID does not exist" containerID="5cab801b095d3b0c45e61ba5ecd8ddeb02c0dd1bf575b7708101d4898da2123d"
Sep 11 14:35:05.268116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:05.268071    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cab801b095d3b0c45e61ba5ecd8ddeb02c0dd1bf575b7708101d4898da2123d"} err="failed to get container status \"5cab801b095d3b0c45e61ba5ecd8ddeb02c0dd1bf575b7708101d4898da2123d\": rpc error: code = NotFound desc = could not find container \"5cab801b095d3b0c45e61ba5ecd8ddeb02c0dd1bf575b7708101d4898da2123d\": container with ID starting with 5cab801b095d3b0c45e61ba5ecd8ddeb02c0dd1bf575b7708101d4898da2123d not found: ID does not exist"
Sep 11 14:35:05.268116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:05.268087    2569 scope.go:117] "RemoveContainer" containerID="a436363ead26175e850d37d8df83482b79756e427b12074919007b6a16479c37"
Sep 11 14:35:05.268367 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:35:05.268348    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a436363ead26175e850d37d8df83482b79756e427b12074919007b6a16479c37\": container with ID starting with a436363ead26175e850d37d8df83482b79756e427b12074919007b6a16479c37 not found: ID does not exist" containerID="a436363ead26175e850d37d8df83482b79756e427b12074919007b6a16479c37"
Sep 11 14:35:05.268422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:05.268372    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a436363ead26175e850d37d8df83482b79756e427b12074919007b6a16479c37"} err="failed to get container status \"a436363ead26175e850d37d8df83482b79756e427b12074919007b6a16479c37\": rpc error: code = NotFound desc = could not find container \"a436363ead26175e850d37d8df83482b79756e427b12074919007b6a16479c37\": container with ID starting with a436363ead26175e850d37d8df83482b79756e427b12074919007b6a16479c37 not found: ID does not exist"
Sep 11 14:35:05.278553 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:05.278532    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"]
Sep 11 14:35:05.282426 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:05.282401    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-c322a2-openshift-default-5d594cfc48-t2w6r"]
Sep 11 14:35:06.269643 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.269611    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65b55159-1f35-43bf-9de8-cec855b3fd31" path="/var/lib/kubelet/pods/65b55159-1f35-43bf-9de8-cec855b3fd31/volumes"
Sep 11 14:35:06.949402 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949371    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"]
Sep 11 14:35:06.949711 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949699    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59fbfeb3-2caa-494c-ab07-cbaa69b361ae" containerName="main"
Sep 11 14:35:06.949756 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949713    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="59fbfeb3-2caa-494c-ab07-cbaa69b361ae" containerName="main"
Sep 11 14:35:06.949756 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949723    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c72fa0-3e02-47c2-8c56-a02dcf700da3" containerName="revoke-keys"
Sep 11 14:35:06.949756 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949728    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c72fa0-3e02-47c2-8c56-a02dcf700da3" containerName="revoke-keys"
Sep 11 14:35:06.949756 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949741    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerName="istio-proxy"
Sep 11 14:35:06.949756 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949746    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerName="istio-proxy"
Sep 11 14:35:06.949756 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949755    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerName="istio-proxy"
Sep 11 14:35:06.949970 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949760    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerName="istio-proxy"
Sep 11 14:35:06.949970 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949772    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b53b1926-303a-4466-95a0-ed036e7db973" containerName="main"
Sep 11 14:35:06.949970 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949777    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b53b1926-303a-4466-95a0-ed036e7db973" containerName="main"
Sep 11 14:35:06.949970 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949831    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="59fbfeb3-2caa-494c-ab07-cbaa69b361ae" containerName="main"
Sep 11 14:35:06.949970 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949839    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerName="istio-proxy"
Sep 11 14:35:06.949970 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949844    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b53b1926-303a-4466-95a0-ed036e7db973" containerName="main"
Sep 11 14:35:06.949970 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949851    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="74c72fa0-3e02-47c2-8c56-a02dcf700da3" containerName="revoke-keys"
Sep 11 14:35:06.949970 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.949857    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="65b55159-1f35-43bf-9de8-cec855b3fd31" containerName="istio-proxy"
Sep 11 14:35:06.954278 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.954260    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"
Sep 11 14:35:06.957640 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.957610    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-69a7cf\""
Sep 11 14:35:06.958074 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.958055    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-69a7cf-dockercfg-6tr9m\""
Sep 11 14:35:06.969479 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.969438    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"]
Sep 11 14:35:06.994762 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.994735    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7khhp\" (UniqueName: \"kubernetes.io/projected/3a79774d-ea46-4d7b-aff6-0797c6c9a8cb-kube-api-access-7khhp\") pod \"payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55\" (UID: \"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"
Sep 11 14:35:06.994919 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:06.994800    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a79774d-ea46-4d7b-aff6-0797c6c9a8cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55\" (UID: \"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"
Sep 11 14:35:07.044737 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.044703    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"]
Sep 11 14:35:07.049646 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.049619    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"
Sep 11 14:35:07.067780 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.067747    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"]
Sep 11 14:35:07.095470 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.095436    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkk78\" (UniqueName: \"kubernetes.io/projected/88cdf3ea-32d6-47fe-a4e8-98541376da8b-kube-api-access-nkk78\") pod \"payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm\" (UID: \"88cdf3ea-32d6-47fe-a4e8-98541376da8b\") " pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"
Sep 11 14:35:07.095678 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.095493    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khhp\" (UniqueName: \"kubernetes.io/projected/3a79774d-ea46-4d7b-aff6-0797c6c9a8cb-kube-api-access-7khhp\") pod \"payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55\" (UID: \"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"
Sep 11 14:35:07.095678 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.095567    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a79774d-ea46-4d7b-aff6-0797c6c9a8cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55\" (UID: \"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"
Sep 11 14:35:07.095678 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.095614    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88cdf3ea-32d6-47fe-a4e8-98541376da8b-plugins-config-volume\") pod \"payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm\" (UID: \"88cdf3ea-32d6-47fe-a4e8-98541376da8b\") " pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"
Sep 11 14:35:07.096305 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.096288    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a79774d-ea46-4d7b-aff6-0797c6c9a8cb-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55\" (UID: \"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"
Sep 11 14:35:07.113338 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.113315    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7khhp\" (UniqueName: \"kubernetes.io/projected/3a79774d-ea46-4d7b-aff6-0797c6c9a8cb-kube-api-access-7khhp\") pod \"payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55\" (UID: \"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"
Sep 11 14:35:07.196624 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.196586    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkk78\" (UniqueName: \"kubernetes.io/projected/88cdf3ea-32d6-47fe-a4e8-98541376da8b-kube-api-access-nkk78\") pod \"payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm\" (UID: \"88cdf3ea-32d6-47fe-a4e8-98541376da8b\") " pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"
Sep 11 14:35:07.196811 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.196677    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88cdf3ea-32d6-47fe-a4e8-98541376da8b-plugins-config-volume\") pod \"payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm\" (UID: \"88cdf3ea-32d6-47fe-a4e8-98541376da8b\") " pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"
Sep 11 14:35:07.197421 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.197395    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88cdf3ea-32d6-47fe-a4e8-98541376da8b-plugins-config-volume\") pod \"payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm\" (UID: \"88cdf3ea-32d6-47fe-a4e8-98541376da8b\") " pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"
Sep 11 14:35:07.214294 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.214219    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkk78\" (UniqueName: \"kubernetes.io/projected/88cdf3ea-32d6-47fe-a4e8-98541376da8b-kube-api-access-nkk78\") pod \"payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm\" (UID: \"88cdf3ea-32d6-47fe-a4e8-98541376da8b\") " pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"
Sep 11 14:35:07.265381 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.265355    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"
Sep 11 14:35:07.362434 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.362398    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"
Sep 11 14:35:07.551192 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.551162    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"]
Sep 11 14:35:07.553511 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:35:07.553483    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a79774d_ea46_4d7b_aff6_0797c6c9a8cb.slice/crio-f51b53399617ac844c8dae23d5762c55e1012058ed991bbac74217dafaaed1e1 WatchSource:0}: Error finding container f51b53399617ac844c8dae23d5762c55e1012058ed991bbac74217dafaaed1e1: Status 404 returned error can't find the container with id f51b53399617ac844c8dae23d5762c55e1012058ed991bbac74217dafaaed1e1
Sep 11 14:35:07.655244 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:07.655202    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"]
Sep 11 14:35:07.659017 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:35:07.658977    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88cdf3ea_32d6_47fe_a4e8_98541376da8b.slice/crio-78c57c9e27302e43476e0ce91ff35de44c422b36f3c593bdec0b0949da65d208 WatchSource:0}: Error finding container 78c57c9e27302e43476e0ce91ff35de44c422b36f3c593bdec0b0949da65d208: Status 404 returned error can't find the container with id 78c57c9e27302e43476e0ce91ff35de44c422b36f3c593bdec0b0949da65d208
Sep 11 14:35:08.270997 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:08.270964    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm" event={"ID":"88cdf3ea-32d6-47fe-a4e8-98541376da8b","Type":"ContainerStarted","Data":"71e131e9fb52d951a14cc12c4255d9ab9fb989a407c66c0550e24f7ad03ba56a"}
Sep 11 14:35:08.271172 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:08.271019    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm" event={"ID":"88cdf3ea-32d6-47fe-a4e8-98541376da8b","Type":"ContainerStarted","Data":"78c57c9e27302e43476e0ce91ff35de44c422b36f3c593bdec0b0949da65d208"}
Sep 11 14:35:08.271172 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:08.271046    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"
Sep 11 14:35:08.271172 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:08.271061    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"
Sep 11 14:35:08.271172 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:08.271078    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55" event={"ID":"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb","Type":"ContainerStarted","Data":"a6e9a97b6fae0dc0da316e6e9f0ba64f75ee445601b42b5a250719cf3b9f4b2b"}
Sep 11 14:35:08.271172 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:08.271099    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55" event={"ID":"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb","Type":"ContainerStarted","Data":"f51b53399617ac844c8dae23d5762c55e1012058ed991bbac74217dafaaed1e1"}
Sep 11 14:35:08.322268 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:08.322218    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55" podStartSLOduration=2.322202572 podStartE2EDuration="2.322202572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:35:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:35:08.320537594 +0000 UTC m=+1204.535123258" watchObservedRunningTime="2026-09-11 14:35:08.322202572 +0000 UTC m=+1204.536788224"
Sep 11 14:35:08.322842 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:08.322821    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm" podStartSLOduration=1.322814992 podStartE2EDuration="1.322814992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:35:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:35:08.294094001 +0000 UTC m=+1204.508679661" watchObservedRunningTime="2026-09-11 14:35:08.322814992 +0000 UTC m=+1204.537400705"
Sep 11 14:35:14.211333 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:14.211301    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"]
Sep 11 14:35:14.211763 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:14.211509    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerName="istio-proxy" containerID="cri-o://1fc20264413ab17cc68533661a4ab7876f73e384837d4c218f29212fc873912f" gracePeriod=30
Sep 11 14:35:18.002323 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:18.002277    2569 patch_prober.go:28] interesting pod/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 14:35:18.002704 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:18.002354    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 14:35:19.277335 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.277311    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"
Sep 11 14:35:19.277688 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.277589    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"
Sep 11 14:35:19.347175 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.347138    2569 generic.go:356] "Generic (PLEG): container finished" podID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerID="1fc20264413ab17cc68533661a4ab7876f73e384837d4c218f29212fc873912f" exitCode=0
Sep 11 14:35:19.347357 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.347192    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" event={"ID":"8d81cec1-945d-4f24-84b6-b7211edf2efe","Type":"ContainerDied","Data":"1fc20264413ab17cc68533661a4ab7876f73e384837d4c218f29212fc873912f"}
Sep 11 14:35:19.347357 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.347240    2569 scope.go:117] "RemoveContainer" containerID="3acf57c4ebbba0d381d3c6931f0bba36f49dc6578e064f7bd1d2a08368099ddc"
Sep 11 14:35:19.459182 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.459154    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:35:19.513934 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.513839    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-workload-certs\") pod \"8d81cec1-945d-4f24-84b6-b7211edf2efe\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") "
Sep 11 14:35:19.513934 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.513889    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-token\") pod \"8d81cec1-945d-4f24-84b6-b7211edf2efe\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") "
Sep 11 14:35:19.513934 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.513924    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-data\") pod \"8d81cec1-945d-4f24-84b6-b7211edf2efe\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") "
Sep 11 14:35:19.514206 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.513955    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-podinfo\") pod \"8d81cec1-945d-4f24-84b6-b7211edf2efe\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") "
Sep 11 14:35:19.514206 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.513988    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jrlxw\" (UniqueName: \"kubernetes.io/projected/8d81cec1-945d-4f24-84b6-b7211edf2efe-kube-api-access-jrlxw\") pod \"8d81cec1-945d-4f24-84b6-b7211edf2efe\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") "
Sep 11 14:35:19.514206 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.514022    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-credential-socket\") pod \"8d81cec1-945d-4f24-84b6-b7211edf2efe\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") "
Sep 11 14:35:19.514206 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.514089    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-workload-socket\") pod \"8d81cec1-945d-4f24-84b6-b7211edf2efe\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") "
Sep 11 14:35:19.514206 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.514118    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-envoy\") pod \"8d81cec1-945d-4f24-84b6-b7211edf2efe\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") "
Sep 11 14:35:19.514206 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.514150    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d81cec1-945d-4f24-84b6-b7211edf2efe-istiod-ca-cert\") pod \"8d81cec1-945d-4f24-84b6-b7211edf2efe\" (UID: \"8d81cec1-945d-4f24-84b6-b7211edf2efe\") "
Sep 11 14:35:19.514206 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.514142    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8d81cec1-945d-4f24-84b6-b7211edf2efe" (UID: "8d81cec1-945d-4f24-84b6-b7211edf2efe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:19.514578 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.514228    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-data" (OuterVolumeSpecName: "istio-data") pod "8d81cec1-945d-4f24-84b6-b7211edf2efe" (UID: "8d81cec1-945d-4f24-84b6-b7211edf2efe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:19.514578 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.514393    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8d81cec1-945d-4f24-84b6-b7211edf2efe" (UID: "8d81cec1-945d-4f24-84b6-b7211edf2efe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:19.514578 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.514497    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-workload-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:19.514578 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.514512    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-workload-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:19.514578 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.514521    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-data\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:19.514820 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.514604    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8d81cec1-945d-4f24-84b6-b7211edf2efe" (UID: "8d81cec1-945d-4f24-84b6-b7211edf2efe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:19.514820 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.514618    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d81cec1-945d-4f24-84b6-b7211edf2efe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8d81cec1-945d-4f24-84b6-b7211edf2efe" (UID: "8d81cec1-945d-4f24-84b6-b7211edf2efe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:35:19.516553 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.516519    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8d81cec1-945d-4f24-84b6-b7211edf2efe" (UID: "8d81cec1-945d-4f24-84b6-b7211edf2efe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:35:19.516762 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.516742    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-token" (OuterVolumeSpecName: "istio-token") pod "8d81cec1-945d-4f24-84b6-b7211edf2efe" (UID: "8d81cec1-945d-4f24-84b6-b7211edf2efe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:35:19.517007 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.516984    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8d81cec1-945d-4f24-84b6-b7211edf2efe" (UID: "8d81cec1-945d-4f24-84b6-b7211edf2efe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 14:35:19.517079 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.516999    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d81cec1-945d-4f24-84b6-b7211edf2efe-kube-api-access-jrlxw" (OuterVolumeSpecName: "kube-api-access-jrlxw") pod "8d81cec1-945d-4f24-84b6-b7211edf2efe" (UID: "8d81cec1-945d-4f24-84b6-b7211edf2efe"). InnerVolumeSpecName "kube-api-access-jrlxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:35:19.615116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.615085    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-podinfo\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:19.615116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.615110    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jrlxw\" (UniqueName: \"kubernetes.io/projected/8d81cec1-945d-4f24-84b6-b7211edf2efe-kube-api-access-jrlxw\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:19.615116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.615120    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-credential-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:19.615324 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.615128    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-envoy\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:19.615324 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.615137    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8d81cec1-945d-4f24-84b6-b7211edf2efe-istiod-ca-cert\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:19.615324 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:19.615144    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8d81cec1-945d-4f24-84b6-b7211edf2efe-istio-token\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:20.354843 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:20.354809    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw" event={"ID":"8d81cec1-945d-4f24-84b6-b7211edf2efe","Type":"ContainerDied","Data":"fae5333cb3c02622378bbdb757d8820cd523ff15a0f8e42e762a298b1f699354"}
Sep 11 14:35:20.354843 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:20.354841    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"
Sep 11 14:35:20.355352 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:20.354868    2569 scope.go:117] "RemoveContainer" containerID="1fc20264413ab17cc68533661a4ab7876f73e384837d4c218f29212fc873912f"
Sep 11 14:35:20.455781 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:20.455752    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"]
Sep 11 14:35:20.457531 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:20.457504    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c9e2e6b4-openshift-default-6bdf95b964-62lqw"]
Sep 11 14:35:22.270170 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:22.270135    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" path="/var/lib/kubelet/pods/8d81cec1-945d-4f24-84b6-b7211edf2efe/volumes"
Sep 11 14:35:23.249851 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.249815    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"]
Sep 11 14:35:23.250199 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.250188    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerName="istio-proxy"
Sep 11 14:35:23.250247 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.250201    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerName="istio-proxy"
Sep 11 14:35:23.250247 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.250217    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerName="istio-proxy"
Sep 11 14:35:23.250247 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.250222    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerName="istio-proxy"
Sep 11 14:35:23.250342 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.250276    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerName="istio-proxy"
Sep 11 14:35:23.250342 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.250285    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d81cec1-945d-4f24-84b6-b7211edf2efe" containerName="istio-proxy"
Sep 11 14:35:23.259551 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.259517    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"
Sep 11 14:35:23.270059 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.270033    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-15594dcc\""
Sep 11 14:35:23.271526 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.271506    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-15594dcc-dockercfg-6vr2v\""
Sep 11 14:35:23.280186 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.280166    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"]
Sep 11 14:35:23.348657 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.348627    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vp44\" (UniqueName: \"kubernetes.io/projected/d8d2e1be-642e-41e9-af04-967a5e727683-kube-api-access-2vp44\") pod \"payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4\" (UID: \"d8d2e1be-642e-41e9-af04-967a5e727683\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"
Sep 11 14:35:23.348823 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.348709    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d2e1be-642e-41e9-af04-967a5e727683-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4\" (UID: \"d8d2e1be-642e-41e9-af04-967a5e727683\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"
Sep 11 14:35:23.450198 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.450160    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d2e1be-642e-41e9-af04-967a5e727683-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4\" (UID: \"d8d2e1be-642e-41e9-af04-967a5e727683\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"
Sep 11 14:35:23.450371 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.450279    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vp44\" (UniqueName: \"kubernetes.io/projected/d8d2e1be-642e-41e9-af04-967a5e727683-kube-api-access-2vp44\") pod \"payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4\" (UID: \"d8d2e1be-642e-41e9-af04-967a5e727683\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"
Sep 11 14:35:23.450917 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.450898    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d2e1be-642e-41e9-af04-967a5e727683-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4\" (UID: \"d8d2e1be-642e-41e9-af04-967a5e727683\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"
Sep 11 14:35:23.469540 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.469508    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vp44\" (UniqueName: \"kubernetes.io/projected/d8d2e1be-642e-41e9-af04-967a5e727683-kube-api-access-2vp44\") pod \"payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4\" (UID: \"d8d2e1be-642e-41e9-af04-967a5e727683\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"
Sep 11 14:35:23.572180 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.572095    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"
Sep 11 14:35:23.897206 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:23.897182    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"]
Sep 11 14:35:23.899868 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:35:23.899838    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d2e1be_642e_41e9_af04_967a5e727683.slice/crio-f8ca42ab87c773c9f11b364ed9bf3c1914e2312cb2a272ff057c2185250b5c0c WatchSource:0}: Error finding container f8ca42ab87c773c9f11b364ed9bf3c1914e2312cb2a272ff057c2185250b5c0c: Status 404 returned error can't find the container with id f8ca42ab87c773c9f11b364ed9bf3c1914e2312cb2a272ff057c2185250b5c0c
Sep 11 14:35:24.378156 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:24.378118    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4" event={"ID":"d8d2e1be-642e-41e9-af04-967a5e727683","Type":"ContainerStarted","Data":"a215c70c17449b6dc9e322e95d9470c1ac75e1831c82e46e3648293143a29985"}
Sep 11 14:35:24.378559 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:24.378175    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4" event={"ID":"d8d2e1be-642e-41e9-af04-967a5e727683","Type":"ContainerStarted","Data":"f8ca42ab87c773c9f11b364ed9bf3c1914e2312cb2a272ff057c2185250b5c0c"}
Sep 11 14:35:24.378559 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:24.378222    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"
Sep 11 14:35:25.617969 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:25.617905    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4" podStartSLOduration=2.617859418 podStartE2EDuration="2.617859418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:35:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:35:24.521470209 +0000 UTC m=+1220.736055870" watchObservedRunningTime="2026-09-11 14:35:25.617859418 +0000 UTC m=+1221.832445078"
Sep 11 14:35:25.619781 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:25.619754    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:35:32.635588 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:32.635554    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb"]
Sep 11 14:35:32.638774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:32.638758    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb"
Sep 11 14:35:32.641705 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:32.641684    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:35:32.641835 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:32.641684    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:35:32.662472 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:32.662448    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb"]
Sep 11 14:35:32.733443 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:32.733404    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-15594dcc-brfxb\" (UID: \"7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb"
Sep 11 14:35:32.834595 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:32.834556    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-15594dcc-brfxb\" (UID: \"7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb"
Sep 11 14:35:32.835209 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:32.835189    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-15594dcc-brfxb\" (UID: \"7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb"
Sep 11 14:35:32.948174 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:32.948145    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb"
Sep 11 14:35:33.233972 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:33.233949    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb"]
Sep 11 14:35:33.235283 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:35:33.235247    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b1a5ea5_0b2c_49d3_99d6_798a9c1387fe.slice/crio-9de3cf9f01000862a8f8e43a5f811f04ae98e129abc9f03b4d3a8d97ef283a47 WatchSource:0}: Error finding container 9de3cf9f01000862a8f8e43a5f811f04ae98e129abc9f03b4d3a8d97ef283a47: Status 404 returned error can't find the container with id 9de3cf9f01000862a8f8e43a5f811f04ae98e129abc9f03b4d3a8d97ef283a47
Sep 11 14:35:33.424938 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:33.424907    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb" event={"ID":"7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe","Type":"ContainerStarted","Data":"9de3cf9f01000862a8f8e43a5f811f04ae98e129abc9f03b4d3a8d97ef283a47"}
Sep 11 14:35:34.431567 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:34.431536    2569 generic.go:356] "Generic (PLEG): container finished" podID="7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe" containerID="cf56e8f7064641d90042222c75e5f325eb63a6e70679b6b005cad41158588315" exitCode=0
Sep 11 14:35:34.431946 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:34.431632    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb" event={"ID":"7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe","Type":"ContainerDied","Data":"cf56e8f7064641d90042222c75e5f325eb63a6e70679b6b005cad41158588315"}
Sep 11 14:35:35.385748 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:35.385716    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"
Sep 11 14:35:35.573749 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:35.573726    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb"
Sep 11 14:35:35.663040 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:35.662952    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe-maas-api-service-ca\") pod \"7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe\" (UID: \"7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe\") "
Sep 11 14:35:35.663303 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:35.663278    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe" (UID: "7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:35:35.763831 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:35.763800    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:36.444588 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:36.444561    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb"
Sep 11 14:35:36.444760 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:36.444552    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb" event={"ID":"7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe","Type":"ContainerDied","Data":"9de3cf9f01000862a8f8e43a5f811f04ae98e129abc9f03b4d3a8d97ef283a47"}
Sep 11 14:35:36.444760 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:36.444694    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9de3cf9f01000862a8f8e43a5f811f04ae98e129abc9f03b4d3a8d97ef283a47"
Sep 11 14:35:43.875960 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:43.875926    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"]
Sep 11 14:35:43.876495 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:43.876173    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4" podUID="d8d2e1be-642e-41e9-af04-967a5e727683" containerName="payload-pre-processing" containerID="cri-o://a215c70c17449b6dc9e322e95d9470c1ac75e1831c82e46e3648293143a29985" gracePeriod=30
Sep 11 14:35:44.129953 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.129868    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"
Sep 11 14:35:44.241858 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.241819    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vp44\" (UniqueName: \"kubernetes.io/projected/d8d2e1be-642e-41e9-af04-967a5e727683-kube-api-access-2vp44\") pod \"d8d2e1be-642e-41e9-af04-967a5e727683\" (UID: \"d8d2e1be-642e-41e9-af04-967a5e727683\") "
Sep 11 14:35:44.242075 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.241922    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d2e1be-642e-41e9-af04-967a5e727683-plugins-config-volume\") pod \"d8d2e1be-642e-41e9-af04-967a5e727683\" (UID: \"d8d2e1be-642e-41e9-af04-967a5e727683\") "
Sep 11 14:35:44.242299 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.242275    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8d2e1be-642e-41e9-af04-967a5e727683-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8d2e1be-642e-41e9-af04-967a5e727683" (UID: "d8d2e1be-642e-41e9-af04-967a5e727683"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:35:44.244159 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.244124    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8d2e1be-642e-41e9-af04-967a5e727683-kube-api-access-2vp44" (OuterVolumeSpecName: "kube-api-access-2vp44") pod "d8d2e1be-642e-41e9-af04-967a5e727683" (UID: "d8d2e1be-642e-41e9-af04-967a5e727683"). InnerVolumeSpecName "kube-api-access-2vp44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:35:44.343401 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.343363    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vp44\" (UniqueName: \"kubernetes.io/projected/d8d2e1be-642e-41e9-af04-967a5e727683-kube-api-access-2vp44\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:44.343401 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.343395    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d2e1be-642e-41e9-af04-967a5e727683-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:35:44.381982 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.381896    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb"]
Sep 11 14:35:44.396303 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.396277    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-15594dcc-brfxb"]
Sep 11 14:35:44.488853 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.488810    2569 generic.go:356] "Generic (PLEG): container finished" podID="d8d2e1be-642e-41e9-af04-967a5e727683" containerID="a215c70c17449b6dc9e322e95d9470c1ac75e1831c82e46e3648293143a29985" exitCode=0
Sep 11 14:35:44.489070 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.488917    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4" event={"ID":"d8d2e1be-642e-41e9-af04-967a5e727683","Type":"ContainerDied","Data":"a215c70c17449b6dc9e322e95d9470c1ac75e1831c82e46e3648293143a29985"}
Sep 11 14:35:44.489070 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.489018    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4" event={"ID":"d8d2e1be-642e-41e9-af04-967a5e727683","Type":"ContainerDied","Data":"f8ca42ab87c773c9f11b364ed9bf3c1914e2312cb2a272ff057c2185250b5c0c"}
Sep 11 14:35:44.489070 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.489058    2569 scope.go:117] "RemoveContainer" containerID="a215c70c17449b6dc9e322e95d9470c1ac75e1831c82e46e3648293143a29985"
Sep 11 14:35:44.489307 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.489289    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"
Sep 11 14:35:44.503990 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.503961    2569 scope.go:117] "RemoveContainer" containerID="a215c70c17449b6dc9e322e95d9470c1ac75e1831c82e46e3648293143a29985"
Sep 11 14:35:44.506248 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:35:44.506133    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a215c70c17449b6dc9e322e95d9470c1ac75e1831c82e46e3648293143a29985\": container with ID starting with a215c70c17449b6dc9e322e95d9470c1ac75e1831c82e46e3648293143a29985 not found: ID does not exist" containerID="a215c70c17449b6dc9e322e95d9470c1ac75e1831c82e46e3648293143a29985"
Sep 11 14:35:44.506248 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.506219    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a215c70c17449b6dc9e322e95d9470c1ac75e1831c82e46e3648293143a29985"} err="failed to get container status \"a215c70c17449b6dc9e322e95d9470c1ac75e1831c82e46e3648293143a29985\": rpc error: code = NotFound desc = could not find container \"a215c70c17449b6dc9e322e95d9470c1ac75e1831c82e46e3648293143a29985\": container with ID starting with a215c70c17449b6dc9e322e95d9470c1ac75e1831c82e46e3648293143a29985 not found: ID does not exist"
Sep 11 14:35:44.556614 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.556582    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"]
Sep 11 14:35:44.574444 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:44.574413    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-15594dcc-6fd968d558-2f9c4"]
Sep 11 14:35:46.270478 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:46.270443    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe" path="/var/lib/kubelet/pods/7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe/volumes"
Sep 11 14:35:46.270844 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:46.270783    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8d2e1be-642e-41e9-af04-967a5e727683" path="/var/lib/kubelet/pods/d8d2e1be-642e-41e9-af04-967a5e727683/volumes"
Sep 11 14:35:47.282706 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:35:47.282676    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:36:04.036853 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:04.036779    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:36:22.160016 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:22.159981    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:36:37.675087 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.675049    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx"]
Sep 11 14:36:37.675625 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.675416    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8d2e1be-642e-41e9-af04-967a5e727683" containerName="payload-pre-processing"
Sep 11 14:36:37.675625 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.675428    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8d2e1be-642e-41e9-af04-967a5e727683" containerName="payload-pre-processing"
Sep 11 14:36:37.675625 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.675446    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe" containerName="revoke-keys"
Sep 11 14:36:37.675625 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.675452    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe" containerName="revoke-keys"
Sep 11 14:36:37.675625 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.675507    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8d2e1be-642e-41e9-af04-967a5e727683" containerName="payload-pre-processing"
Sep 11 14:36:37.675625 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.675515    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b1a5ea5-0b2c-49d3-99d6-798a9c1387fe" containerName="revoke-keys"
Sep 11 14:36:37.678224 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.678207    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx"
Sep 11 14:36:37.681903 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.681858    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:36:37.682607 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.682588    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:36:37.694239 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.694141    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx"]
Sep 11 14:36:37.815297 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.815261    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc37e001-4c12-4e93-9813-d421e0f684e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx\" (UID: \"fc37e001-4c12-4e93-9813-d421e0f684e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx"
Sep 11 14:36:37.916374 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.916334    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc37e001-4c12-4e93-9813-d421e0f684e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx\" (UID: \"fc37e001-4c12-4e93-9813-d421e0f684e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx"
Sep 11 14:36:37.916978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.916958    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc37e001-4c12-4e93-9813-d421e0f684e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx\" (UID: \"fc37e001-4c12-4e93-9813-d421e0f684e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx"
Sep 11 14:36:37.995197 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:37.995112    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx"
Sep 11 14:36:38.272084 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:38.272058    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx"]
Sep 11 14:36:38.274302 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:36:38.274278    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc37e001_4c12_4e93_9813_d421e0f684e9.slice/crio-41b195307616cf713351988f315882ab90999c97637763c5a4c9a78ea709d12d WatchSource:0}: Error finding container 41b195307616cf713351988f315882ab90999c97637763c5a4c9a78ea709d12d: Status 404 returned error can't find the container with id 41b195307616cf713351988f315882ab90999c97637763c5a4c9a78ea709d12d
Sep 11 14:36:38.770491 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:38.770457    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx" event={"ID":"fc37e001-4c12-4e93-9813-d421e0f684e9","Type":"ContainerStarted","Data":"3534378b3146c4b73e1dc5464626b1f5fd16d0276aaee183fd9c2973f8386661"}
Sep 11 14:36:38.770924 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:38.770510    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx" event={"ID":"fc37e001-4c12-4e93-9813-d421e0f684e9","Type":"ContainerStarted","Data":"41b195307616cf713351988f315882ab90999c97637763c5a4c9a78ea709d12d"}
Sep 11 14:36:38.800130 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:38.800043    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx" podStartSLOduration=1.800028747 podStartE2EDuration="1.800028747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:36:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:36:38.79783825 +0000 UTC m=+1295.012423913" watchObservedRunningTime="2026-09-11 14:36:38.800028747 +0000 UTC m=+1295.014614408"
Sep 11 14:36:39.778519 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:39.778483    2569 generic.go:356] "Generic (PLEG): container finished" podID="fc37e001-4c12-4e93-9813-d421e0f684e9" containerID="3534378b3146c4b73e1dc5464626b1f5fd16d0276aaee183fd9c2973f8386661" exitCode=0
Sep 11 14:36:39.778925 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:39.778556    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx" event={"ID":"fc37e001-4c12-4e93-9813-d421e0f684e9","Type":"ContainerDied","Data":"3534378b3146c4b73e1dc5464626b1f5fd16d0276aaee183fd9c2973f8386661"}
Sep 11 14:36:40.913490 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:40.913465    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx"
Sep 11 14:36:40.944625 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:40.944596    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc37e001-4c12-4e93-9813-d421e0f684e9-maas-api-service-ca\") pod \"fc37e001-4c12-4e93-9813-d421e0f684e9\" (UID: \"fc37e001-4c12-4e93-9813-d421e0f684e9\") "
Sep 11 14:36:40.945051 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:40.945023    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc37e001-4c12-4e93-9813-d421e0f684e9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fc37e001-4c12-4e93-9813-d421e0f684e9" (UID: "fc37e001-4c12-4e93-9813-d421e0f684e9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:36:41.045570 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:41.045491    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc37e001-4c12-4e93-9813-d421e0f684e9-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:36:41.790075 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:41.790050    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx"
Sep 11 14:36:41.790269 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:41.790047    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx" event={"ID":"fc37e001-4c12-4e93-9813-d421e0f684e9","Type":"ContainerDied","Data":"41b195307616cf713351988f315882ab90999c97637763c5a4c9a78ea709d12d"}
Sep 11 14:36:41.790269 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:41.790180    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41b195307616cf713351988f315882ab90999c97637763c5a4c9a78ea709d12d"
Sep 11 14:36:42.367910 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:42.367018    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:36:48.638079 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:48.638043    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"]
Sep 11 14:36:48.638499 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:48.638357    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm" podUID="88cdf3ea-32d6-47fe-a4e8-98541376da8b" containerName="payload-processing" containerID="cri-o://71e131e9fb52d951a14cc12c4255d9ab9fb989a407c66c0550e24f7ad03ba56a" gracePeriod=30
Sep 11 14:36:48.655467 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:48.655443    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"]
Sep 11 14:36:48.655685 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:48.655647    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55" podUID="3a79774d-ea46-4d7b-aff6-0797c6c9a8cb" containerName="payload-pre-processing" containerID="cri-o://a6e9a97b6fae0dc0da316e6e9f0ba64f75ee445601b42b5a250719cf3b9f4b2b" gracePeriod=30
Sep 11 14:36:48.828457 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:48.828229    2569 generic.go:356] "Generic (PLEG): container finished" podID="3a79774d-ea46-4d7b-aff6-0797c6c9a8cb" containerID="a6e9a97b6fae0dc0da316e6e9f0ba64f75ee445601b42b5a250719cf3b9f4b2b" exitCode=0
Sep 11 14:36:48.828457 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:48.828371    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55" event={"ID":"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb","Type":"ContainerDied","Data":"a6e9a97b6fae0dc0da316e6e9f0ba64f75ee445601b42b5a250719cf3b9f4b2b"}
Sep 11 14:36:48.830910 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:48.830858    2569 generic.go:356] "Generic (PLEG): container finished" podID="88cdf3ea-32d6-47fe-a4e8-98541376da8b" containerID="71e131e9fb52d951a14cc12c4255d9ab9fb989a407c66c0550e24f7ad03ba56a" exitCode=0
Sep 11 14:36:48.831053 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:48.830989    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm" event={"ID":"88cdf3ea-32d6-47fe-a4e8-98541376da8b","Type":"ContainerDied","Data":"71e131e9fb52d951a14cc12c4255d9ab9fb989a407c66c0550e24f7ad03ba56a"}
Sep 11 14:36:48.901435 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:48.901376    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"
Sep 11 14:36:48.933487 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:48.933449    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"
Sep 11 14:36:48.997251 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:48.997218    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx"]
Sep 11 14:36:49.008632 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.008596    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a79774d-ea46-4d7b-aff6-0797c6c9a8cb-plugins-config-volume\") pod \"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb\" (UID: \"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb\") "
Sep 11 14:36:49.008784 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.008643    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7khhp\" (UniqueName: \"kubernetes.io/projected/3a79774d-ea46-4d7b-aff6-0797c6c9a8cb-kube-api-access-7khhp\") pod \"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb\" (UID: \"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb\") "
Sep 11 14:36:49.008784 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.008685    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88cdf3ea-32d6-47fe-a4e8-98541376da8b-plugins-config-volume\") pod \"88cdf3ea-32d6-47fe-a4e8-98541376da8b\" (UID: \"88cdf3ea-32d6-47fe-a4e8-98541376da8b\") "
Sep 11 14:36:49.008784 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.008726    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkk78\" (UniqueName: \"kubernetes.io/projected/88cdf3ea-32d6-47fe-a4e8-98541376da8b-kube-api-access-nkk78\") pod \"88cdf3ea-32d6-47fe-a4e8-98541376da8b\" (UID: \"88cdf3ea-32d6-47fe-a4e8-98541376da8b\") "
Sep 11 14:36:49.009129 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.009085    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a79774d-ea46-4d7b-aff6-0797c6c9a8cb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3a79774d-ea46-4d7b-aff6-0797c6c9a8cb" (UID: "3a79774d-ea46-4d7b-aff6-0797c6c9a8cb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:36:49.009264 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.009143    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88cdf3ea-32d6-47fe-a4e8-98541376da8b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "88cdf3ea-32d6-47fe-a4e8-98541376da8b" (UID: "88cdf3ea-32d6-47fe-a4e8-98541376da8b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:36:49.011171 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.011143    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a79774d-ea46-4d7b-aff6-0797c6c9a8cb-kube-api-access-7khhp" (OuterVolumeSpecName: "kube-api-access-7khhp") pod "3a79774d-ea46-4d7b-aff6-0797c6c9a8cb" (UID: "3a79774d-ea46-4d7b-aff6-0797c6c9a8cb"). InnerVolumeSpecName "kube-api-access-7khhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:36:49.011171 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.011156    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88cdf3ea-32d6-47fe-a4e8-98541376da8b-kube-api-access-nkk78" (OuterVolumeSpecName: "kube-api-access-nkk78") pod "88cdf3ea-32d6-47fe-a4e8-98541376da8b" (UID: "88cdf3ea-32d6-47fe-a4e8-98541376da8b"). InnerVolumeSpecName "kube-api-access-nkk78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:36:49.012138 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.012090    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-69a7cf-ndrwx"]
Sep 11 14:36:49.110519 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.110484    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkk78\" (UniqueName: \"kubernetes.io/projected/88cdf3ea-32d6-47fe-a4e8-98541376da8b-kube-api-access-nkk78\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:36:49.110519 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.110512    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a79774d-ea46-4d7b-aff6-0797c6c9a8cb-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:36:49.110519 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.110523    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7khhp\" (UniqueName: \"kubernetes.io/projected/3a79774d-ea46-4d7b-aff6-0797c6c9a8cb-kube-api-access-7khhp\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:36:49.110799 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.110532    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88cdf3ea-32d6-47fe-a4e8-98541376da8b-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:36:49.837436 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.837403    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"
Sep 11 14:36:49.837947 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.837433    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55" event={"ID":"3a79774d-ea46-4d7b-aff6-0797c6c9a8cb","Type":"ContainerDied","Data":"f51b53399617ac844c8dae23d5762c55e1012058ed991bbac74217dafaaed1e1"}
Sep 11 14:36:49.837947 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.837504    2569 scope.go:117] "RemoveContainer" containerID="a6e9a97b6fae0dc0da316e6e9f0ba64f75ee445601b42b5a250719cf3b9f4b2b"
Sep 11 14:36:49.838912 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.838851    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"
Sep 11 14:36:49.838912 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.838862    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm" event={"ID":"88cdf3ea-32d6-47fe-a4e8-98541376da8b","Type":"ContainerDied","Data":"78c57c9e27302e43476e0ce91ff35de44c422b36f3c593bdec0b0949da65d208"}
Sep 11 14:36:49.847263 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.847240    2569 scope.go:117] "RemoveContainer" containerID="71e131e9fb52d951a14cc12c4255d9ab9fb989a407c66c0550e24f7ad03ba56a"
Sep 11 14:36:49.867822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.867795    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"]
Sep 11 14:36:49.876245 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.876219    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-69a7cf-77965cf9cd-swk55"]
Sep 11 14:36:49.894807 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.894779    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"]
Sep 11 14:36:49.896941 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:49.896917    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-69a7cf-7d87878949-2v4zm"]
Sep 11 14:36:50.272069 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:50.272037    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a79774d-ea46-4d7b-aff6-0797c6c9a8cb" path="/var/lib/kubelet/pods/3a79774d-ea46-4d7b-aff6-0797c6c9a8cb/volumes"
Sep 11 14:36:50.272400 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:50.272387    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88cdf3ea-32d6-47fe-a4e8-98541376da8b" path="/var/lib/kubelet/pods/88cdf3ea-32d6-47fe-a4e8-98541376da8b/volumes"
Sep 11 14:36:50.272663 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:50.272652    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc37e001-4c12-4e93-9813-d421e0f684e9" path="/var/lib/kubelet/pods/fc37e001-4c12-4e93-9813-d421e0f684e9/volumes"
Sep 11 14:36:53.350885 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:53.350835    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:36:59.507614 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.507572    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"]
Sep 11 14:36:59.508082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.507959    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88cdf3ea-32d6-47fe-a4e8-98541376da8b" containerName="payload-processing"
Sep 11 14:36:59.508082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.507974    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="88cdf3ea-32d6-47fe-a4e8-98541376da8b" containerName="payload-processing"
Sep 11 14:36:59.508082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.507986    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc37e001-4c12-4e93-9813-d421e0f684e9" containerName="revoke-keys"
Sep 11 14:36:59.508082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.507992    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc37e001-4c12-4e93-9813-d421e0f684e9" containerName="revoke-keys"
Sep 11 14:36:59.508082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.508005    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a79774d-ea46-4d7b-aff6-0797c6c9a8cb" containerName="payload-pre-processing"
Sep 11 14:36:59.508082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.508011    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a79774d-ea46-4d7b-aff6-0797c6c9a8cb" containerName="payload-pre-processing"
Sep 11 14:36:59.508082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.508068    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="88cdf3ea-32d6-47fe-a4e8-98541376da8b" containerName="payload-processing"
Sep 11 14:36:59.508082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.508078    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a79774d-ea46-4d7b-aff6-0797c6c9a8cb" containerName="payload-pre-processing"
Sep 11 14:36:59.508082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.508085    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc37e001-4c12-4e93-9813-d421e0f684e9" containerName="revoke-keys"
Sep 11 14:36:59.512661 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.512639    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.528316 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.528292    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-cdc958-openshift-default-dockercfg-5z7g8\""
Sep 11 14:36:59.540154 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.540126    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"]
Sep 11 14:36:59.609420 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.609379    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-workload-certs\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.609746 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.609722    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtjws\" (UniqueName: \"kubernetes.io/projected/b95f4ffa-21fe-4391-80a3-850b5d2c4236-kube-api-access-mtjws\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.609945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.609924    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-workload-socket\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.610106 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.610089    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-envoy\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.610265 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.610250    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-credential-socket\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.610402 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.610384    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-podinfo\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.610551 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.610536    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-data\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.610670 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.610657    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istiod-ca-cert\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.610792 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.610777    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-token\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712031 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712001    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-data\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712031 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712034    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istiod-ca-cert\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712051    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-token\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712113    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-workload-certs\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712129    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtjws\" (UniqueName: \"kubernetes.io/projected/b95f4ffa-21fe-4391-80a3-850b5d2c4236-kube-api-access-mtjws\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712149    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-workload-socket\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712173    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-envoy\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712207    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-credential-socket\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712233    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-podinfo\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712608 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712460    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-data\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712608 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712583    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-workload-socket\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712695 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712614    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-workload-certs\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712773 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712752    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-credential-socket\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.712827 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.712785    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istiod-ca-cert\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.714782 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.714758    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-envoy\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.714918 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.714895    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-podinfo\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.724911 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.724891    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-token\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.729099 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.729074    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtjws\" (UniqueName: \"kubernetes.io/projected/b95f4ffa-21fe-4391-80a3-850b5d2c4236-kube-api-access-mtjws\") pod \"e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") " pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:36:59.822613 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:36:59.822527    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:37:00.135570 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:00.135544    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"]
Sep 11 14:37:00.136338 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:37:00.136308    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb95f4ffa_21fe_4391_80a3_850b5d2c4236.slice/crio-b07605c7666f38ab182365dd255b903530e19a9a3de168b1519ecd27dbded702 WatchSource:0}: Error finding container b07605c7666f38ab182365dd255b903530e19a9a3de168b1519ecd27dbded702: Status 404 returned error can't find the container with id b07605c7666f38ab182365dd255b903530e19a9a3de168b1519ecd27dbded702
Sep 11 14:37:00.138591 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:00.138556    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:37:00.138685 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:00.138642    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:37:00.138749 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:00.138692    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:37:00.898734 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:00.898697    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx" event={"ID":"b95f4ffa-21fe-4391-80a3-850b5d2c4236","Type":"ContainerStarted","Data":"7aff1d3a9fa3905c176014a5d8db9647e06f7446c9c205891b24f4d6164d266e"}
Sep 11 14:37:00.899271 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:00.898758    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx" event={"ID":"b95f4ffa-21fe-4391-80a3-850b5d2c4236","Type":"ContainerStarted","Data":"b07605c7666f38ab182365dd255b903530e19a9a3de168b1519ecd27dbded702"}
Sep 11 14:37:00.988545 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:00.988452    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx" podStartSLOduration=1.988430996 podStartE2EDuration="1.988430996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:36:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:37:00.985666892 +0000 UTC m=+1317.200252554" watchObservedRunningTime="2026-09-11 14:37:00.988430996 +0000 UTC m=+1317.203016654"
Sep 11 14:37:01.823285 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:01.823247    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:37:01.829071 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:01.829047    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:37:01.904298 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:01.904264    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:37:01.905196 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:01.905175    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:37:10.988496 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:10.988455    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"]
Sep 11 14:37:10.993354 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:10.993331    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:10.999626 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:10.999518    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-cdc958\"/\"noten-model-cdc958-kserve-self-signed-certs\""
Sep 11 14:37:10.999626 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:10.999580    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-cdc958\"/\"kube-root-ca.crt\""
Sep 11 14:37:11.000548 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.000531    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-noten-cdc958\"/\"openshift-service-ca.crt\""
Sep 11 14:37:11.005712 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.005697    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-noten-cdc958\"/\"default-dockercfg-qw6xh\""
Sep 11 14:37:11.043440 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.043406    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"]
Sep 11 14:37:11.115143 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.115110    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-dshm\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.115334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.115179    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-tmp-dir\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.115334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.115208    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-home\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.115334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.115230    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a730e4e1-2a86-406c-8394-c495735d1626-tls-certs\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.115334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.115258    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-model-cache\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.115507 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.115368    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf966\" (UniqueName: \"kubernetes.io/projected/a730e4e1-2a86-406c-8394-c495735d1626-kube-api-access-cf966\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.216668 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.216633    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-tmp-dir\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.216668 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.216672    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-home\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.216958 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.216692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a730e4e1-2a86-406c-8394-c495735d1626-tls-certs\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.216958 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.216753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-model-cache\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.216958 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.216848    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf966\" (UniqueName: \"kubernetes.io/projected/a730e4e1-2a86-406c-8394-c495735d1626-kube-api-access-cf966\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.216958 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.216923    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-dshm\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.217151 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.217082    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-home\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.217197 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.217149    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-model-cache\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.217256 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.217233    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-tmp-dir\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.219202 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.219181    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-dshm\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.219461 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.219445    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a730e4e1-2a86-406c-8394-c495735d1626-tls-certs\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.232042 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.232015    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf966\" (UniqueName: \"kubernetes.io/projected/a730e4e1-2a86-406c-8394-c495735d1626-kube-api-access-cf966\") pod \"noten-model-cdc958-kserve-5df479f899-87hfp\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") " pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.302009 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.301943    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:11.598564 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.598402    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"]
Sep 11 14:37:11.601168 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:37:11.601141    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda730e4e1_2a86_406c_8394_c495735d1626.slice/crio-572a327ea5e1b7a8986283b17ab5715e48e3cea2c12d2854b25b237d43accc89 WatchSource:0}: Error finding container 572a327ea5e1b7a8986283b17ab5715e48e3cea2c12d2854b25b237d43accc89: Status 404 returned error can't find the container with id 572a327ea5e1b7a8986283b17ab5715e48e3cea2c12d2854b25b237d43accc89
Sep 11 14:37:11.958443 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.958410    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp" event={"ID":"a730e4e1-2a86-406c-8394-c495735d1626","Type":"ContainerStarted","Data":"628125085b12a18918f00c0c7ffc565dc8c9c305f9a36fd887e5c2c8d329a261"}
Sep 11 14:37:11.958612 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:11.958455    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp" event={"ID":"a730e4e1-2a86-406c-8394-c495735d1626","Type":"ContainerStarted","Data":"572a327ea5e1b7a8986283b17ab5715e48e3cea2c12d2854b25b237d43accc89"}
Sep 11 14:37:16.543979 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:16.543920    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp" podStartSLOduration=6.543903122 podStartE2EDuration="6.543903122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:37:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:37:12.000366361 +0000 UTC m=+1328.214952048" watchObservedRunningTime="2026-09-11 14:37:16.543903122 +0000 UTC m=+1332.758488777"
Sep 11 14:37:16.544795 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:16.544770    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"]
Sep 11 14:37:16.656633 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:16.656602    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"]
Sep 11 14:37:16.656814 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:16.656793    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx" podUID="b95f4ffa-21fe-4391-80a3-850b5d2c4236" containerName="istio-proxy" containerID="cri-o://7aff1d3a9fa3905c176014a5d8db9647e06f7446c9c205891b24f4d6164d266e" gracePeriod=30
Sep 11 14:37:16.906446 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:16.906359    2569 patch_prober.go:28] interesting pod/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 11 14:37:16.906446 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:16.906432    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx" podUID="b95f4ffa-21fe-4391-80a3-850b5d2c4236" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 14:37:20.141082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:20.141044    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:37:21.303030 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.303000    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:21.896602 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.896577    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:37:21.918952 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.918858    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istiod-ca-cert\") pod \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") "
Sep 11 14:37:21.918952 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.918926    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-workload-certs\") pod \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") "
Sep 11 14:37:21.919130 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.918987    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-workload-socket\") pod \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") "
Sep 11 14:37:21.919130 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919037    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtjws\" (UniqueName: \"kubernetes.io/projected/b95f4ffa-21fe-4391-80a3-850b5d2c4236-kube-api-access-mtjws\") pod \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") "
Sep 11 14:37:21.919130 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919080    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-envoy\") pod \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") "
Sep 11 14:37:21.919130 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919105    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-credential-socket\") pod \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") "
Sep 11 14:37:21.919334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919150    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-data\") pod \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") "
Sep 11 14:37:21.919334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919210    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-token\") pod \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") "
Sep 11 14:37:21.919334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919236    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b95f4ffa-21fe-4391-80a3-850b5d2c4236" (UID: "b95f4ffa-21fe-4391-80a3-850b5d2c4236"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:37:21.919334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919256    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-podinfo\") pod \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\" (UID: \"b95f4ffa-21fe-4391-80a3-850b5d2c4236\") "
Sep 11 14:37:21.919334 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919254    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b95f4ffa-21fe-4391-80a3-850b5d2c4236" (UID: "b95f4ffa-21fe-4391-80a3-850b5d2c4236"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:37:21.919591 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919332    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b95f4ffa-21fe-4391-80a3-850b5d2c4236" (UID: "b95f4ffa-21fe-4391-80a3-850b5d2c4236"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:37:21.919591 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919444    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b95f4ffa-21fe-4391-80a3-850b5d2c4236" (UID: "b95f4ffa-21fe-4391-80a3-850b5d2c4236"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:37:21.919591 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919522    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-data" (OuterVolumeSpecName: "istio-data") pod "b95f4ffa-21fe-4391-80a3-850b5d2c4236" (UID: "b95f4ffa-21fe-4391-80a3-850b5d2c4236"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:37:21.919753 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919634    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-credential-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:21.919753 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919654    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-data\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:21.919753 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919670    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istiod-ca-cert\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:21.919753 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919685    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-workload-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:21.919753 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.919700    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-workload-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:21.921540 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.921519    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b95f4ffa-21fe-4391-80a3-850b5d2c4236" (UID: "b95f4ffa-21fe-4391-80a3-850b5d2c4236"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 14:37:21.921911 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.921856    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b95f4ffa-21fe-4391-80a3-850b5d2c4236" (UID: "b95f4ffa-21fe-4391-80a3-850b5d2c4236"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:37:21.922028 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.921954    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-token" (OuterVolumeSpecName: "istio-token") pod "b95f4ffa-21fe-4391-80a3-850b5d2c4236" (UID: "b95f4ffa-21fe-4391-80a3-850b5d2c4236"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:37:21.922028 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:21.921972    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b95f4ffa-21fe-4391-80a3-850b5d2c4236-kube-api-access-mtjws" (OuterVolumeSpecName: "kube-api-access-mtjws") pod "b95f4ffa-21fe-4391-80a3-850b5d2c4236" (UID: "b95f4ffa-21fe-4391-80a3-850b5d2c4236"). InnerVolumeSpecName "kube-api-access-mtjws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:37:22.012067 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.012031    2569 generic.go:356] "Generic (PLEG): container finished" podID="b95f4ffa-21fe-4391-80a3-850b5d2c4236" containerID="7aff1d3a9fa3905c176014a5d8db9647e06f7446c9c205891b24f4d6164d266e" exitCode=0
Sep 11 14:37:22.012255 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.012081    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"
Sep 11 14:37:22.012255 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.012119    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx" event={"ID":"b95f4ffa-21fe-4391-80a3-850b5d2c4236","Type":"ContainerDied","Data":"7aff1d3a9fa3905c176014a5d8db9647e06f7446c9c205891b24f4d6164d266e"}
Sep 11 14:37:22.012255 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.012187    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx" event={"ID":"b95f4ffa-21fe-4391-80a3-850b5d2c4236","Type":"ContainerDied","Data":"b07605c7666f38ab182365dd255b903530e19a9a3de168b1519ecd27dbded702"}
Sep 11 14:37:22.012255 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.012221    2569 scope.go:117] "RemoveContainer" containerID="7aff1d3a9fa3905c176014a5d8db9647e06f7446c9c205891b24f4d6164d266e"
Sep 11 14:37:22.020343 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.020319    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-podinfo\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:22.020445 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.020349    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtjws\" (UniqueName: \"kubernetes.io/projected/b95f4ffa-21fe-4391-80a3-850b5d2c4236-kube-api-access-mtjws\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:22.020445 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.020366    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-envoy\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:22.020445 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.020378    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b95f4ffa-21fe-4391-80a3-850b5d2c4236-istio-token\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:22.022066 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.022051    2569 scope.go:117] "RemoveContainer" containerID="7aff1d3a9fa3905c176014a5d8db9647e06f7446c9c205891b24f4d6164d266e"
Sep 11 14:37:22.022345 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:37:22.022325    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aff1d3a9fa3905c176014a5d8db9647e06f7446c9c205891b24f4d6164d266e\": container with ID starting with 7aff1d3a9fa3905c176014a5d8db9647e06f7446c9c205891b24f4d6164d266e not found: ID does not exist" containerID="7aff1d3a9fa3905c176014a5d8db9647e06f7446c9c205891b24f4d6164d266e"
Sep 11 14:37:22.022402 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.022355    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aff1d3a9fa3905c176014a5d8db9647e06f7446c9c205891b24f4d6164d266e"} err="failed to get container status \"7aff1d3a9fa3905c176014a5d8db9647e06f7446c9c205891b24f4d6164d266e\": rpc error: code = NotFound desc = could not find container \"7aff1d3a9fa3905c176014a5d8db9647e06f7446c9c205891b24f4d6164d266e\": container with ID starting with 7aff1d3a9fa3905c176014a5d8db9647e06f7446c9c205891b24f4d6164d266e not found: ID does not exist"
Sep 11 14:37:22.042823 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.042792    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"]
Sep 11 14:37:22.052087 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.052059    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-cdc958-openshift-default-5b9dcd68fb-zmhhx"]
Sep 11 14:37:22.270400 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:22.270365    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b95f4ffa-21fe-4391-80a3-850b5d2c4236" path="/var/lib/kubelet/pods/b95f4ffa-21fe-4391-80a3-850b5d2c4236/volumes"
Sep 11 14:37:31.564402 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.564287    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp" podUID="a730e4e1-2a86-406c-8394-c495735d1626" containerName="main" containerID="cri-o://628125085b12a18918f00c0c7ffc565dc8c9c305f9a36fd887e5c2c8d329a261" gracePeriod=45
Sep 11 14:37:31.821499 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.821436    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:31.909220 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.909186    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf966\" (UniqueName: \"kubernetes.io/projected/a730e4e1-2a86-406c-8394-c495735d1626-kube-api-access-cf966\") pod \"a730e4e1-2a86-406c-8394-c495735d1626\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") "
Sep 11 14:37:31.909405 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.909240    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-model-cache\") pod \"a730e4e1-2a86-406c-8394-c495735d1626\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") "
Sep 11 14:37:31.909405 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.909270    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-home\") pod \"a730e4e1-2a86-406c-8394-c495735d1626\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") "
Sep 11 14:37:31.909405 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.909316    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-dshm\") pod \"a730e4e1-2a86-406c-8394-c495735d1626\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") "
Sep 11 14:37:31.909405 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.909337    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a730e4e1-2a86-406c-8394-c495735d1626-tls-certs\") pod \"a730e4e1-2a86-406c-8394-c495735d1626\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") "
Sep 11 14:37:31.909405 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.909366    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-tmp-dir\") pod \"a730e4e1-2a86-406c-8394-c495735d1626\" (UID: \"a730e4e1-2a86-406c-8394-c495735d1626\") "
Sep 11 14:37:31.909692 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.909531    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-home" (OuterVolumeSpecName: "home") pod "a730e4e1-2a86-406c-8394-c495735d1626" (UID: "a730e4e1-2a86-406c-8394-c495735d1626"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:37:31.909692 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.909542    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-model-cache" (OuterVolumeSpecName: "model-cache") pod "a730e4e1-2a86-406c-8394-c495735d1626" (UID: "a730e4e1-2a86-406c-8394-c495735d1626"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:37:31.909692 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.909653    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-model-cache\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:31.909692 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.909673    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-home\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:31.909901 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.909848    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a730e4e1-2a86-406c-8394-c495735d1626" (UID: "a730e4e1-2a86-406c-8394-c495735d1626"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:37:31.911724 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.911692    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a730e4e1-2a86-406c-8394-c495735d1626-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a730e4e1-2a86-406c-8394-c495735d1626" (UID: "a730e4e1-2a86-406c-8394-c495735d1626"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:37:31.911724 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.911702    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-dshm" (OuterVolumeSpecName: "dshm") pod "a730e4e1-2a86-406c-8394-c495735d1626" (UID: "a730e4e1-2a86-406c-8394-c495735d1626"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:37:31.911904 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:31.911735    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a730e4e1-2a86-406c-8394-c495735d1626-kube-api-access-cf966" (OuterVolumeSpecName: "kube-api-access-cf966") pod "a730e4e1-2a86-406c-8394-c495735d1626" (UID: "a730e4e1-2a86-406c-8394-c495735d1626"). InnerVolumeSpecName "kube-api-access-cf966". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:37:32.010929 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.010901    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-dshm\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:32.010929 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.010927    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a730e4e1-2a86-406c-8394-c495735d1626-tls-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:32.011092 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.010936    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a730e4e1-2a86-406c-8394-c495735d1626-tmp-dir\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:32.011092 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.010955    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf966\" (UniqueName: \"kubernetes.io/projected/a730e4e1-2a86-406c-8394-c495735d1626-kube-api-access-cf966\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:32.062622 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.062588    2569 generic.go:356] "Generic (PLEG): container finished" podID="a730e4e1-2a86-406c-8394-c495735d1626" containerID="628125085b12a18918f00c0c7ffc565dc8c9c305f9a36fd887e5c2c8d329a261" exitCode=0
Sep 11 14:37:32.062743 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.062626    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"
Sep 11 14:37:32.062743 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.062681    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp" event={"ID":"a730e4e1-2a86-406c-8394-c495735d1626","Type":"ContainerDied","Data":"628125085b12a18918f00c0c7ffc565dc8c9c305f9a36fd887e5c2c8d329a261"}
Sep 11 14:37:32.062743 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.062727    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp" event={"ID":"a730e4e1-2a86-406c-8394-c495735d1626","Type":"ContainerDied","Data":"572a327ea5e1b7a8986283b17ab5715e48e3cea2c12d2854b25b237d43accc89"}
Sep 11 14:37:32.062930 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.062748    2569 scope.go:117] "RemoveContainer" containerID="628125085b12a18918f00c0c7ffc565dc8c9c305f9a36fd887e5c2c8d329a261"
Sep 11 14:37:32.071645 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.071625    2569 scope.go:117] "RemoveContainer" containerID="628125085b12a18918f00c0c7ffc565dc8c9c305f9a36fd887e5c2c8d329a261"
Sep 11 14:37:32.071987 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:37:32.071944    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"628125085b12a18918f00c0c7ffc565dc8c9c305f9a36fd887e5c2c8d329a261\": container with ID starting with 628125085b12a18918f00c0c7ffc565dc8c9c305f9a36fd887e5c2c8d329a261 not found: ID does not exist" containerID="628125085b12a18918f00c0c7ffc565dc8c9c305f9a36fd887e5c2c8d329a261"
Sep 11 14:37:32.072044 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.071997    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"628125085b12a18918f00c0c7ffc565dc8c9c305f9a36fd887e5c2c8d329a261"} err="failed to get container status \"628125085b12a18918f00c0c7ffc565dc8c9c305f9a36fd887e5c2c8d329a261\": rpc error: code = NotFound desc = could not find container \"628125085b12a18918f00c0c7ffc565dc8c9c305f9a36fd887e5c2c8d329a261\": container with ID starting with 628125085b12a18918f00c0c7ffc565dc8c9c305f9a36fd887e5c2c8d329a261 not found: ID does not exist"
Sep 11 14:37:32.102277 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.102257    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"]
Sep 11 14:37:32.113786 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.113762    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-noten-cdc958/noten-model-cdc958-kserve-5df479f899-87hfp"]
Sep 11 14:37:32.276381 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.276343    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a730e4e1-2a86-406c-8394-c495735d1626" path="/var/lib/kubelet/pods/a730e4e1-2a86-406c-8394-c495735d1626/volumes"
Sep 11 14:37:32.577352 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:32.577313    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"]
Sep 11 14:37:34.907607 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:34.907574    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"]
Sep 11 14:37:34.907998 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:34.907932    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a730e4e1-2a86-406c-8394-c495735d1626" containerName="main"
Sep 11 14:37:34.907998 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:34.907944    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a730e4e1-2a86-406c-8394-c495735d1626" containerName="main"
Sep 11 14:37:34.907998 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:34.907961    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b95f4ffa-21fe-4391-80a3-850b5d2c4236" containerName="istio-proxy"
Sep 11 14:37:34.907998 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:34.907967    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b95f4ffa-21fe-4391-80a3-850b5d2c4236" containerName="istio-proxy"
Sep 11 14:37:34.908129 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:34.908019    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b95f4ffa-21fe-4391-80a3-850b5d2c4236" containerName="istio-proxy"
Sep 11 14:37:34.908129 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:34.908028    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a730e4e1-2a86-406c-8394-c495735d1626" containerName="main"
Sep 11 14:37:34.910780 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:34.910763    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:34.913333 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:34.913304    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-210be13f-openshift-default-dockercfg-sj2rt\""
Sep 11 14:37:34.958975 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:34.958938    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"]
Sep 11 14:37:35.041092 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.041054    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8618530b-afb2-4031-8706-09adc63446d2-istiod-ca-cert\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.041287 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.041113    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8618530b-afb2-4031-8706-09adc63446d2-istio-token\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.041287 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.041154    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmwnh\" (UniqueName: \"kubernetes.io/projected/8618530b-afb2-4031-8706-09adc63446d2-kube-api-access-bmwnh\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.041287 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.041188    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-istio-envoy\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.041287 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.041247    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-workload-socket\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.041464 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.041333    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8618530b-afb2-4031-8706-09adc63446d2-istio-podinfo\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.041464 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.041372    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-workload-certs\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.041464 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.041435    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-istio-data\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.041589 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.041464    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-credential-socket\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.142422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.142379    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-istio-envoy\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.142612 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.142439    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-workload-socket\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.142612 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.142493    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8618530b-afb2-4031-8706-09adc63446d2-istio-podinfo\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.142612 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.142517    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-workload-certs\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.142612 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.142556    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-istio-data\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.142612 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.142580    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-credential-socket\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.142870 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.142616    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8618530b-afb2-4031-8706-09adc63446d2-istiod-ca-cert\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.142870 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.142663    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8618530b-afb2-4031-8706-09adc63446d2-istio-token\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.142870 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.142688    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmwnh\" (UniqueName: \"kubernetes.io/projected/8618530b-afb2-4031-8706-09adc63446d2-kube-api-access-bmwnh\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.143054 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.142985    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-credential-socket\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.143054 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.142998    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-workload-certs\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.143137 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.143052    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-istio-data\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.143488 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.143471    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-workload-socket\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.143753 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.143727    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8618530b-afb2-4031-8706-09adc63446d2-istiod-ca-cert\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.144944 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.144924    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-istio-envoy\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.145027 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.145014    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8618530b-afb2-4031-8706-09adc63446d2-istio-podinfo\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.160200 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.160145    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmwnh\" (UniqueName: \"kubernetes.io/projected/8618530b-afb2-4031-8706-09adc63446d2-kube-api-access-bmwnh\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.161103 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.161087    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8618530b-afb2-4031-8706-09adc63446d2-istio-token\") pod \"e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") " pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.221317 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.221282    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:35.535086 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.535062    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"]
Sep 11 14:37:35.537163 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:37:35.537141    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8618530b_afb2_4031_8706_09adc63446d2.slice/crio-17f9c913e73099b7d60e2c8615b359d8bce0b2f9dfef7b5e558eea81e0769928 WatchSource:0}: Error finding container 17f9c913e73099b7d60e2c8615b359d8bce0b2f9dfef7b5e558eea81e0769928: Status 404 returned error can't find the container with id 17f9c913e73099b7d60e2c8615b359d8bce0b2f9dfef7b5e558eea81e0769928
Sep 11 14:37:35.539228 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.539197    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:37:35.539311 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.539261    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:37:35.539311 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:35.539290    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:37:36.086900 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:36.086851    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" event={"ID":"8618530b-afb2-4031-8706-09adc63446d2","Type":"ContainerStarted","Data":"cd9c9ca9637e6d4d4816411bb398d07a320ea184a9c4a92a821edf9d62c4e6c6"}
Sep 11 14:37:36.087343 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:36.086922    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" event={"ID":"8618530b-afb2-4031-8706-09adc63446d2","Type":"ContainerStarted","Data":"17f9c913e73099b7d60e2c8615b359d8bce0b2f9dfef7b5e558eea81e0769928"}
Sep 11 14:37:36.135438 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:36.135383    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" podStartSLOduration=2.135367983 podStartE2EDuration="2.135367983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:37:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:37:36.134202124 +0000 UTC m=+1352.348787786" watchObservedRunningTime="2026-09-11 14:37:36.135367983 +0000 UTC m=+1352.349953643"
Sep 11 14:37:36.222248 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:36.222211    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:36.227391 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:36.227359    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:36.761258 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:36.761227    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:37:37.093546 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:37.093454    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:37.094504 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:37.094483    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:47.596528 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.596463    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq" podUID="41f8d2ed-fe68-4896-90fc-79de7a899a29" containerName="main" containerID="cri-o://ae588c1dc03a2fb884ce8c5e0db80a13887b109d4448e143b54f33642fa02f14" gracePeriod=45
Sep 11 14:37:47.877652 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.877626    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:37:47.965127 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.965086    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-tmp-dir\") pod \"41f8d2ed-fe68-4896-90fc-79de7a899a29\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") "
Sep 11 14:37:47.965127 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.965135    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-model-cache\") pod \"41f8d2ed-fe68-4896-90fc-79de7a899a29\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") "
Sep 11 14:37:47.965399 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.965165    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-dshm\") pod \"41f8d2ed-fe68-4896-90fc-79de7a899a29\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") "
Sep 11 14:37:47.965399 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.965186    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41f8d2ed-fe68-4896-90fc-79de7a899a29-tls-certs\") pod \"41f8d2ed-fe68-4896-90fc-79de7a899a29\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") "
Sep 11 14:37:47.965399 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.965201    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-home\") pod \"41f8d2ed-fe68-4896-90fc-79de7a899a29\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") "
Sep 11 14:37:47.965399 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.965290    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xjgz\" (UniqueName: \"kubernetes.io/projected/41f8d2ed-fe68-4896-90fc-79de7a899a29-kube-api-access-7xjgz\") pod \"41f8d2ed-fe68-4896-90fc-79de7a899a29\" (UID: \"41f8d2ed-fe68-4896-90fc-79de7a899a29\") "
Sep 11 14:37:47.965399 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.965316    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "41f8d2ed-fe68-4896-90fc-79de7a899a29" (UID: "41f8d2ed-fe68-4896-90fc-79de7a899a29"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:37:47.965677 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.965452    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-tmp-dir\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:47.965677 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.965662    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-model-cache" (OuterVolumeSpecName: "model-cache") pod "41f8d2ed-fe68-4896-90fc-79de7a899a29" (UID: "41f8d2ed-fe68-4896-90fc-79de7a899a29"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:37:47.965793 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.965752    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-home" (OuterVolumeSpecName: "home") pod "41f8d2ed-fe68-4896-90fc-79de7a899a29" (UID: "41f8d2ed-fe68-4896-90fc-79de7a899a29"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:37:47.967526 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.967503    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-dshm" (OuterVolumeSpecName: "dshm") pod "41f8d2ed-fe68-4896-90fc-79de7a899a29" (UID: "41f8d2ed-fe68-4896-90fc-79de7a899a29"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:37:47.967788 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.967767    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41f8d2ed-fe68-4896-90fc-79de7a899a29-kube-api-access-7xjgz" (OuterVolumeSpecName: "kube-api-access-7xjgz") pod "41f8d2ed-fe68-4896-90fc-79de7a899a29" (UID: "41f8d2ed-fe68-4896-90fc-79de7a899a29"). InnerVolumeSpecName "kube-api-access-7xjgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:37:47.968013 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:47.967995    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f8d2ed-fe68-4896-90fc-79de7a899a29-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "41f8d2ed-fe68-4896-90fc-79de7a899a29" (UID: "41f8d2ed-fe68-4896-90fc-79de7a899a29"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:37:48.066187 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.066153    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xjgz\" (UniqueName: \"kubernetes.io/projected/41f8d2ed-fe68-4896-90fc-79de7a899a29-kube-api-access-7xjgz\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:48.066187 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.066181    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-model-cache\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:48.066187 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.066193    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-dshm\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:48.066425 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.066201    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/41f8d2ed-fe68-4896-90fc-79de7a899a29-tls-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:48.066425 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.066209    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/41f8d2ed-fe68-4896-90fc-79de7a899a29-home\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:37:48.176897 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.176836    2569 generic.go:356] "Generic (PLEG): container finished" podID="41f8d2ed-fe68-4896-90fc-79de7a899a29" containerID="ae588c1dc03a2fb884ce8c5e0db80a13887b109d4448e143b54f33642fa02f14" exitCode=0
Sep 11 14:37:48.177091 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.176910    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"
Sep 11 14:37:48.177091 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.176916    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq" event={"ID":"41f8d2ed-fe68-4896-90fc-79de7a899a29","Type":"ContainerDied","Data":"ae588c1dc03a2fb884ce8c5e0db80a13887b109d4448e143b54f33642fa02f14"}
Sep 11 14:37:48.177091 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.176968    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq" event={"ID":"41f8d2ed-fe68-4896-90fc-79de7a899a29","Type":"ContainerDied","Data":"3216f753b15efd08cf7ed4566c4728c1a57db81234887c979aead2736fe147b1"}
Sep 11 14:37:48.177091 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.176990    2569 scope.go:117] "RemoveContainer" containerID="ae588c1dc03a2fb884ce8c5e0db80a13887b109d4448e143b54f33642fa02f14"
Sep 11 14:37:48.186496 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.186480    2569 scope.go:117] "RemoveContainer" containerID="ae588c1dc03a2fb884ce8c5e0db80a13887b109d4448e143b54f33642fa02f14"
Sep 11 14:37:48.186771 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:37:48.186751    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae588c1dc03a2fb884ce8c5e0db80a13887b109d4448e143b54f33642fa02f14\": container with ID starting with ae588c1dc03a2fb884ce8c5e0db80a13887b109d4448e143b54f33642fa02f14 not found: ID does not exist" containerID="ae588c1dc03a2fb884ce8c5e0db80a13887b109d4448e143b54f33642fa02f14"
Sep 11 14:37:48.186826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.186781    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae588c1dc03a2fb884ce8c5e0db80a13887b109d4448e143b54f33642fa02f14"} err="failed to get container status \"ae588c1dc03a2fb884ce8c5e0db80a13887b109d4448e143b54f33642fa02f14\": rpc error: code = NotFound desc = could not find container \"ae588c1dc03a2fb884ce8c5e0db80a13887b109d4448e143b54f33642fa02f14\": container with ID starting with ae588c1dc03a2fb884ce8c5e0db80a13887b109d4448e143b54f33642fa02f14 not found: ID does not exist"
Sep 11 14:37:48.217785 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.217757    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"]
Sep 11 14:37:48.221846 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.221824    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-d4444b/test-model-d4444b-kserve-fdc45fbdf-ghhdq"]
Sep 11 14:37:48.270971 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:48.270932    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41f8d2ed-fe68-4896-90fc-79de7a899a29" path="/var/lib/kubelet/pods/41f8d2ed-fe68-4896-90fc-79de7a899a29/volumes"
Sep 11 14:37:50.374137 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:50.374084    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:37:53.135076 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:53.135036    2569 patch_prober.go:28] interesting pod/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 14:37:53.135541 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:53.135100    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 14:37:54.213073 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:54.213040    2569 generic.go:356] "Generic (PLEG): container finished" podID="8618530b-afb2-4031-8706-09adc63446d2" containerID="cd9c9ca9637e6d4d4816411bb398d07a320ea184a9c4a92a821edf9d62c4e6c6" exitCode=0
Sep 11 14:37:54.213456 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:54.213113    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" event={"ID":"8618530b-afb2-4031-8706-09adc63446d2","Type":"ContainerDied","Data":"cd9c9ca9637e6d4d4816411bb398d07a320ea184a9c4a92a821edf9d62c4e6c6"}
Sep 11 14:37:54.213528 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:54.213513    2569 scope.go:117] "RemoveContainer" containerID="cd9c9ca9637e6d4d4816411bb398d07a320ea184a9c4a92a821edf9d62c4e6c6"
Sep 11 14:37:54.214610 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:54.214579    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:37:54.214691 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:54.214677    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:37:54.214732 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:54.214712    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:37:55.219950 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:55.219914    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" event={"ID":"8618530b-afb2-4031-8706-09adc63446d2","Type":"ContainerStarted","Data":"64eb8879d756fccb9aeaca7d09015341c02e45dcac738cfc0010c09231415337"}
Sep 11 14:37:55.222416 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:55.222398    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:37:55.222615 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:55.222594    2569 patch_prober.go:28] interesting pod/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 14:37:55.222668 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:55.222652    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 14:37:56.222094 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:56.222052    2569 patch_prober.go:28] interesting pod/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 14:37:56.222530 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:56.222116    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 14:37:57.195448 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:57.195416    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"]
Sep 11 14:37:57.195657 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:57.195635    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v" podUID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerName="istio-proxy" containerID="cri-o://b24ad8ceabb84d09569359fe449a6f8a0ddeeb731418a7ed880a3ccc0e5ebcf9" gracePeriod=30
Sep 11 14:37:57.221617 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:57.221587    2569 patch_prober.go:28] interesting pod/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 14:37:57.221750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:57.221648    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 14:37:58.221988 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:58.221951    2569 patch_prober.go:28] interesting pod/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 14:37:58.222380 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:58.222008    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 14:37:59.222548 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:59.222509    2569 patch_prober.go:28] interesting pod/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 14:37:59.223049 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:37:59.222573    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 14:38:00.222550 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:00.222512    2569 patch_prober.go:28] interesting pod/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 11 14:38:00.222985 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:00.222570    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 11 14:38:01.225288 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:01.225257    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:38:01.225735 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:01.225547    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:38:01.226371 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:01.226352    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:38:02.436964 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.436932    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:38:02.497203 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497123    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-workload-socket\") pod \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") "
Sep 11 14:38:02.497203 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497166    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-credential-socket\") pod \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") "
Sep 11 14:38:02.497203 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497186    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-token\") pod \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") "
Sep 11 14:38:02.497459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497212    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-envoy\") pod \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") "
Sep 11 14:38:02.497459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497235    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-workload-certs\") pod \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") "
Sep 11 14:38:02.497459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497337    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-data\") pod \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") "
Sep 11 14:38:02.497459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497366    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istiod-ca-cert\") pod \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") "
Sep 11 14:38:02.497459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497429    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-podinfo\") pod \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") "
Sep 11 14:38:02.497459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497438    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "412d77cc-45a0-4b12-a76c-095dec3aaeb6" (UID: "412d77cc-45a0-4b12-a76c-095dec3aaeb6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:02.497459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497453    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "412d77cc-45a0-4b12-a76c-095dec3aaeb6" (UID: "412d77cc-45a0-4b12-a76c-095dec3aaeb6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:02.497813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497542    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "412d77cc-45a0-4b12-a76c-095dec3aaeb6" (UID: "412d77cc-45a0-4b12-a76c-095dec3aaeb6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:02.497813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497628    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-data" (OuterVolumeSpecName: "istio-data") pod "412d77cc-45a0-4b12-a76c-095dec3aaeb6" (UID: "412d77cc-45a0-4b12-a76c-095dec3aaeb6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:02.497813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497755    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "412d77cc-45a0-4b12-a76c-095dec3aaeb6" (UID: "412d77cc-45a0-4b12-a76c-095dec3aaeb6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:38:02.497813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497759    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-workload-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:02.497813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497802    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-credential-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:02.498049 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497818    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-workload-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:02.498049 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.497831    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-data\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:02.499572 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.499541    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "412d77cc-45a0-4b12-a76c-095dec3aaeb6" (UID: "412d77cc-45a0-4b12-a76c-095dec3aaeb6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:02.499679 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.499569    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "412d77cc-45a0-4b12-a76c-095dec3aaeb6" (UID: "412d77cc-45a0-4b12-a76c-095dec3aaeb6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 14:38:02.499857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.499836    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-token" (OuterVolumeSpecName: "istio-token") pod "412d77cc-45a0-4b12-a76c-095dec3aaeb6" (UID: "412d77cc-45a0-4b12-a76c-095dec3aaeb6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:38:02.598169 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.598141    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7l5rc\" (UniqueName: \"kubernetes.io/projected/412d77cc-45a0-4b12-a76c-095dec3aaeb6-kube-api-access-7l5rc\") pod \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\" (UID: \"412d77cc-45a0-4b12-a76c-095dec3aaeb6\") "
Sep 11 14:38:02.598332 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.598322    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-podinfo\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:02.598373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.598336    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-token\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:02.598373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.598344    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istio-envoy\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:02.598373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.598352    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/412d77cc-45a0-4b12-a76c-095dec3aaeb6-istiod-ca-cert\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:02.600283 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.600257    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/412d77cc-45a0-4b12-a76c-095dec3aaeb6-kube-api-access-7l5rc" (OuterVolumeSpecName: "kube-api-access-7l5rc") pod "412d77cc-45a0-4b12-a76c-095dec3aaeb6" (UID: "412d77cc-45a0-4b12-a76c-095dec3aaeb6"). InnerVolumeSpecName "kube-api-access-7l5rc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:38:02.699481 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:02.699445    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l5rc\" (UniqueName: \"kubernetes.io/projected/412d77cc-45a0-4b12-a76c-095dec3aaeb6-kube-api-access-7l5rc\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:03.283188 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.283152    2569 generic.go:356] "Generic (PLEG): container finished" podID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerID="b24ad8ceabb84d09569359fe449a6f8a0ddeeb731418a7ed880a3ccc0e5ebcf9" exitCode=0
Sep 11 14:38:03.283188 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.283192    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v" event={"ID":"412d77cc-45a0-4b12-a76c-095dec3aaeb6","Type":"ContainerDied","Data":"b24ad8ceabb84d09569359fe449a6f8a0ddeeb731418a7ed880a3ccc0e5ebcf9"}
Sep 11 14:38:03.283398 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.283200    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"
Sep 11 14:38:03.283398 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.283235    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v" event={"ID":"412d77cc-45a0-4b12-a76c-095dec3aaeb6","Type":"ContainerDied","Data":"44c6f7614025a9b713e9fecf09f017b36d7f13eb6595f75bc5427ca0effe9791"}
Sep 11 14:38:03.283398 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.283255    2569 scope.go:117] "RemoveContainer" containerID="b24ad8ceabb84d09569359fe449a6f8a0ddeeb731418a7ed880a3ccc0e5ebcf9"
Sep 11 14:38:03.291817 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.291797    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm"]
Sep 11 14:38:03.292227 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.292209    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f8d2ed-fe68-4896-90fc-79de7a899a29" containerName="main"
Sep 11 14:38:03.292277 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.292230    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f8d2ed-fe68-4896-90fc-79de7a899a29" containerName="main"
Sep 11 14:38:03.292277 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.292251    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerName="istio-proxy"
Sep 11 14:38:03.292277 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.292256    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerName="istio-proxy"
Sep 11 14:38:03.292277 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.292263    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerName="istio-proxy"
Sep 11 14:38:03.292277 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.292268    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerName="istio-proxy"
Sep 11 14:38:03.292424 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.292324    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerName="istio-proxy"
Sep 11 14:38:03.292424 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.292331    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" containerName="istio-proxy"
Sep 11 14:38:03.292424 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.292337    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f8d2ed-fe68-4896-90fc-79de7a899a29" containerName="main"
Sep 11 14:38:03.293081 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.293066    2569 scope.go:117] "RemoveContainer" containerID="f0679f145ac95dae66bdc903b01aeb60e2bb2b67d7b4139d591dc0eca00fbcd6"
Sep 11 14:38:03.296431 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.296412    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm"
Sep 11 14:38:03.299428 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.299410    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:38:03.300230 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.300213    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:38:03.301394 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.301378    2569 scope.go:117] "RemoveContainer" containerID="b24ad8ceabb84d09569359fe449a6f8a0ddeeb731418a7ed880a3ccc0e5ebcf9"
Sep 11 14:38:03.301674 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:38:03.301652    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b24ad8ceabb84d09569359fe449a6f8a0ddeeb731418a7ed880a3ccc0e5ebcf9\": container with ID starting with b24ad8ceabb84d09569359fe449a6f8a0ddeeb731418a7ed880a3ccc0e5ebcf9 not found: ID does not exist" containerID="b24ad8ceabb84d09569359fe449a6f8a0ddeeb731418a7ed880a3ccc0e5ebcf9"
Sep 11 14:38:03.301725 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.301683    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b24ad8ceabb84d09569359fe449a6f8a0ddeeb731418a7ed880a3ccc0e5ebcf9"} err="failed to get container status \"b24ad8ceabb84d09569359fe449a6f8a0ddeeb731418a7ed880a3ccc0e5ebcf9\": rpc error: code = NotFound desc = could not find container \"b24ad8ceabb84d09569359fe449a6f8a0ddeeb731418a7ed880a3ccc0e5ebcf9\": container with ID starting with b24ad8ceabb84d09569359fe449a6f8a0ddeeb731418a7ed880a3ccc0e5ebcf9 not found: ID does not exist"
Sep 11 14:38:03.301725 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.301700    2569 scope.go:117] "RemoveContainer" containerID="f0679f145ac95dae66bdc903b01aeb60e2bb2b67d7b4139d591dc0eca00fbcd6"
Sep 11 14:38:03.302027 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:38:03.302007    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0679f145ac95dae66bdc903b01aeb60e2bb2b67d7b4139d591dc0eca00fbcd6\": container with ID starting with f0679f145ac95dae66bdc903b01aeb60e2bb2b67d7b4139d591dc0eca00fbcd6 not found: ID does not exist" containerID="f0679f145ac95dae66bdc903b01aeb60e2bb2b67d7b4139d591dc0eca00fbcd6"
Sep 11 14:38:03.302095 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.302034    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0679f145ac95dae66bdc903b01aeb60e2bb2b67d7b4139d591dc0eca00fbcd6"} err="failed to get container status \"f0679f145ac95dae66bdc903b01aeb60e2bb2b67d7b4139d591dc0eca00fbcd6\": rpc error: code = NotFound desc = could not find container \"f0679f145ac95dae66bdc903b01aeb60e2bb2b67d7b4139d591dc0eca00fbcd6\": container with ID starting with f0679f145ac95dae66bdc903b01aeb60e2bb2b67d7b4139d591dc0eca00fbcd6 not found: ID does not exist"
Sep 11 14:38:03.305507 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.305487    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cf7087-4d3f-486f-bca6-08f830430719-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-210be13f-9hlvm\" (UID: \"f7cf7087-4d3f-486f-bca6-08f830430719\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm"
Sep 11 14:38:03.311211 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.311187    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm"]
Sep 11 14:38:03.321986 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.321966    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"]
Sep 11 14:38:03.336302 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.336273    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d4444b-openshift-default-595fc4fd94-tkn5v"]
Sep 11 14:38:03.406909 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.406865    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cf7087-4d3f-486f-bca6-08f830430719-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-210be13f-9hlvm\" (UID: \"f7cf7087-4d3f-486f-bca6-08f830430719\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm"
Sep 11 14:38:03.407500 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.407475    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cf7087-4d3f-486f-bca6-08f830430719-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-210be13f-9hlvm\" (UID: \"f7cf7087-4d3f-486f-bca6-08f830430719\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm"
Sep 11 14:38:03.607181 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.607089    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm"
Sep 11 14:38:03.901387 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:03.901359    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm"]
Sep 11 14:38:03.902674 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:38:03.902635    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7cf7087_4d3f_486f_bca6_08f830430719.slice/crio-9d24540eeeeb5f5bbc19f2829435c9788877fd5728a44ff64ed49ce20b775ad9 WatchSource:0}: Error finding container 9d24540eeeeb5f5bbc19f2829435c9788877fd5728a44ff64ed49ce20b775ad9: Status 404 returned error can't find the container with id 9d24540eeeeb5f5bbc19f2829435c9788877fd5728a44ff64ed49ce20b775ad9
Sep 11 14:38:04.270938 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:04.270900    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="412d77cc-45a0-4b12-a76c-095dec3aaeb6" path="/var/lib/kubelet/pods/412d77cc-45a0-4b12-a76c-095dec3aaeb6/volumes"
Sep 11 14:38:04.290400 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:04.290367    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm" event={"ID":"f7cf7087-4d3f-486f-bca6-08f830430719","Type":"ContainerStarted","Data":"6134b2deda93e5b602ef9ecee4338b869306f62a403db4d7add83d3ac5ae1492"}
Sep 11 14:38:04.290541 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:04.290430    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm" event={"ID":"f7cf7087-4d3f-486f-bca6-08f830430719","Type":"ContainerStarted","Data":"9d24540eeeeb5f5bbc19f2829435c9788877fd5728a44ff64ed49ce20b775ad9"}
Sep 11 14:38:04.328364 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:04.328318    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm" podStartSLOduration=1.3283039460000001 podStartE2EDuration="1.328303946s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:38:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:38:04.327137415 +0000 UTC m=+1380.541723077" watchObservedRunningTime="2026-09-11 14:38:04.328303946 +0000 UTC m=+1380.542889607"
Sep 11 14:38:05.297949 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:05.297908    2569 generic.go:356] "Generic (PLEG): container finished" podID="f7cf7087-4d3f-486f-bca6-08f830430719" containerID="6134b2deda93e5b602ef9ecee4338b869306f62a403db4d7add83d3ac5ae1492" exitCode=0
Sep 11 14:38:05.298324 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:05.297999    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm" event={"ID":"f7cf7087-4d3f-486f-bca6-08f830430719","Type":"ContainerDied","Data":"6134b2deda93e5b602ef9ecee4338b869306f62a403db4d7add83d3ac5ae1492"}
Sep 11 14:38:06.439428 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:06.439400    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm"
Sep 11 14:38:06.535859 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:06.535831    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cf7087-4d3f-486f-bca6-08f830430719-maas-api-service-ca\") pod \"f7cf7087-4d3f-486f-bca6-08f830430719\" (UID: \"f7cf7087-4d3f-486f-bca6-08f830430719\") "
Sep 11 14:38:06.536165 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:06.536145    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7cf7087-4d3f-486f-bca6-08f830430719-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f7cf7087-4d3f-486f-bca6-08f830430719" (UID: "f7cf7087-4d3f-486f-bca6-08f830430719"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:38:06.636925 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:06.636829    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f7cf7087-4d3f-486f-bca6-08f830430719-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:07.310526 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:07.310495    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm"
Sep 11 14:38:07.310713 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:07.310535    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm" event={"ID":"f7cf7087-4d3f-486f-bca6-08f830430719","Type":"ContainerDied","Data":"9d24540eeeeb5f5bbc19f2829435c9788877fd5728a44ff64ed49ce20b775ad9"}
Sep 11 14:38:07.310713 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:07.310584    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d24540eeeeb5f5bbc19f2829435c9788877fd5728a44ff64ed49ce20b775ad9"
Sep 11 14:38:11.514196 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:11.514157    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:38:11.540488 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:11.540455    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm"]
Sep 11 14:38:11.546696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:11.546673    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-210be13f-9hlvm"]
Sep 11 14:38:12.271007 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:12.270971    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7cf7087-4d3f-486f-bca6-08f830430719" path="/var/lib/kubelet/pods/f7cf7087-4d3f-486f-bca6-08f830430719/volumes"
Sep 11 14:38:16.703315 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:16.703283    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"]
Sep 11 14:38:16.703700 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:16.703474    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerName="istio-proxy" containerID="cri-o://9ab47873550ef7dd7a8f6b0e0c9250a229afdf5020f7b16b8d7933fb508f40ac" gracePeriod=30
Sep 11 14:38:18.602253 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:18.602220    2569 patch_prober.go:28] interesting pod/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 14:38:18.602645 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:18.602288    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 14:38:20.252705 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:20.252669    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:38:21.953418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:21.953389    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"]
Sep 11 14:38:21.953741 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:21.953605    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy" containerID="cri-o://64eb8879d756fccb9aeaca7d09015341c02e45dcac738cfc0010c09231415337" gracePeriod=30
Sep 11 14:38:21.960306 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:21.960284    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:38:22.073140 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073060    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9r7tq\" (UniqueName: \"kubernetes.io/projected/9dd79113-8d59-4e44-872c-f7692fe708a8-kube-api-access-9r7tq\") pod \"9dd79113-8d59-4e44-872c-f7692fe708a8\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") "
Sep 11 14:38:22.073140 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073095    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-workload-certs\") pod \"9dd79113-8d59-4e44-872c-f7692fe708a8\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") "
Sep 11 14:38:22.073140 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073120    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-podinfo\") pod \"9dd79113-8d59-4e44-872c-f7692fe708a8\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") "
Sep 11 14:38:22.073418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073166    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-credential-socket\") pod \"9dd79113-8d59-4e44-872c-f7692fe708a8\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") "
Sep 11 14:38:22.073418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073192    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-data\") pod \"9dd79113-8d59-4e44-872c-f7692fe708a8\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") "
Sep 11 14:38:22.073418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073258    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-envoy\") pod \"9dd79113-8d59-4e44-872c-f7692fe708a8\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") "
Sep 11 14:38:22.073418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073290    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-workload-socket\") pod \"9dd79113-8d59-4e44-872c-f7692fe708a8\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") "
Sep 11 14:38:22.073418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073322    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-token\") pod \"9dd79113-8d59-4e44-872c-f7692fe708a8\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") "
Sep 11 14:38:22.073418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073365    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9dd79113-8d59-4e44-872c-f7692fe708a8" (UID: "9dd79113-8d59-4e44-872c-f7692fe708a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:22.073418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073379    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd79113-8d59-4e44-872c-f7692fe708a8-istiod-ca-cert\") pod \"9dd79113-8d59-4e44-872c-f7692fe708a8\" (UID: \"9dd79113-8d59-4e44-872c-f7692fe708a8\") "
Sep 11 14:38:22.073774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073541    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "9dd79113-8d59-4e44-872c-f7692fe708a8" (UID: "9dd79113-8d59-4e44-872c-f7692fe708a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:22.073774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073700    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dd79113-8d59-4e44-872c-f7692fe708a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9dd79113-8d59-4e44-872c-f7692fe708a8" (UID: "9dd79113-8d59-4e44-872c-f7692fe708a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:38:22.073774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073708    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9dd79113-8d59-4e44-872c-f7692fe708a8" (UID: "9dd79113-8d59-4e44-872c-f7692fe708a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:22.073774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073749    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-workload-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:22.073774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073767    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-data\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:22.074239 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.073782    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9dd79113-8d59-4e44-872c-f7692fe708a8" (UID: "9dd79113-8d59-4e44-872c-f7692fe708a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:22.075667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.075627    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9dd79113-8d59-4e44-872c-f7692fe708a8" (UID: "9dd79113-8d59-4e44-872c-f7692fe708a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 14:38:22.075667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.075641    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9dd79113-8d59-4e44-872c-f7692fe708a8" (UID: "9dd79113-8d59-4e44-872c-f7692fe708a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:22.075667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.075639    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd79113-8d59-4e44-872c-f7692fe708a8-kube-api-access-9r7tq" (OuterVolumeSpecName: "kube-api-access-9r7tq") pod "9dd79113-8d59-4e44-872c-f7692fe708a8" (UID: "9dd79113-8d59-4e44-872c-f7692fe708a8"). InnerVolumeSpecName "kube-api-access-9r7tq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:38:22.076392 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.076375    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "9dd79113-8d59-4e44-872c-f7692fe708a8" (UID: "9dd79113-8d59-4e44-872c-f7692fe708a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:38:22.174410 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.174384    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dd79113-8d59-4e44-872c-f7692fe708a8-istiod-ca-cert\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:22.174410 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.174407    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9r7tq\" (UniqueName: \"kubernetes.io/projected/9dd79113-8d59-4e44-872c-f7692fe708a8-kube-api-access-9r7tq\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:22.174410 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.174417    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-podinfo\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:22.174623 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.174426    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-credential-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:22.174623 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.174435    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-envoy\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:22.174623 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.174446    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dd79113-8d59-4e44-872c-f7692fe708a8-workload-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:22.174623 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.174453    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dd79113-8d59-4e44-872c-f7692fe708a8-istio-token\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:22.384738 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.384647    2569 generic.go:356] "Generic (PLEG): container finished" podID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerID="9ab47873550ef7dd7a8f6b0e0c9250a229afdf5020f7b16b8d7933fb508f40ac" exitCode=0
Sep 11 14:38:22.384738 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.384700    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"
Sep 11 14:38:22.384949 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.384696    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" event={"ID":"9dd79113-8d59-4e44-872c-f7692fe708a8","Type":"ContainerDied","Data":"9ab47873550ef7dd7a8f6b0e0c9250a229afdf5020f7b16b8d7933fb508f40ac"}
Sep 11 14:38:22.384949 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.384828    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w" event={"ID":"9dd79113-8d59-4e44-872c-f7692fe708a8","Type":"ContainerDied","Data":"e0236abb9d08e6f98a27df0ec7f8e002f717f206a74bf40b789aee2945e51caa"}
Sep 11 14:38:22.384949 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.384856    2569 scope.go:117] "RemoveContainer" containerID="9ab47873550ef7dd7a8f6b0e0c9250a229afdf5020f7b16b8d7933fb508f40ac"
Sep 11 14:38:22.393317 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.393299    2569 scope.go:117] "RemoveContainer" containerID="80a38b78473e792fc77c71954ec1ca52990427b13af13c16431b622b21b0d16f"
Sep 11 14:38:22.402957 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.402937    2569 scope.go:117] "RemoveContainer" containerID="9ab47873550ef7dd7a8f6b0e0c9250a229afdf5020f7b16b8d7933fb508f40ac"
Sep 11 14:38:22.403332 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:38:22.403312    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ab47873550ef7dd7a8f6b0e0c9250a229afdf5020f7b16b8d7933fb508f40ac\": container with ID starting with 9ab47873550ef7dd7a8f6b0e0c9250a229afdf5020f7b16b8d7933fb508f40ac not found: ID does not exist" containerID="9ab47873550ef7dd7a8f6b0e0c9250a229afdf5020f7b16b8d7933fb508f40ac"
Sep 11 14:38:22.403418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.403344    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ab47873550ef7dd7a8f6b0e0c9250a229afdf5020f7b16b8d7933fb508f40ac"} err="failed to get container status \"9ab47873550ef7dd7a8f6b0e0c9250a229afdf5020f7b16b8d7933fb508f40ac\": rpc error: code = NotFound desc = could not find container \"9ab47873550ef7dd7a8f6b0e0c9250a229afdf5020f7b16b8d7933fb508f40ac\": container with ID starting with 9ab47873550ef7dd7a8f6b0e0c9250a229afdf5020f7b16b8d7933fb508f40ac not found: ID does not exist"
Sep 11 14:38:22.403418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.403369    2569 scope.go:117] "RemoveContainer" containerID="80a38b78473e792fc77c71954ec1ca52990427b13af13c16431b622b21b0d16f"
Sep 11 14:38:22.403646 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:38:22.403627    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80a38b78473e792fc77c71954ec1ca52990427b13af13c16431b622b21b0d16f\": container with ID starting with 80a38b78473e792fc77c71954ec1ca52990427b13af13c16431b622b21b0d16f not found: ID does not exist" containerID="80a38b78473e792fc77c71954ec1ca52990427b13af13c16431b622b21b0d16f"
Sep 11 14:38:22.403700 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.403655    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80a38b78473e792fc77c71954ec1ca52990427b13af13c16431b622b21b0d16f"} err="failed to get container status \"80a38b78473e792fc77c71954ec1ca52990427b13af13c16431b622b21b0d16f\": rpc error: code = NotFound desc = could not find container \"80a38b78473e792fc77c71954ec1ca52990427b13af13c16431b622b21b0d16f\": container with ID starting with 80a38b78473e792fc77c71954ec1ca52990427b13af13c16431b622b21b0d16f not found: ID does not exist"
Sep 11 14:38:22.450746 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.450721    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"]
Sep 11 14:38:22.483084 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:22.483055    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-5b0917-openshift-default-7bf56648b8-ss82w"]
Sep 11 14:38:24.270512 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.270481    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" path="/var/lib/kubelet/pods/9dd79113-8d59-4e44-872c-f7692fe708a8/volumes"
Sep 11 14:38:24.662830 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.662740    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"]
Sep 11 14:38:24.663211 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.663192    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerName="istio-proxy"
Sep 11 14:38:24.663303 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.663214    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerName="istio-proxy"
Sep 11 14:38:24.663303 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.663232    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7cf7087-4d3f-486f-bca6-08f830430719" containerName="revoke-keys"
Sep 11 14:38:24.663303 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.663240    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7cf7087-4d3f-486f-bca6-08f830430719" containerName="revoke-keys"
Sep 11 14:38:24.663459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.663320    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerName="istio-proxy"
Sep 11 14:38:24.663459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.663334    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerName="istio-proxy"
Sep 11 14:38:24.663459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.663348    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7cf7087-4d3f-486f-bca6-08f830430719" containerName="revoke-keys"
Sep 11 14:38:24.667430 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.667409    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"
Sep 11 14:38:24.671396 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.671379    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-8feb68\""
Sep 11 14:38:24.671538 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.671522    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-8feb68-dockercfg-v4tcj\""
Sep 11 14:38:24.721199 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.721172    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"]
Sep 11 14:38:24.799477 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.799447    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llchk\" (UniqueName: \"kubernetes.io/projected/ed53c401-1274-4a61-a11a-71c0b639f1e1-kube-api-access-llchk\") pod \"payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb\" (UID: \"ed53c401-1274-4a61-a11a-71c0b639f1e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"
Sep 11 14:38:24.799622 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.799570    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed53c401-1274-4a61-a11a-71c0b639f1e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb\" (UID: \"ed53c401-1274-4a61-a11a-71c0b639f1e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"
Sep 11 14:38:24.900195 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.900160    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed53c401-1274-4a61-a11a-71c0b639f1e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb\" (UID: \"ed53c401-1274-4a61-a11a-71c0b639f1e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"
Sep 11 14:38:24.900372 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.900224    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llchk\" (UniqueName: \"kubernetes.io/projected/ed53c401-1274-4a61-a11a-71c0b639f1e1-kube-api-access-llchk\") pod \"payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb\" (UID: \"ed53c401-1274-4a61-a11a-71c0b639f1e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"
Sep 11 14:38:24.900833 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.900814    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed53c401-1274-4a61-a11a-71c0b639f1e1-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb\" (UID: \"ed53c401-1274-4a61-a11a-71c0b639f1e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"
Sep 11 14:38:24.911274 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.911246    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llchk\" (UniqueName: \"kubernetes.io/projected/ed53c401-1274-4a61-a11a-71c0b639f1e1-kube-api-access-llchk\") pod \"payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb\" (UID: \"ed53c401-1274-4a61-a11a-71c0b639f1e1\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"
Sep 11 14:38:24.977161 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:24.977133    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"
Sep 11 14:38:25.290711 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:25.290687    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"]
Sep 11 14:38:25.293075 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:38:25.293040    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded53c401_1274_4a61_a11a_71c0b639f1e1.slice/crio-dd0e3446b4762dcf80784220704bb28f9540f587a3eede43df4f23ad149e450e WatchSource:0}: Error finding container dd0e3446b4762dcf80784220704bb28f9540f587a3eede43df4f23ad149e450e: Status 404 returned error can't find the container with id dd0e3446b4762dcf80784220704bb28f9540f587a3eede43df4f23ad149e450e
Sep 11 14:38:25.402768 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:25.402573    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb" event={"ID":"ed53c401-1274-4a61-a11a-71c0b639f1e1","Type":"ContainerStarted","Data":"a314508006e15205e2e0c768cd3bce905682d7e4101f43d3291d4cbfbdd2ea8d"}
Sep 11 14:38:25.402768 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:25.402687    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb" event={"ID":"ed53c401-1274-4a61-a11a-71c0b639f1e1","Type":"ContainerStarted","Data":"dd0e3446b4762dcf80784220704bb28f9540f587a3eede43df4f23ad149e450e"}
Sep 11 14:38:25.403745 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:25.403721    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"
Sep 11 14:38:25.452403 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:25.452355    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb" podStartSLOduration=1.452339803 podStartE2EDuration="1.452339803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:38:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:38:25.451753923 +0000 UTC m=+1401.666339588" watchObservedRunningTime="2026-09-11 14:38:25.452339803 +0000 UTC m=+1401.666925463"
Sep 11 14:38:27.206691 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.206666    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:38:27.327164 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327085    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bmwnh\" (UniqueName: \"kubernetes.io/projected/8618530b-afb2-4031-8706-09adc63446d2-kube-api-access-bmwnh\") pod \"8618530b-afb2-4031-8706-09adc63446d2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") "
Sep 11 14:38:27.327164 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327118    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8618530b-afb2-4031-8706-09adc63446d2-istio-podinfo\") pod \"8618530b-afb2-4031-8706-09adc63446d2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") "
Sep 11 14:38:27.327164 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327136    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8618530b-afb2-4031-8706-09adc63446d2-istiod-ca-cert\") pod \"8618530b-afb2-4031-8706-09adc63446d2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") "
Sep 11 14:38:27.327164 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327163    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8618530b-afb2-4031-8706-09adc63446d2-istio-token\") pod \"8618530b-afb2-4031-8706-09adc63446d2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") "
Sep 11 14:38:27.327503 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327189    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-workload-certs\") pod \"8618530b-afb2-4031-8706-09adc63446d2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") "
Sep 11 14:38:27.327503 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327220    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-istio-envoy\") pod \"8618530b-afb2-4031-8706-09adc63446d2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") "
Sep 11 14:38:27.327503 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327277    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-credential-socket\") pod \"8618530b-afb2-4031-8706-09adc63446d2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") "
Sep 11 14:38:27.327503 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327333    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-workload-socket\") pod \"8618530b-afb2-4031-8706-09adc63446d2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") "
Sep 11 14:38:27.327503 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327370    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-istio-data\") pod \"8618530b-afb2-4031-8706-09adc63446d2\" (UID: \"8618530b-afb2-4031-8706-09adc63446d2\") "
Sep 11 14:38:27.327763 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327506    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8618530b-afb2-4031-8706-09adc63446d2" (UID: "8618530b-afb2-4031-8706-09adc63446d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:27.327763 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327555    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8618530b-afb2-4031-8706-09adc63446d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8618530b-afb2-4031-8706-09adc63446d2" (UID: "8618530b-afb2-4031-8706-09adc63446d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:38:27.327763 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327708    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8618530b-afb2-4031-8706-09adc63446d2-istiod-ca-cert\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:27.327763 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327708    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "8618530b-afb2-4031-8706-09adc63446d2" (UID: "8618530b-afb2-4031-8706-09adc63446d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:27.327763 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327725    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-workload-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:27.328033 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327864    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8618530b-afb2-4031-8706-09adc63446d2" (UID: "8618530b-afb2-4031-8706-09adc63446d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:27.328104 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.327987    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8618530b-afb2-4031-8706-09adc63446d2" (UID: "8618530b-afb2-4031-8706-09adc63446d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:27.329660 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.329630    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8618530b-afb2-4031-8706-09adc63446d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8618530b-afb2-4031-8706-09adc63446d2" (UID: "8618530b-afb2-4031-8706-09adc63446d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 14:38:27.329789 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.329771    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8618530b-afb2-4031-8706-09adc63446d2" (UID: "8618530b-afb2-4031-8706-09adc63446d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:38:27.329969 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.329942    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8618530b-afb2-4031-8706-09adc63446d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "8618530b-afb2-4031-8706-09adc63446d2" (UID: "8618530b-afb2-4031-8706-09adc63446d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:38:27.330076 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.330060    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8618530b-afb2-4031-8706-09adc63446d2-kube-api-access-bmwnh" (OuterVolumeSpecName: "kube-api-access-bmwnh") pod "8618530b-afb2-4031-8706-09adc63446d2" (UID: "8618530b-afb2-4031-8706-09adc63446d2"). InnerVolumeSpecName "kube-api-access-bmwnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:38:27.414511 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.414481    2569 generic.go:356] "Generic (PLEG): container finished" podID="8618530b-afb2-4031-8706-09adc63446d2" containerID="64eb8879d756fccb9aeaca7d09015341c02e45dcac738cfc0010c09231415337" exitCode=0
Sep 11 14:38:27.414696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.414527    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"
Sep 11 14:38:27.414696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.414564    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" event={"ID":"8618530b-afb2-4031-8706-09adc63446d2","Type":"ContainerDied","Data":"64eb8879d756fccb9aeaca7d09015341c02e45dcac738cfc0010c09231415337"}
Sep 11 14:38:27.414696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.414625    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2" event={"ID":"8618530b-afb2-4031-8706-09adc63446d2","Type":"ContainerDied","Data":"17f9c913e73099b7d60e2c8615b359d8bce0b2f9dfef7b5e558eea81e0769928"}
Sep 11 14:38:27.414696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.414658    2569 scope.go:117] "RemoveContainer" containerID="64eb8879d756fccb9aeaca7d09015341c02e45dcac738cfc0010c09231415337"
Sep 11 14:38:27.424433 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.424416    2569 scope.go:117] "RemoveContainer" containerID="cd9c9ca9637e6d4d4816411bb398d07a320ea184a9c4a92a821edf9d62c4e6c6"
Sep 11 14:38:27.428583 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.428563    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-workload-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:27.428583 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.428584    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-istio-data\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:27.428736 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.428593    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bmwnh\" (UniqueName: \"kubernetes.io/projected/8618530b-afb2-4031-8706-09adc63446d2-kube-api-access-bmwnh\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:27.428736 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.428602    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8618530b-afb2-4031-8706-09adc63446d2-istio-podinfo\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:27.428736 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.428610    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8618530b-afb2-4031-8706-09adc63446d2-istio-token\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:27.428736 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.428617    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-istio-envoy\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:27.428736 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.428624    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8618530b-afb2-4031-8706-09adc63446d2-credential-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:38:27.433034 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.433015    2569 scope.go:117] "RemoveContainer" containerID="64eb8879d756fccb9aeaca7d09015341c02e45dcac738cfc0010c09231415337"
Sep 11 14:38:27.433312 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:38:27.433294    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64eb8879d756fccb9aeaca7d09015341c02e45dcac738cfc0010c09231415337\": container with ID starting with 64eb8879d756fccb9aeaca7d09015341c02e45dcac738cfc0010c09231415337 not found: ID does not exist" containerID="64eb8879d756fccb9aeaca7d09015341c02e45dcac738cfc0010c09231415337"
Sep 11 14:38:27.433358 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.433322    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64eb8879d756fccb9aeaca7d09015341c02e45dcac738cfc0010c09231415337"} err="failed to get container status \"64eb8879d756fccb9aeaca7d09015341c02e45dcac738cfc0010c09231415337\": rpc error: code = NotFound desc = could not find container \"64eb8879d756fccb9aeaca7d09015341c02e45dcac738cfc0010c09231415337\": container with ID starting with 64eb8879d756fccb9aeaca7d09015341c02e45dcac738cfc0010c09231415337 not found: ID does not exist"
Sep 11 14:38:27.433358 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.433339    2569 scope.go:117] "RemoveContainer" containerID="cd9c9ca9637e6d4d4816411bb398d07a320ea184a9c4a92a821edf9d62c4e6c6"
Sep 11 14:38:27.433571 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:38:27.433556    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd9c9ca9637e6d4d4816411bb398d07a320ea184a9c4a92a821edf9d62c4e6c6\": container with ID starting with cd9c9ca9637e6d4d4816411bb398d07a320ea184a9c4a92a821edf9d62c4e6c6 not found: ID does not exist" containerID="cd9c9ca9637e6d4d4816411bb398d07a320ea184a9c4a92a821edf9d62c4e6c6"
Sep 11 14:38:27.433613 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.433574    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd9c9ca9637e6d4d4816411bb398d07a320ea184a9c4a92a821edf9d62c4e6c6"} err="failed to get container status \"cd9c9ca9637e6d4d4816411bb398d07a320ea184a9c4a92a821edf9d62c4e6c6\": rpc error: code = NotFound desc = could not find container \"cd9c9ca9637e6d4d4816411bb398d07a320ea184a9c4a92a821edf9d62c4e6c6\": container with ID starting with cd9c9ca9637e6d4d4816411bb398d07a320ea184a9c4a92a821edf9d62c4e6c6 not found: ID does not exist"
Sep 11 14:38:27.442095 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.442076    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"]
Sep 11 14:38:27.446620 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:27.446600    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-210be13f-openshift-default-84684d8cb-hbtr2"]
Sep 11 14:38:28.270490 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:28.270458    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8618530b-afb2-4031-8706-09adc63446d2" path="/var/lib/kubelet/pods/8618530b-afb2-4031-8706-09adc63446d2/volumes"
Sep 11 14:38:37.417003 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:37.416974    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"
Sep 11 14:38:40.802172 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:40.802131    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:38:45.150318 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.150286    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"]
Sep 11 14:38:45.150799 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.150781    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy"
Sep 11 14:38:45.150905 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.150803    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy"
Sep 11 14:38:45.150905 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.150825    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerName="istio-proxy"
Sep 11 14:38:45.150905 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.150834    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dd79113-8d59-4e44-872c-f7692fe708a8" containerName="istio-proxy"
Sep 11 14:38:45.150905 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.150852    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy"
Sep 11 14:38:45.150905 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.150861    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy"
Sep 11 14:38:45.151170 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.151004    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy"
Sep 11 14:38:45.153937 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.153919    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.163114 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.163096    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-28858c-openshift-default-dockercfg-4nwlz\""
Sep 11 14:38:45.182235 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.182211    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"]
Sep 11 14:38:45.184431 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.184405    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39f88921-4254-4359-bb33-f3d76a3e7027-istio-podinfo\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.184530 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.184448    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v7rd\" (UniqueName: \"kubernetes.io/projected/39f88921-4254-4359-bb33-f3d76a3e7027-kube-api-access-8v7rd\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.184584 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.184532    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39f88921-4254-4359-bb33-f3d76a3e7027-istiod-ca-cert\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.184692 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.184633    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-workload-certs\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.184692 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.184682    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-istio-data\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.184766 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.184719    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-workload-socket\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.184807 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.184785    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39f88921-4254-4359-bb33-f3d76a3e7027-istio-token\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.184843 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.184825    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-istio-envoy\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.184903 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.184868    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-credential-socket\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.285545 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.285492    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39f88921-4254-4359-bb33-f3d76a3e7027-istio-token\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.285545 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.285540    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-istio-envoy\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.285801 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.285578    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-credential-socket\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.285801 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.285633    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39f88921-4254-4359-bb33-f3d76a3e7027-istio-podinfo\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.285801 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.285669    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v7rd\" (UniqueName: \"kubernetes.io/projected/39f88921-4254-4359-bb33-f3d76a3e7027-kube-api-access-8v7rd\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.285801 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.285738    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39f88921-4254-4359-bb33-f3d76a3e7027-istiod-ca-cert\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.286036 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.285824    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-workload-certs\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.286036 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.285865    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-istio-data\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.286036 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.285916    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-workload-socket\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.286316 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.286293    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-workload-socket\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.286717 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.286692    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-credential-socket\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.286826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.286771    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39f88921-4254-4359-bb33-f3d76a3e7027-istiod-ca-cert\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.286826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.286800    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-workload-certs\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.286826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.286820    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-istio-data\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.289116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.289093    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-istio-envoy\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.289581 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.289551    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39f88921-4254-4359-bb33-f3d76a3e7027-istio-podinfo\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.300235 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.300211    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v7rd\" (UniqueName: \"kubernetes.io/projected/39f88921-4254-4359-bb33-f3d76a3e7027-kube-api-access-8v7rd\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.300345 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.300326    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39f88921-4254-4359-bb33-f3d76a3e7027-istio-token\") pod \"e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") " pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.463680 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.463648    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:45.767347 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.767318    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"]
Sep 11 14:38:45.769061 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:38:45.769032    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39f88921_4254_4359_bb33_f3d76a3e7027.slice/crio-d17462822bba3455a79ed60601a17b2dfd79278f36232a67a42d6fd2817599bc WatchSource:0}: Error finding container d17462822bba3455a79ed60601a17b2dfd79278f36232a67a42d6fd2817599bc: Status 404 returned error can't find the container with id d17462822bba3455a79ed60601a17b2dfd79278f36232a67a42d6fd2817599bc
Sep 11 14:38:45.771105 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.771075    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:38:45.771172 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.771144    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:38:45.771213 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:45.771173    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:38:46.510743 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:46.510708    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc" event={"ID":"39f88921-4254-4359-bb33-f3d76a3e7027","Type":"ContainerStarted","Data":"f66c1c7bf57526a32f69e144a5f98bf15086bbebe8051f45f2236915dbf1f561"}
Sep 11 14:38:46.511149 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:46.510763    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc" event={"ID":"39f88921-4254-4359-bb33-f3d76a3e7027","Type":"ContainerStarted","Data":"d17462822bba3455a79ed60601a17b2dfd79278f36232a67a42d6fd2817599bc"}
Sep 11 14:38:46.569042 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:46.568992    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc" podStartSLOduration=1.56897453 podStartE2EDuration="1.56897453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:38:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:38:46.568116306 +0000 UTC m=+1422.782701966" watchObservedRunningTime="2026-09-11 14:38:46.56897453 +0000 UTC m=+1422.783560190"
Sep 11 14:38:47.464800 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:47.464748    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:47.469571 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:47.469547    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:47.516000 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:47.515970    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:47.516832 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:47.516811    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:38:49.205395 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.205361    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"]
Sep 11 14:38:49.205790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.205754    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8618530b-afb2-4031-8706-09adc63446d2" containerName="istio-proxy"
Sep 11 14:38:49.208744 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.208726    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.214147 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.214126    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-977c12-openshift-default-dockercfg-xdt97\""
Sep 11 14:38:49.216066 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.216043    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f91a165-ad35-41cb-966f-431d9d7157f3-istiod-ca-cert\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.216188 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.216077    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-workload-certs\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.216188 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.216100    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpbfx\" (UniqueName: \"kubernetes.io/projected/6f91a165-ad35-41cb-966f-431d9d7157f3-kube-api-access-hpbfx\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.216266 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.216200    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-token\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.216311 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.216294    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-data\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.216356 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.216336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-credential-socket\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.216394 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.216384    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-envoy\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.216449 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.216407    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-podinfo\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.216449 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.216424    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-workload-socket\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.245301 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.245271    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"]
Sep 11 14:38:49.317543 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.317508    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-token\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.317709 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.317556    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-data\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.317790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.317703    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-credential-socket\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.317790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.317775    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-envoy\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.317930 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.317812    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-podinfo\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.317930 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.317844    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-workload-socket\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.317930 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.317917    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-data\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.318093 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.317927    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f91a165-ad35-41cb-966f-431d9d7157f3-istiod-ca-cert\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.318093 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.317971    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-workload-certs\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.318093 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.318010    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpbfx\" (UniqueName: \"kubernetes.io/projected/6f91a165-ad35-41cb-966f-431d9d7157f3-kube-api-access-hpbfx\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.318251 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.318128    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-credential-socket\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.318251 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.318227    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-workload-socket\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.318329 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.318265    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-workload-certs\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.318575 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.318559    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f91a165-ad35-41cb-966f-431d9d7157f3-istiod-ca-cert\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.320352 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.320333    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-envoy\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.320476 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.320453    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-podinfo\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.330572 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.330549    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-token\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.332444 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.332421    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpbfx\" (UniqueName: \"kubernetes.io/projected/6f91a165-ad35-41cb-966f-431d9d7157f3-kube-api-access-hpbfx\") pod \"e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") " pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.519796 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.519711    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:49.834161 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.834136    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"]
Sep 11 14:38:49.836441 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:38:49.836415    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f91a165_ad35_41cb_966f_431d9d7157f3.slice/crio-419bfc4d990c452532d397beca683775cf054300f62f47984b345ab01d088ac2 WatchSource:0}: Error finding container 419bfc4d990c452532d397beca683775cf054300f62f47984b345ab01d088ac2: Status 404 returned error can't find the container with id 419bfc4d990c452532d397beca683775cf054300f62f47984b345ab01d088ac2
Sep 11 14:38:49.838578 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.838545    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:38:49.838663 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.838610    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:38:49.838663 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:49.838637    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:38:50.533301 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:50.533260    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd" event={"ID":"6f91a165-ad35-41cb-966f-431d9d7157f3","Type":"ContainerStarted","Data":"6283c58c89420edb9513659f3b5a57c722e795ab7edee86cbf506cb035a7df8b"}
Sep 11 14:38:50.533790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:50.533327    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd" event={"ID":"6f91a165-ad35-41cb-966f-431d9d7157f3","Type":"ContainerStarted","Data":"419bfc4d990c452532d397beca683775cf054300f62f47984b345ab01d088ac2"}
Sep 11 14:38:50.583513 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:50.583462    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd" podStartSLOduration=1.583445998 podStartE2EDuration="1.583445998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:38:50.582218467 +0000 UTC m=+1426.796804128" watchObservedRunningTime="2026-09-11 14:38:50.583445998 +0000 UTC m=+1426.798031658"
Sep 11 14:38:51.520644 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:51.520606    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:51.527188 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:51.527158    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:51.538219 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:51.538191    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:51.539191 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:51.539168    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:38:52.587591 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:52.587554    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"]
Sep 11 14:38:52.591283 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:52.591264    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"
Sep 11 14:38:52.596128 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:52.596100    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-28858c\""
Sep 11 14:38:52.596128 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:52.596107    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-28858c-dockercfg-2x9sv\""
Sep 11 14:38:52.653183 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:52.653153    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cmgx\" (UniqueName: \"kubernetes.io/projected/c49967f3-c5c9-415b-9b33-5712502b59bd-kube-api-access-8cmgx\") pod \"payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5\" (UID: \"c49967f3-c5c9-415b-9b33-5712502b59bd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"
Sep 11 14:38:52.653319 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:52.653240    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c49967f3-c5c9-415b-9b33-5712502b59bd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5\" (UID: \"c49967f3-c5c9-415b-9b33-5712502b59bd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"
Sep 11 14:38:52.688637 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:52.688609    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"]
Sep 11 14:38:52.754276 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:52.754240    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cmgx\" (UniqueName: \"kubernetes.io/projected/c49967f3-c5c9-415b-9b33-5712502b59bd-kube-api-access-8cmgx\") pod \"payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5\" (UID: \"c49967f3-c5c9-415b-9b33-5712502b59bd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"
Sep 11 14:38:52.754424 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:52.754315    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c49967f3-c5c9-415b-9b33-5712502b59bd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5\" (UID: \"c49967f3-c5c9-415b-9b33-5712502b59bd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"
Sep 11 14:38:52.755052 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:52.755033    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c49967f3-c5c9-415b-9b33-5712502b59bd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5\" (UID: \"c49967f3-c5c9-415b-9b33-5712502b59bd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"
Sep 11 14:38:52.768192 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:52.768159    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cmgx\" (UniqueName: \"kubernetes.io/projected/c49967f3-c5c9-415b-9b33-5712502b59bd-kube-api-access-8cmgx\") pod \"payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5\" (UID: \"c49967f3-c5c9-415b-9b33-5712502b59bd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"
Sep 11 14:38:52.901587 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:52.901511    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"
Sep 11 14:38:53.208851 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:38:53.208822    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc49967f3_c5c9_415b_9b33_5712502b59bd.slice/crio-a2cb86ee3e8d1639f78814a634683b031d9d3d19f039aca0e69d5d1b7852f8e7 WatchSource:0}: Error finding container a2cb86ee3e8d1639f78814a634683b031d9d3d19f039aca0e69d5d1b7852f8e7: Status 404 returned error can't find the container with id a2cb86ee3e8d1639f78814a634683b031d9d3d19f039aca0e69d5d1b7852f8e7
Sep 11 14:38:53.209632 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:53.209551    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"]
Sep 11 14:38:53.549971 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:53.549868    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5" event={"ID":"c49967f3-c5c9-415b-9b33-5712502b59bd","Type":"ContainerStarted","Data":"b51114d02a3015d9468e2b3257ab874eed281cd4a65f1229eb684a65a2a74fb9"}
Sep 11 14:38:53.550116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:53.550087    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"
Sep 11 14:38:53.550161 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:53.550114    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5" event={"ID":"c49967f3-c5c9-415b-9b33-5712502b59bd","Type":"ContainerStarted","Data":"a2cb86ee3e8d1639f78814a634683b031d9d3d19f039aca0e69d5d1b7852f8e7"}
Sep 11 14:38:53.590162 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:53.590108    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5" podStartSLOduration=1.59009342 podStartE2EDuration="1.59009342s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:38:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:38:53.586965341 +0000 UTC m=+1429.801550999" watchObservedRunningTime="2026-09-11 14:38:53.59009342 +0000 UTC m=+1429.804679081"
Sep 11 14:38:55.647416 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:55.647321    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:38:56.079223 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:56.079180    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"]
Sep 11 14:38:56.082332 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:56.082310    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"
Sep 11 14:38:56.089842 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:56.089822    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-977c12\""
Sep 11 14:38:56.089995 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:56.089969    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-977c12-dockercfg-tz8f8\""
Sep 11 14:38:56.124226 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:56.124198    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"]
Sep 11 14:38:56.182393 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:56.182361    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf70b073-c021-4242-b792-66c59ae369bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9\" (UID: \"cf70b073-c021-4242-b792-66c59ae369bd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"
Sep 11 14:38:56.182575 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:56.182419    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm4hw\" (UniqueName: \"kubernetes.io/projected/cf70b073-c021-4242-b792-66c59ae369bd-kube-api-access-xm4hw\") pod \"payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9\" (UID: \"cf70b073-c021-4242-b792-66c59ae369bd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"
Sep 11 14:38:56.283247 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:56.283213    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf70b073-c021-4242-b792-66c59ae369bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9\" (UID: \"cf70b073-c021-4242-b792-66c59ae369bd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"
Sep 11 14:38:56.283439 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:56.283268    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm4hw\" (UniqueName: \"kubernetes.io/projected/cf70b073-c021-4242-b792-66c59ae369bd-kube-api-access-xm4hw\") pod \"payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9\" (UID: \"cf70b073-c021-4242-b792-66c59ae369bd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"
Sep 11 14:38:56.283968 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:56.283943    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf70b073-c021-4242-b792-66c59ae369bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9\" (UID: \"cf70b073-c021-4242-b792-66c59ae369bd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"
Sep 11 14:38:56.308421 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:56.308394    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm4hw\" (UniqueName: \"kubernetes.io/projected/cf70b073-c021-4242-b792-66c59ae369bd-kube-api-access-xm4hw\") pod \"payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9\" (UID: \"cf70b073-c021-4242-b792-66c59ae369bd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"
Sep 11 14:38:56.392167 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:56.392091    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"
Sep 11 14:38:56.686968 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:56.686937    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"]
Sep 11 14:38:56.689807 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:38:56.689780    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf70b073_c021_4242_b792_66c59ae369bd.slice/crio-1817948023f6e481d6d1d40387db8b75476c1ab6d0a325e433d645ac97075c84 WatchSource:0}: Error finding container 1817948023f6e481d6d1d40387db8b75476c1ab6d0a325e433d645ac97075c84: Status 404 returned error can't find the container with id 1817948023f6e481d6d1d40387db8b75476c1ab6d0a325e433d645ac97075c84
Sep 11 14:38:57.572467 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:57.572433    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9" event={"ID":"cf70b073-c021-4242-b792-66c59ae369bd","Type":"ContainerStarted","Data":"a4f3490e1b9e073722eaee095de19e1f08bb9f668fe7d31daa98b571fa5a07ae"}
Sep 11 14:38:57.572691 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:57.572486    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9" event={"ID":"cf70b073-c021-4242-b792-66c59ae369bd","Type":"ContainerStarted","Data":"1817948023f6e481d6d1d40387db8b75476c1ab6d0a325e433d645ac97075c84"}
Sep 11 14:38:57.572691 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:57.572508    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"
Sep 11 14:38:57.609781 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:38:57.609734    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9" podStartSLOduration=1.609717021 podStartE2EDuration="1.609717021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:38:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:38:57.607021036 +0000 UTC m=+1433.821606696" watchObservedRunningTime="2026-09-11 14:38:57.609717021 +0000 UTC m=+1433.824302681"
Sep 11 14:39:04.557439 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:04.557412    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"
Sep 11 14:39:07.635477 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:07.635439    2569 generic.go:356] "Generic (PLEG): container finished" podID="39f88921-4254-4359-bb33-f3d76a3e7027" containerID="f66c1c7bf57526a32f69e144a5f98bf15086bbebe8051f45f2236915dbf1f561" exitCode=0
Sep 11 14:39:07.636066 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:07.635590    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc" event={"ID":"39f88921-4254-4359-bb33-f3d76a3e7027","Type":"ContainerDied","Data":"f66c1c7bf57526a32f69e144a5f98bf15086bbebe8051f45f2236915dbf1f561"}
Sep 11 14:39:07.636434 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:07.636130    2569 scope.go:117] "RemoveContainer" containerID="f66c1c7bf57526a32f69e144a5f98bf15086bbebe8051f45f2236915dbf1f561"
Sep 11 14:39:07.638043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:07.638000    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:39:07.638151 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:07.638117    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:39:07.638221 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:07.638160    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:39:08.140930 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:08.140855    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:39:08.579331 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:08.579302    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"
Sep 11 14:39:08.650130 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:08.649586    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc" event={"ID":"39f88921-4254-4359-bb33-f3d76a3e7027","Type":"ContainerStarted","Data":"14c52a33e9509b1a578445aa6a4090318ae820c87eb292ffdbcb352c718e7eb3"}
Sep 11 14:39:09.464935 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:09.464889    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:39:09.465197 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:09.465171    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 14:39:09.465257 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:09.465231    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc" podUID="39f88921-4254-4359-bb33-f3d76a3e7027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 14:39:10.464543 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:10.464501    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 14:39:10.465049 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:10.464574    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc" podUID="39f88921-4254-4359-bb33-f3d76a3e7027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 14:39:11.464302 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:11.464271    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 14:39:11.464462 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:11.464327    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc" podUID="39f88921-4254-4359-bb33-f3d76a3e7027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 14:39:12.464584 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:12.464546    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 14:39:12.465021 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:12.464606    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc" podUID="39f88921-4254-4359-bb33-f3d76a3e7027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 14:39:12.672737 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:12.672644    2569 generic.go:356] "Generic (PLEG): container finished" podID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerID="6283c58c89420edb9513659f3b5a57c722e795ab7edee86cbf506cb035a7df8b" exitCode=0
Sep 11 14:39:12.672737 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:12.672697    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd" event={"ID":"6f91a165-ad35-41cb-966f-431d9d7157f3","Type":"ContainerDied","Data":"6283c58c89420edb9513659f3b5a57c722e795ab7edee86cbf506cb035a7df8b"}
Sep 11 14:39:12.673146 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:12.673128    2569 scope.go:117] "RemoveContainer" containerID="6283c58c89420edb9513659f3b5a57c722e795ab7edee86cbf506cb035a7df8b"
Sep 11 14:39:12.674243 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:12.674211    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:39:12.674317 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:12.674287    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:39:12.674355 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:12.674323    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:39:13.464378 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:13.464331    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 11 14:39:13.464620 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:13.464404    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc" podUID="39f88921-4254-4359-bb33-f3d76a3e7027" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 11 14:39:13.681776 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:13.681745    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd" event={"ID":"6f91a165-ad35-41cb-966f-431d9d7157f3","Type":"ContainerStarted","Data":"3ab4130dfe3d366f2c3b926bccf28106bc3563354aeabd4022ad9e2705fd5a64"}
Sep 11 14:39:14.468466 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:14.468434    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:39:14.468890 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:14.468737    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:39:14.469332 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:14.469316    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:39:14.520687 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:14.520663    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:39:14.520869 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:14.520852    2569 patch_prober.go:28] interesting pod/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 14:39:14.520985 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:14.520934    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd" podUID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 14:39:15.520381 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:15.520350    2569 patch_prober.go:28] interesting pod/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 14:39:15.520780 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:15.520415    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd" podUID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 14:39:16.520496 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:16.520448    2569 patch_prober.go:28] interesting pod/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 14:39:16.521027 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:16.520520    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd" podUID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 14:39:17.520519 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:17.520478    2569 patch_prober.go:28] interesting pod/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 14:39:17.520946 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:17.520536    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd" podUID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 14:39:18.521028 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:18.520986    2569 patch_prober.go:28] interesting pod/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 14:39:18.521403 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:18.521078    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd" podUID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 14:39:19.523976 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:19.523946    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:39:19.524452 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:19.524236    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:39:19.525011 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:19.524990    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:39:27.752688 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.752655    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"]
Sep 11 14:39:27.755709 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.755693    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.779616 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.779588    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-8feb68\"/\"kube-root-ca.crt\""
Sep 11 14:39:27.779754 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.779686    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-8feb68\"/\"default-dockercfg-4bqkh\""
Sep 11 14:39:27.787183 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.787161    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-8feb68\"/\"auth-test-model-8feb68-kserve-self-signed-certs\""
Sep 11 14:39:27.787342 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.787327    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-8feb68\"/\"openshift-service-ca.crt\""
Sep 11 14:39:27.822437 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.822414    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"]
Sep 11 14:39:27.897688 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.897657    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmf8n\" (UniqueName: \"kubernetes.io/projected/a2f318eb-ca14-483c-b9ec-e78020189a81-kube-api-access-jmf8n\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.897857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.897705    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-tmp-dir\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.897857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.897747    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2f318eb-ca14-483c-b9ec-e78020189a81-tls-certs\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.897857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.897764    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-model-cache\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.897857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.897799    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-dshm\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.897857 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.897840    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-home\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.999338 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.999307    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-tmp-dir\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.999509 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.999351    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2f318eb-ca14-483c-b9ec-e78020189a81-tls-certs\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.999509 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.999369    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-model-cache\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.999509 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.999418    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-dshm\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.999509 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.999456    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-home\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.999509 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.999506    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmf8n\" (UniqueName: \"kubernetes.io/projected/a2f318eb-ca14-483c-b9ec-e78020189a81-kube-api-access-jmf8n\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.999843 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.999762    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-tmp-dir\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.999843 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.999826    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-model-cache\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:27.999992 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:27.999976    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-home\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:28.002043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.002016    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-dshm\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:28.002276 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.002260    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2f318eb-ca14-483c-b9ec-e78020189a81-tls-certs\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:28.023770 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.023708    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmf8n\" (UniqueName: \"kubernetes.io/projected/a2f318eb-ca14-483c-b9ec-e78020189a81-kube-api-access-jmf8n\") pod \"auth-test-model-8feb68-kserve-7f67f6df5-4mj2r\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:28.064435 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.064405    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:28.362975 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.362869    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"]
Sep 11 14:39:28.369952 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:39:28.369924    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2f318eb_ca14_483c_b9ec_e78020189a81.slice/crio-9646c4ae3a3a940824f1c3511fc563bd22fa768b768355e8c6ad01e7c75c83fd WatchSource:0}: Error finding container 9646c4ae3a3a940824f1c3511fc563bd22fa768b768355e8c6ad01e7c75c83fd: Status 404 returned error can't find the container with id 9646c4ae3a3a940824f1c3511fc563bd22fa768b768355e8c6ad01e7c75c83fd
Sep 11 14:39:28.535718 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.535687    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"]
Sep 11 14:39:28.538187 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.538170    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"
Sep 11 14:39:28.542001 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.541980    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-7eeb45-dockercfg-dpzbz\""
Sep 11 14:39:28.542087 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.542051    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-7eeb45\""
Sep 11 14:39:28.568117 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.568093    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"]
Sep 11 14:39:28.706222 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.706181    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2wvb\" (UniqueName: \"kubernetes.io/projected/f408c1d6-6934-495e-bedd-24410e3eb466-kube-api-access-n2wvb\") pod \"payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m\" (UID: \"f408c1d6-6934-495e-bedd-24410e3eb466\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"
Sep 11 14:39:28.706415 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.706278    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f408c1d6-6934-495e-bedd-24410e3eb466-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m\" (UID: \"f408c1d6-6934-495e-bedd-24410e3eb466\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"
Sep 11 14:39:28.758452 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.758414    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r" event={"ID":"a2f318eb-ca14-483c-b9ec-e78020189a81","Type":"ContainerStarted","Data":"e7b5e8f35bc1c4028c2cb2ebe44601c387200f5d92a57a2aeaa55bf71fca5308"}
Sep 11 14:39:28.758822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.758467    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r" event={"ID":"a2f318eb-ca14-483c-b9ec-e78020189a81","Type":"ContainerStarted","Data":"9646c4ae3a3a940824f1c3511fc563bd22fa768b768355e8c6ad01e7c75c83fd"}
Sep 11 14:39:28.804205 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.804161    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r" podStartSLOduration=1.804146654 podStartE2EDuration="1.804146654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:39:28.790834692 +0000 UTC m=+1465.005420354" watchObservedRunningTime="2026-09-11 14:39:28.804146654 +0000 UTC m=+1465.018732315"
Sep 11 14:39:28.807800 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.807775    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2wvb\" (UniqueName: \"kubernetes.io/projected/f408c1d6-6934-495e-bedd-24410e3eb466-kube-api-access-n2wvb\") pod \"payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m\" (UID: \"f408c1d6-6934-495e-bedd-24410e3eb466\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"
Sep 11 14:39:28.807955 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.807897    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f408c1d6-6934-495e-bedd-24410e3eb466-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m\" (UID: \"f408c1d6-6934-495e-bedd-24410e3eb466\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"
Sep 11 14:39:28.808591 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.808573    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f408c1d6-6934-495e-bedd-24410e3eb466-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m\" (UID: \"f408c1d6-6934-495e-bedd-24410e3eb466\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"
Sep 11 14:39:28.823687 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.823666    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2wvb\" (UniqueName: \"kubernetes.io/projected/f408c1d6-6934-495e-bedd-24410e3eb466-kube-api-access-n2wvb\") pod \"payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m\" (UID: \"f408c1d6-6934-495e-bedd-24410e3eb466\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"
Sep 11 14:39:28.848402 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:28.848381    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"
Sep 11 14:39:29.155183 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:29.155104    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"]
Sep 11 14:39:29.161898 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:39:29.161845    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf408c1d6_6934_495e_bedd_24410e3eb466.slice/crio-f49c839195c06f975d54f0c20e0ddf9d8975d986a2d1888a3bf39448005ac075 WatchSource:0}: Error finding container f49c839195c06f975d54f0c20e0ddf9d8975d986a2d1888a3bf39448005ac075: Status 404 returned error can't find the container with id f49c839195c06f975d54f0c20e0ddf9d8975d986a2d1888a3bf39448005ac075
Sep 11 14:39:29.774038 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:29.773994    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m" event={"ID":"f408c1d6-6934-495e-bedd-24410e3eb466","Type":"ContainerStarted","Data":"276a16dc8f8d5b8d448a1c842294c91d9693b82b04fb5e790ce758964d561b69"}
Sep 11 14:39:29.774459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:29.774099    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m" event={"ID":"f408c1d6-6934-495e-bedd-24410e3eb466","Type":"ContainerStarted","Data":"f49c839195c06f975d54f0c20e0ddf9d8975d986a2d1888a3bf39448005ac075"}
Sep 11 14:39:29.774459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:29.774127    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"
Sep 11 14:39:29.806114 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:29.806066    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m" podStartSLOduration=1.806051293 podStartE2EDuration="1.806051293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:39:29.80449325 +0000 UTC m=+1466.019078912" watchObservedRunningTime="2026-09-11 14:39:29.806051293 +0000 UTC m=+1466.020636953"
Sep 11 14:39:31.474191 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:31.474149    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:39:38.064897 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:38.064833    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:38.064897 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:38.064902    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:38.077928 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:38.077899    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:38.831971 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:38.831940    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:39:40.781310 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:40.781278    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"
Sep 11 14:39:45.573548 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.573517    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"]
Sep 11 14:39:45.575993 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.575976    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.580956 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.580924    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-977c12\"/\"openshift-service-ca.crt\""
Sep 11 14:39:45.580956 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.580924    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-977c12\"/\"default-dockercfg-vwpdv\""
Sep 11 14:39:45.581683 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.581661    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-977c12\"/\"auth-test-model-977c12-kserve-self-signed-certs\""
Sep 11 14:39:45.591495 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.591478    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-977c12\"/\"kube-root-ca.crt\""
Sep 11 14:39:45.653717 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.653687    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"]
Sep 11 14:39:45.662195 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.662162    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfh29\" (UniqueName: \"kubernetes.io/projected/b19289cb-49cb-4bbc-867e-97dce317241e-kube-api-access-mfh29\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.662319 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.662244    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-model-cache\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.662319 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.662295    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-home\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.662417 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.662385    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-dshm\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.662497 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.662483    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b19289cb-49cb-4bbc-867e-97dce317241e-tls-certs\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.662540 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.662515    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-tmp-dir\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.763410 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.763377    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfh29\" (UniqueName: \"kubernetes.io/projected/b19289cb-49cb-4bbc-867e-97dce317241e-kube-api-access-mfh29\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.763610 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.763442    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-model-cache\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.763610 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.763487    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-home\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.763610 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.763554    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-dshm\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.763802 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.763617    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b19289cb-49cb-4bbc-867e-97dce317241e-tls-certs\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.763802 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.763641    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-tmp-dir\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.763931 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.763903    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-model-cache\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.763988 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.763974    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-tmp-dir\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.764231 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.764196    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-home\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.766607 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.766581    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-dshm\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.767129 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.767101    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b19289cb-49cb-4bbc-867e-97dce317241e-tls-certs\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.779558 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.779530    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfh29\" (UniqueName: \"kubernetes.io/projected/b19289cb-49cb-4bbc-867e-97dce317241e-kube-api-access-mfh29\") pod \"auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") " pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:45.885046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:45.884969    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:46.168846 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:46.168669    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"]
Sep 11 14:39:46.171378 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:39:46.171352    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb19289cb_49cb_4bbc_867e_97dce317241e.slice/crio-ed3ce22f7c85be52ebd817cb55dabca23e80d304375b4bb26d7b54ec66557260 WatchSource:0}: Error finding container ed3ce22f7c85be52ebd817cb55dabca23e80d304375b4bb26d7b54ec66557260: Status 404 returned error can't find the container with id ed3ce22f7c85be52ebd817cb55dabca23e80d304375b4bb26d7b54ec66557260
Sep 11 14:39:46.872647 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:46.872611    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x" event={"ID":"b19289cb-49cb-4bbc-867e-97dce317241e","Type":"ContainerStarted","Data":"6472263207c3e7367eac1bb57398922a9f1b05ebe7833a5fde28f0d600f66bb7"}
Sep 11 14:39:46.872647 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:46.872654    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x" event={"ID":"b19289cb-49cb-4bbc-867e-97dce317241e","Type":"ContainerStarted","Data":"ed3ce22f7c85be52ebd817cb55dabca23e80d304375b4bb26d7b54ec66557260"}
Sep 11 14:39:46.905308 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:46.905259    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x" podStartSLOduration=1.9052409369999999 podStartE2EDuration="1.905240937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:39:46.902603309 +0000 UTC m=+1483.117188971" watchObservedRunningTime="2026-09-11 14:39:46.905240937 +0000 UTC m=+1483.119826599"
Sep 11 14:39:50.694195 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:50.694156    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:39:55.885951 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:55.885916    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:55.886374 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:55.885968    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:55.898007 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:55.897984    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:39:55.931015 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:39:55.930991    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:40:04.291569 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:04.291539    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:40:04.296719 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:04.296698    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:40:04.472212 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:04.472175    2569 scope.go:117] "RemoveContainer" containerID="8e0eabe97f3ff4591072c9cf0b40a95a6e7af407e06cda7c93efbb5c054359a2"
Sep 11 14:40:11.470363 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:11.470330    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:40:14.560948 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:14.560915    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"]
Sep 11 14:40:14.564025 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:14.564010    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"
Sep 11 14:40:14.570614 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:14.570594    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-3893129d-dockercfg-6fmzw\""
Sep 11 14:40:14.570841 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:14.570820    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-3893129d\""
Sep 11 14:40:14.587306 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:14.587278    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"]
Sep 11 14:40:14.740786 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:14.740755    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbf85\" (UniqueName: \"kubernetes.io/projected/c1bb7df1-9ee0-4a79-b01f-66b3249ad678-kube-api-access-fbf85\") pod \"payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924\" (UID: \"c1bb7df1-9ee0-4a79-b01f-66b3249ad678\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"
Sep 11 14:40:14.741102 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:14.740816    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1bb7df1-9ee0-4a79-b01f-66b3249ad678-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924\" (UID: \"c1bb7df1-9ee0-4a79-b01f-66b3249ad678\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"
Sep 11 14:40:14.841667 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:14.841577    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1bb7df1-9ee0-4a79-b01f-66b3249ad678-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924\" (UID: \"c1bb7df1-9ee0-4a79-b01f-66b3249ad678\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"
Sep 11 14:40:14.841825 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:14.841706    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbf85\" (UniqueName: \"kubernetes.io/projected/c1bb7df1-9ee0-4a79-b01f-66b3249ad678-kube-api-access-fbf85\") pod \"payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924\" (UID: \"c1bb7df1-9ee0-4a79-b01f-66b3249ad678\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"
Sep 11 14:40:14.842306 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:14.842286    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1bb7df1-9ee0-4a79-b01f-66b3249ad678-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924\" (UID: \"c1bb7df1-9ee0-4a79-b01f-66b3249ad678\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"
Sep 11 14:40:14.862502 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:14.862475    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbf85\" (UniqueName: \"kubernetes.io/projected/c1bb7df1-9ee0-4a79-b01f-66b3249ad678-kube-api-access-fbf85\") pod \"payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924\" (UID: \"c1bb7df1-9ee0-4a79-b01f-66b3249ad678\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"
Sep 11 14:40:14.874277 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:14.874254    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"
Sep 11 14:40:15.175829 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:15.175804    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"]
Sep 11 14:40:15.178423 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:40:15.178396    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1bb7df1_9ee0_4a79_b01f_66b3249ad678.slice/crio-b8add49b66da670e99d5e5083ad05a7aea004cafe23938ce5e35cc92124ee3c1 WatchSource:0}: Error finding container b8add49b66da670e99d5e5083ad05a7aea004cafe23938ce5e35cc92124ee3c1: Status 404 returned error can't find the container with id b8add49b66da670e99d5e5083ad05a7aea004cafe23938ce5e35cc92124ee3c1
Sep 11 14:40:16.023859 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:16.023826    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924" event={"ID":"c1bb7df1-9ee0-4a79-b01f-66b3249ad678","Type":"ContainerStarted","Data":"895ae9f0d590b6661d9211d2c8ff0a5547e9ca993c43af251f77253423b33102"}
Sep 11 14:40:16.024294 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:16.024021    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"
Sep 11 14:40:16.024294 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:16.024066    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924" event={"ID":"c1bb7df1-9ee0-4a79-b01f-66b3249ad678","Type":"ContainerStarted","Data":"b8add49b66da670e99d5e5083ad05a7aea004cafe23938ce5e35cc92124ee3c1"}
Sep 11 14:40:16.055416 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:16.055363    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924" podStartSLOduration=2.055349218 podStartE2EDuration="2.055349218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:40:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:40:16.054975207 +0000 UTC m=+1512.269560868" watchObservedRunningTime="2026-09-11 14:40:16.055349218 +0000 UTC m=+1512.269934879"
Sep 11 14:40:27.031399 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:27.031317    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"
Sep 11 14:40:31.843480 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:31.843443    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:40:49.352800 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:40:49.352765    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:41:03.370397 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:03.370363    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:41:04.498212 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:04.498181    2569 scope.go:117] "RemoveContainer" containerID="45ddf19229d94d53c6349a12aca4ae9992cb3d9cf30b56c6b785fd2eb9d021c3"
Sep 11 14:41:04.506544 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:04.506526    2569 scope.go:117] "RemoveContainer" containerID="5e9f6bee0daa4421f51a305e04081d76013336e5db3f7a7f230e7d0b886cff6e"
Sep 11 14:41:21.173756 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:21.173723    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7"]
Sep 11 14:41:21.178625 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:21.178609    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7"
Sep 11 14:41:21.185736 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:21.185718    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:41:21.185850 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:21.185725    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:41:21.201827 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:21.201804    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7"]
Sep 11 14:41:21.244481 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:21.244459    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a085dc1-2115-4820-b37f-6c4b670ed2ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3893129d-j85z7\" (UID: \"3a085dc1-2115-4820-b37f-6c4b670ed2ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7"
Sep 11 14:41:21.345264 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:21.345230    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a085dc1-2115-4820-b37f-6c4b670ed2ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3893129d-j85z7\" (UID: \"3a085dc1-2115-4820-b37f-6c4b670ed2ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7"
Sep 11 14:41:21.345846 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:21.345825    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a085dc1-2115-4820-b37f-6c4b670ed2ec-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3893129d-j85z7\" (UID: \"3a085dc1-2115-4820-b37f-6c4b670ed2ec\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7"
Sep 11 14:41:21.489111 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:21.489039    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7"
Sep 11 14:41:21.787391 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:21.787369    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7"]
Sep 11 14:41:21.789390 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:41:21.789362    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a085dc1_2115_4820_b37f_6c4b670ed2ec.slice/crio-da917dc58d5f13b7c4b8fdd6ca1dc6f349947dc72f8bfcde51e5113ec3b908fe WatchSource:0}: Error finding container da917dc58d5f13b7c4b8fdd6ca1dc6f349947dc72f8bfcde51e5113ec3b908fe: Status 404 returned error can't find the container with id da917dc58d5f13b7c4b8fdd6ca1dc6f349947dc72f8bfcde51e5113ec3b908fe
Sep 11 14:41:22.368554 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:22.368515    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7" event={"ID":"3a085dc1-2115-4820-b37f-6c4b670ed2ec","Type":"ContainerStarted","Data":"de1602f7b04f1dfd204c5d19455d382b1408a41a2cbbb2fba64525338e735039"}
Sep 11 14:41:22.368992 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:22.368570    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7" event={"ID":"3a085dc1-2115-4820-b37f-6c4b670ed2ec","Type":"ContainerStarted","Data":"da917dc58d5f13b7c4b8fdd6ca1dc6f349947dc72f8bfcde51e5113ec3b908fe"}
Sep 11 14:41:22.396569 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:22.396526    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7" podStartSLOduration=1.396510608 podStartE2EDuration="1.396510608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:41:22.393795833 +0000 UTC m=+1578.608381492" watchObservedRunningTime="2026-09-11 14:41:22.396510608 +0000 UTC m=+1578.611096268"
Sep 11 14:41:23.380012 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:23.379977    2569 generic.go:356] "Generic (PLEG): container finished" podID="3a085dc1-2115-4820-b37f-6c4b670ed2ec" containerID="de1602f7b04f1dfd204c5d19455d382b1408a41a2cbbb2fba64525338e735039" exitCode=0
Sep 11 14:41:23.380397 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:23.380026    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7" event={"ID":"3a085dc1-2115-4820-b37f-6c4b670ed2ec","Type":"ContainerDied","Data":"de1602f7b04f1dfd204c5d19455d382b1408a41a2cbbb2fba64525338e735039"}
Sep 11 14:41:23.439909 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:23.439868    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:41:24.518589 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:24.518562    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7"
Sep 11 14:41:24.574739 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:24.574707    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a085dc1-2115-4820-b37f-6c4b670ed2ec-maas-api-service-ca\") pod \"3a085dc1-2115-4820-b37f-6c4b670ed2ec\" (UID: \"3a085dc1-2115-4820-b37f-6c4b670ed2ec\") "
Sep 11 14:41:24.575168 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:24.575140    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a085dc1-2115-4820-b37f-6c4b670ed2ec-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3a085dc1-2115-4820-b37f-6c4b670ed2ec" (UID: "3a085dc1-2115-4820-b37f-6c4b670ed2ec"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:41:24.675518 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:24.675500    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a085dc1-2115-4820-b37f-6c4b670ed2ec-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:41:25.392554 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:25.392527    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7"
Sep 11 14:41:25.392728 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:25.392531    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7" event={"ID":"3a085dc1-2115-4820-b37f-6c4b670ed2ec","Type":"ContainerDied","Data":"da917dc58d5f13b7c4b8fdd6ca1dc6f349947dc72f8bfcde51e5113ec3b908fe"}
Sep 11 14:41:25.392728 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:25.392635    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da917dc58d5f13b7c4b8fdd6ca1dc6f349947dc72f8bfcde51e5113ec3b908fe"
Sep 11 14:41:37.312559 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:37.312528    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"]
Sep 11 14:41:37.313372 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:37.312769    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924" podUID="c1bb7df1-9ee0-4a79-b01f-66b3249ad678" containerName="payload-pre-processing" containerID="cri-o://895ae9f0d590b6661d9211d2c8ff0a5547e9ca993c43af251f77253423b33102" gracePeriod=30
Sep 11 14:41:37.453305 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:37.453271    2569 generic.go:356] "Generic (PLEG): container finished" podID="c1bb7df1-9ee0-4a79-b01f-66b3249ad678" containerID="895ae9f0d590b6661d9211d2c8ff0a5547e9ca993c43af251f77253423b33102" exitCode=0
Sep 11 14:41:37.453449 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:37.453345    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924" event={"ID":"c1bb7df1-9ee0-4a79-b01f-66b3249ad678","Type":"ContainerDied","Data":"895ae9f0d590b6661d9211d2c8ff0a5547e9ca993c43af251f77253423b33102"}
Sep 11 14:41:37.576077 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:37.576017    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"
Sep 11 14:41:37.612124 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:37.612097    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7"]
Sep 11 14:41:37.615469 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:37.615441    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3893129d-j85z7"]
Sep 11 14:41:37.680597 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:37.680563    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1bb7df1-9ee0-4a79-b01f-66b3249ad678-plugins-config-volume\") pod \"c1bb7df1-9ee0-4a79-b01f-66b3249ad678\" (UID: \"c1bb7df1-9ee0-4a79-b01f-66b3249ad678\") "
Sep 11 14:41:37.680768 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:37.680624    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbf85\" (UniqueName: \"kubernetes.io/projected/c1bb7df1-9ee0-4a79-b01f-66b3249ad678-kube-api-access-fbf85\") pod \"c1bb7df1-9ee0-4a79-b01f-66b3249ad678\" (UID: \"c1bb7df1-9ee0-4a79-b01f-66b3249ad678\") "
Sep 11 14:41:37.680973 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:37.680950    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1bb7df1-9ee0-4a79-b01f-66b3249ad678-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c1bb7df1-9ee0-4a79-b01f-66b3249ad678" (UID: "c1bb7df1-9ee0-4a79-b01f-66b3249ad678"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:41:37.682781 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:37.682757    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1bb7df1-9ee0-4a79-b01f-66b3249ad678-kube-api-access-fbf85" (OuterVolumeSpecName: "kube-api-access-fbf85") pod "c1bb7df1-9ee0-4a79-b01f-66b3249ad678" (UID: "c1bb7df1-9ee0-4a79-b01f-66b3249ad678"). InnerVolumeSpecName "kube-api-access-fbf85". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:41:37.781824 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:37.781796    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbf85\" (UniqueName: \"kubernetes.io/projected/c1bb7df1-9ee0-4a79-b01f-66b3249ad678-kube-api-access-fbf85\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:41:37.781824 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:37.781821    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1bb7df1-9ee0-4a79-b01f-66b3249ad678-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:41:38.270612 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:38.270579    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a085dc1-2115-4820-b37f-6c4b670ed2ec" path="/var/lib/kubelet/pods/3a085dc1-2115-4820-b37f-6c4b670ed2ec/volumes"
Sep 11 14:41:38.443062 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:38.443028    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:41:38.466104 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:38.466076    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924" event={"ID":"c1bb7df1-9ee0-4a79-b01f-66b3249ad678","Type":"ContainerDied","Data":"b8add49b66da670e99d5e5083ad05a7aea004cafe23938ce5e35cc92124ee3c1"}
Sep 11 14:41:38.466271 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:38.466153    2569 scope.go:117] "RemoveContainer" containerID="895ae9f0d590b6661d9211d2c8ff0a5547e9ca993c43af251f77253423b33102"
Sep 11 14:41:38.466271 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:38.466080    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"
Sep 11 14:41:38.497128 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:38.497100    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"]
Sep 11 14:41:38.502797 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:38.502775    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3893129d-9dc575b98-g2924"]
Sep 11 14:41:40.271252 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:40.271219    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1bb7df1-9ee0-4a79-b01f-66b3249ad678" path="/var/lib/kubelet/pods/c1bb7df1-9ee0-4a79-b01f-66b3249ad678/volumes"
Sep 11 14:41:55.129328 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:41:55.129296    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:42:04.533606 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:04.533538    2569 scope.go:117] "RemoveContainer" containerID="cf56e8f7064641d90042222c75e5f325eb63a6e70679b6b005cad41158588315"
Sep 11 14:42:11.457650 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:11.457615    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:42:17.987649 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:17.987616    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"]
Sep 11 14:42:19.029186 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:19.029146    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"]
Sep 11 14:42:22.188865 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.188829    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"]
Sep 11 14:42:22.189441 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.189418    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a085dc1-2115-4820-b37f-6c4b670ed2ec" containerName="revoke-keys"
Sep 11 14:42:22.189540 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.189443    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a085dc1-2115-4820-b37f-6c4b670ed2ec" containerName="revoke-keys"
Sep 11 14:42:22.189540 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.189458    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1bb7df1-9ee0-4a79-b01f-66b3249ad678" containerName="payload-pre-processing"
Sep 11 14:42:22.189540 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.189466    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1bb7df1-9ee0-4a79-b01f-66b3249ad678" containerName="payload-pre-processing"
Sep 11 14:42:22.189689 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.189556    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a085dc1-2115-4820-b37f-6c4b670ed2ec" containerName="revoke-keys"
Sep 11 14:42:22.189689 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.189573    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1bb7df1-9ee0-4a79-b01f-66b3249ad678" containerName="payload-pre-processing"
Sep 11 14:42:22.194154 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.194132    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.197671 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.197652    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-8feb68\"/\"sub-test-model-8feb68-kserve-self-signed-certs\""
Sep 11 14:42:22.209139 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.209114    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"]
Sep 11 14:42:22.260018 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.259990    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-model-cache\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.260155 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.260024    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-525x9\" (UniqueName: \"kubernetes.io/projected/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-kube-api-access-525x9\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.260155 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.260107    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-tls-certs\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.260227 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.260165    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-tmp-dir\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.260227 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.260190    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-home\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.260227 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.260212    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-dshm\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.361079 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.361051    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-model-cache\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.361079 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.361083    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-525x9\" (UniqueName: \"kubernetes.io/projected/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-kube-api-access-525x9\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.361315 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.361134    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-tls-certs\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.361315 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.361157    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-tmp-dir\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.361315 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.361183    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-home\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.361315 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.361204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-dshm\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.361495 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.361478    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-model-cache\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.361557 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.361540    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-tmp-dir\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.361662 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.361640    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-home\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.363490 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.363469    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-dshm\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.363669 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.363651    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-tls-certs\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.370240 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.370215    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-525x9\" (UniqueName: \"kubernetes.io/projected/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-kube-api-access-525x9\") pod \"sub-test-model-8feb68-kserve-5866c9b56f-5xnn9\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") " pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.504098 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.504028    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:22.777679 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:22.777595    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"]
Sep 11 14:42:22.780341 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:42:22.780313    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c34b1fd_4bf9_4f57_a6f2_d548d8601983.slice/crio-2230f2aa0854b925f8d35a59743dcfd6d2ad5b47710634ef5c109eafd6d042a6 WatchSource:0}: Error finding container 2230f2aa0854b925f8d35a59743dcfd6d2ad5b47710634ef5c109eafd6d042a6: Status 404 returned error can't find the container with id 2230f2aa0854b925f8d35a59743dcfd6d2ad5b47710634ef5c109eafd6d042a6
Sep 11 14:42:23.688615 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:23.688576    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9" event={"ID":"1c34b1fd-4bf9-4f57-a6f2-d548d8601983","Type":"ContainerStarted","Data":"61f0634255a32e2dd340ddbd34bb21e079ead9ed944551c091d1a561acd48251"}
Sep 11 14:42:23.688999 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:23.688622    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9" event={"ID":"1c34b1fd-4bf9-4f57-a6f2-d548d8601983","Type":"ContainerStarted","Data":"2230f2aa0854b925f8d35a59743dcfd6d2ad5b47710634ef5c109eafd6d042a6"}
Sep 11 14:42:23.708845 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:23.708793    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9" podStartSLOduration=1.708775014 podStartE2EDuration="1.708775014s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:42:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:42:23.706833024 +0000 UTC m=+1639.921418676" watchObservedRunningTime="2026-09-11 14:42:23.708775014 +0000 UTC m=+1639.923360676"
Sep 11 14:42:29.443387 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:29.443352    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:42:32.504153 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:32.504120    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:32.504560 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:32.504164    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:32.516788 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:32.516766    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:32.745522 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:32.745497    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:42:33.006698 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.006663    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r" podUID="a2f318eb-ca14-483c-b9ec-e78020189a81" containerName="main" containerID="cri-o://e7b5e8f35bc1c4028c2cb2ebe44601c387200f5d92a57a2aeaa55bf71fca5308" gracePeriod=45
Sep 11 14:42:33.249471 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.249444    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:42:33.356622 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.356551    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-dshm\") pod \"a2f318eb-ca14-483c-b9ec-e78020189a81\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") "
Sep 11 14:42:33.356622 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.356589    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-home\") pod \"a2f318eb-ca14-483c-b9ec-e78020189a81\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") "
Sep 11 14:42:33.356797 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.356639    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2f318eb-ca14-483c-b9ec-e78020189a81-tls-certs\") pod \"a2f318eb-ca14-483c-b9ec-e78020189a81\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") "
Sep 11 14:42:33.356797 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.356694    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-model-cache\") pod \"a2f318eb-ca14-483c-b9ec-e78020189a81\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") "
Sep 11 14:42:33.356797 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.356721    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-tmp-dir\") pod \"a2f318eb-ca14-483c-b9ec-e78020189a81\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") "
Sep 11 14:42:33.356981 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.356929    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmf8n\" (UniqueName: \"kubernetes.io/projected/a2f318eb-ca14-483c-b9ec-e78020189a81-kube-api-access-jmf8n\") pod \"a2f318eb-ca14-483c-b9ec-e78020189a81\" (UID: \"a2f318eb-ca14-483c-b9ec-e78020189a81\") "
Sep 11 14:42:33.356981 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.356956    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-home" (OuterVolumeSpecName: "home") pod "a2f318eb-ca14-483c-b9ec-e78020189a81" (UID: "a2f318eb-ca14-483c-b9ec-e78020189a81"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:42:33.357080 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.357000    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-model-cache" (OuterVolumeSpecName: "model-cache") pod "a2f318eb-ca14-483c-b9ec-e78020189a81" (UID: "a2f318eb-ca14-483c-b9ec-e78020189a81"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:42:33.357080 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.357008    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a2f318eb-ca14-483c-b9ec-e78020189a81" (UID: "a2f318eb-ca14-483c-b9ec-e78020189a81"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:42:33.357259 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.357242    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-model-cache\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:42:33.357318 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.357266    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-tmp-dir\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:42:33.357318 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.357279    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-home\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:42:33.358887 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.358850    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-dshm" (OuterVolumeSpecName: "dshm") pod "a2f318eb-ca14-483c-b9ec-e78020189a81" (UID: "a2f318eb-ca14-483c-b9ec-e78020189a81"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:42:33.358998 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.358917    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2f318eb-ca14-483c-b9ec-e78020189a81-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a2f318eb-ca14-483c-b9ec-e78020189a81" (UID: "a2f318eb-ca14-483c-b9ec-e78020189a81"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:42:33.359060 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.359009    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2f318eb-ca14-483c-b9ec-e78020189a81-kube-api-access-jmf8n" (OuterVolumeSpecName: "kube-api-access-jmf8n") pod "a2f318eb-ca14-483c-b9ec-e78020189a81" (UID: "a2f318eb-ca14-483c-b9ec-e78020189a81"). InnerVolumeSpecName "kube-api-access-jmf8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:42:33.458529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.458498    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a2f318eb-ca14-483c-b9ec-e78020189a81-tls-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:42:33.458529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.458526    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmf8n\" (UniqueName: \"kubernetes.io/projected/a2f318eb-ca14-483c-b9ec-e78020189a81-kube-api-access-jmf8n\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:42:33.458529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.458536    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a2f318eb-ca14-483c-b9ec-e78020189a81-dshm\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:42:33.740750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.740721    2569 generic.go:356] "Generic (PLEG): container finished" podID="a2f318eb-ca14-483c-b9ec-e78020189a81" containerID="e7b5e8f35bc1c4028c2cb2ebe44601c387200f5d92a57a2aeaa55bf71fca5308" exitCode=0
Sep 11 14:42:33.741140 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.740768    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"
Sep 11 14:42:33.741140 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.740812    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r" event={"ID":"a2f318eb-ca14-483c-b9ec-e78020189a81","Type":"ContainerDied","Data":"e7b5e8f35bc1c4028c2cb2ebe44601c387200f5d92a57a2aeaa55bf71fca5308"}
Sep 11 14:42:33.741140 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.740860    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r" event={"ID":"a2f318eb-ca14-483c-b9ec-e78020189a81","Type":"ContainerDied","Data":"9646c4ae3a3a940824f1c3511fc563bd22fa768b768355e8c6ad01e7c75c83fd"}
Sep 11 14:42:33.741140 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.740907    2569 scope.go:117] "RemoveContainer" containerID="e7b5e8f35bc1c4028c2cb2ebe44601c387200f5d92a57a2aeaa55bf71fca5308"
Sep 11 14:42:33.751927 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.751907    2569 scope.go:117] "RemoveContainer" containerID="e7b5e8f35bc1c4028c2cb2ebe44601c387200f5d92a57a2aeaa55bf71fca5308"
Sep 11 14:42:33.752207 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:42:33.752181    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7b5e8f35bc1c4028c2cb2ebe44601c387200f5d92a57a2aeaa55bf71fca5308\": container with ID starting with e7b5e8f35bc1c4028c2cb2ebe44601c387200f5d92a57a2aeaa55bf71fca5308 not found: ID does not exist" containerID="e7b5e8f35bc1c4028c2cb2ebe44601c387200f5d92a57a2aeaa55bf71fca5308"
Sep 11 14:42:33.752300 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.752213    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7b5e8f35bc1c4028c2cb2ebe44601c387200f5d92a57a2aeaa55bf71fca5308"} err="failed to get container status \"e7b5e8f35bc1c4028c2cb2ebe44601c387200f5d92a57a2aeaa55bf71fca5308\": rpc error: code = NotFound desc = could not find container \"e7b5e8f35bc1c4028c2cb2ebe44601c387200f5d92a57a2aeaa55bf71fca5308\": container with ID starting with e7b5e8f35bc1c4028c2cb2ebe44601c387200f5d92a57a2aeaa55bf71fca5308 not found: ID does not exist"
Sep 11 14:42:33.766831 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.766810    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"]
Sep 11 14:42:33.771777 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:33.771752    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8feb68/auth-test-model-8feb68-kserve-7f67f6df5-4mj2r"]
Sep 11 14:42:34.049022 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.048922    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x" podUID="b19289cb-49cb-4bbc-867e-97dce317241e" containerName="main" containerID="cri-o://6472263207c3e7367eac1bb57398922a9f1b05ebe7833a5fde28f0d600f66bb7" gracePeriod=45
Sep 11 14:42:34.272459 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.272434    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2f318eb-ca14-483c-b9ec-e78020189a81" path="/var/lib/kubelet/pods/a2f318eb-ca14-483c-b9ec-e78020189a81/volumes"
Sep 11 14:42:34.291865 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.291841    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:42:34.365574 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.365508    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-tmp-dir\") pod \"b19289cb-49cb-4bbc-867e-97dce317241e\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") "
Sep 11 14:42:34.365703 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.365578    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-dshm\") pod \"b19289cb-49cb-4bbc-867e-97dce317241e\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") "
Sep 11 14:42:34.365703 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.365602    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfh29\" (UniqueName: \"kubernetes.io/projected/b19289cb-49cb-4bbc-867e-97dce317241e-kube-api-access-mfh29\") pod \"b19289cb-49cb-4bbc-867e-97dce317241e\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") "
Sep 11 14:42:34.365703 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.365618    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-model-cache\") pod \"b19289cb-49cb-4bbc-867e-97dce317241e\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") "
Sep 11 14:42:34.365703 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.365643    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b19289cb-49cb-4bbc-867e-97dce317241e-tls-certs\") pod \"b19289cb-49cb-4bbc-867e-97dce317241e\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") "
Sep 11 14:42:34.365703 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.365697    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-home\") pod \"b19289cb-49cb-4bbc-867e-97dce317241e\" (UID: \"b19289cb-49cb-4bbc-867e-97dce317241e\") "
Sep 11 14:42:34.366006 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.365804    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b19289cb-49cb-4bbc-867e-97dce317241e" (UID: "b19289cb-49cb-4bbc-867e-97dce317241e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:42:34.366006 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.365939    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-model-cache" (OuterVolumeSpecName: "model-cache") pod "b19289cb-49cb-4bbc-867e-97dce317241e" (UID: "b19289cb-49cb-4bbc-867e-97dce317241e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:42:34.366113 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.366003    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-home" (OuterVolumeSpecName: "home") pod "b19289cb-49cb-4bbc-867e-97dce317241e" (UID: "b19289cb-49cb-4bbc-867e-97dce317241e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:42:34.366166 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.366130    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-home\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:42:34.366166 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.366151    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-tmp-dir\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:42:34.366166 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.366161    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-model-cache\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:42:34.367967 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.367944    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b19289cb-49cb-4bbc-867e-97dce317241e-kube-api-access-mfh29" (OuterVolumeSpecName: "kube-api-access-mfh29") pod "b19289cb-49cb-4bbc-867e-97dce317241e" (UID: "b19289cb-49cb-4bbc-867e-97dce317241e"). InnerVolumeSpecName "kube-api-access-mfh29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:42:34.368381 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.368356    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-dshm" (OuterVolumeSpecName: "dshm") pod "b19289cb-49cb-4bbc-867e-97dce317241e" (UID: "b19289cb-49cb-4bbc-867e-97dce317241e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:42:34.368381 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.368368    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b19289cb-49cb-4bbc-867e-97dce317241e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b19289cb-49cb-4bbc-867e-97dce317241e" (UID: "b19289cb-49cb-4bbc-867e-97dce317241e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:42:34.467574 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.467546    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b19289cb-49cb-4bbc-867e-97dce317241e-tls-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:42:34.467574 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.467569    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b19289cb-49cb-4bbc-867e-97dce317241e-dshm\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:42:34.467740 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.467581    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfh29\" (UniqueName: \"kubernetes.io/projected/b19289cb-49cb-4bbc-867e-97dce317241e-kube-api-access-mfh29\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:42:34.746580 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.746547    2569 generic.go:356] "Generic (PLEG): container finished" podID="b19289cb-49cb-4bbc-867e-97dce317241e" containerID="6472263207c3e7367eac1bb57398922a9f1b05ebe7833a5fde28f0d600f66bb7" exitCode=0
Sep 11 14:42:34.747035 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.746593    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"
Sep 11 14:42:34.747035 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.746634    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x" event={"ID":"b19289cb-49cb-4bbc-867e-97dce317241e","Type":"ContainerDied","Data":"6472263207c3e7367eac1bb57398922a9f1b05ebe7833a5fde28f0d600f66bb7"}
Sep 11 14:42:34.747035 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.746692    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x" event={"ID":"b19289cb-49cb-4bbc-867e-97dce317241e","Type":"ContainerDied","Data":"ed3ce22f7c85be52ebd817cb55dabca23e80d304375b4bb26d7b54ec66557260"}
Sep 11 14:42:34.747035 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.746718    2569 scope.go:117] "RemoveContainer" containerID="6472263207c3e7367eac1bb57398922a9f1b05ebe7833a5fde28f0d600f66bb7"
Sep 11 14:42:34.756248 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.756228    2569 scope.go:117] "RemoveContainer" containerID="6472263207c3e7367eac1bb57398922a9f1b05ebe7833a5fde28f0d600f66bb7"
Sep 11 14:42:34.756509 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:42:34.756492    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6472263207c3e7367eac1bb57398922a9f1b05ebe7833a5fde28f0d600f66bb7\": container with ID starting with 6472263207c3e7367eac1bb57398922a9f1b05ebe7833a5fde28f0d600f66bb7 not found: ID does not exist" containerID="6472263207c3e7367eac1bb57398922a9f1b05ebe7833a5fde28f0d600f66bb7"
Sep 11 14:42:34.756559 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.756517    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6472263207c3e7367eac1bb57398922a9f1b05ebe7833a5fde28f0d600f66bb7"} err="failed to get container status \"6472263207c3e7367eac1bb57398922a9f1b05ebe7833a5fde28f0d600f66bb7\": rpc error: code = NotFound desc = could not find container \"6472263207c3e7367eac1bb57398922a9f1b05ebe7833a5fde28f0d600f66bb7\": container with ID starting with 6472263207c3e7367eac1bb57398922a9f1b05ebe7833a5fde28f0d600f66bb7 not found: ID does not exist"
Sep 11 14:42:34.781716 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.781691    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"]
Sep 11 14:42:34.800156 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:34.800135    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/auth-test-model-977c12-kserve-75f8ff8c9f-z2b6x"]
Sep 11 14:42:36.270197 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:36.270161    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b19289cb-49cb-4bbc-867e-97dce317241e" path="/var/lib/kubelet/pods/b19289cb-49cb-4bbc-867e-97dce317241e/volumes"
Sep 11 14:42:59.617751 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.617716    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"]
Sep 11 14:42:59.618259 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.618077    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b19289cb-49cb-4bbc-867e-97dce317241e" containerName="main"
Sep 11 14:42:59.618259 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.618088    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b19289cb-49cb-4bbc-867e-97dce317241e" containerName="main"
Sep 11 14:42:59.618259 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.618105    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2f318eb-ca14-483c-b9ec-e78020189a81" containerName="main"
Sep 11 14:42:59.618259 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.618110    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2f318eb-ca14-483c-b9ec-e78020189a81" containerName="main"
Sep 11 14:42:59.618259 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.618182    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b19289cb-49cb-4bbc-867e-97dce317241e" containerName="main"
Sep 11 14:42:59.618259 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.618190    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2f318eb-ca14-483c-b9ec-e78020189a81" containerName="main"
Sep 11 14:42:59.622545 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.622529    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.625756 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.625732    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-977c12\"/\"openshift-service-ca.crt\""
Sep 11 14:42:59.625923 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.625815    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-977c12\"/\"default-dockercfg-vwpdv\""
Sep 11 14:42:59.626751 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.626730    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-977c12\"/\"kube-root-ca.crt\""
Sep 11 14:42:59.627625 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.627610    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-977c12\"/\"sub-test-model-977c12-kserve-self-signed-certs\""
Sep 11 14:42:59.638328 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.638308    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"]
Sep 11 14:42:59.674862 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.674834    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-dshm\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.675020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.674891    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-model-cache\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.675020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.674987    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-tmp-dir\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.675119 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.675032    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sns6n\" (UniqueName: \"kubernetes.io/projected/da2e95cf-c18a-4f41-85a4-fc2a8377a058-kube-api-access-sns6n\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.675119 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.675071    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-home\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.675240 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.675154    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da2e95cf-c18a-4f41-85a4-fc2a8377a058-tls-certs\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.775610 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.775578    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-tmp-dir\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.775610 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.775616    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sns6n\" (UniqueName: \"kubernetes.io/projected/da2e95cf-c18a-4f41-85a4-fc2a8377a058-kube-api-access-sns6n\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.775838 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.775631    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-home\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.775838 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.775676    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da2e95cf-c18a-4f41-85a4-fc2a8377a058-tls-certs\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.775838 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.775716    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-dshm\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.775838 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.775814    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-model-cache\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.776064 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.776042    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-tmp-dir\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.776159 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.776136    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-home\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.776219 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.776156    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-model-cache\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.778153 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.778133    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-dshm\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.778231 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.778218    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da2e95cf-c18a-4f41-85a4-fc2a8377a058-tls-certs\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.797723 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.797705    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sns6n\" (UniqueName: \"kubernetes.io/projected/da2e95cf-c18a-4f41-85a4-fc2a8377a058-kube-api-access-sns6n\") pod \"sub-test-model-977c12-kserve-679df97849-clcnf\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") " pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:42:59.931653 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:42:59.931595    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:43:00.215655 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:00.215632    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"]
Sep 11 14:43:00.218304 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:43:00.218278    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podda2e95cf_c18a_4f41_85a4_fc2a8377a058.slice/crio-51a68663f843f72898073bfd87ec9344ac6a05945a507049f260d38c50f2eb70 WatchSource:0}: Error finding container 51a68663f843f72898073bfd87ec9344ac6a05945a507049f260d38c50f2eb70: Status 404 returned error can't find the container with id 51a68663f843f72898073bfd87ec9344ac6a05945a507049f260d38c50f2eb70
Sep 11 14:43:00.882404 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:00.882360    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf" event={"ID":"da2e95cf-c18a-4f41-85a4-fc2a8377a058","Type":"ContainerStarted","Data":"1cf299a1b30ae433616dd8fc651bd2341c71a462ee4ec46724b97a47cdfbbc4c"}
Sep 11 14:43:00.882922 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:00.882412    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf" event={"ID":"da2e95cf-c18a-4f41-85a4-fc2a8377a058","Type":"ContainerStarted","Data":"51a68663f843f72898073bfd87ec9344ac6a05945a507049f260d38c50f2eb70"}
Sep 11 14:43:00.901721 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:00.901672    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf" podStartSLOduration=1.901656869 podStartE2EDuration="1.901656869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:42:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:43:00.900268611 +0000 UTC m=+1677.114854272" watchObservedRunningTime="2026-09-11 14:43:00.901656869 +0000 UTC m=+1677.116242529"
Sep 11 14:43:03.931331 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:03.931302    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:43:04.557169 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:04.557141    2569 scope.go:117] "RemoveContainer" containerID="3534378b3146c4b73e1dc5464626b1f5fd16d0276aaee183fd9c2973f8386661"
Sep 11 14:43:09.932579 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:09.932549    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:43:09.933096 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:09.932611    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:43:09.945012 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:09.944989    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:43:10.945344 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:10.945312    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:43:37.268668 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:37.268629    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"]
Sep 11 14:43:37.272384 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:37.272351    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"
Sep 11 14:43:37.275329 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:37.275305    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-1af681\""
Sep 11 14:43:37.275482 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:37.275370    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-1af681-dockercfg-td9k6\""
Sep 11 14:43:37.287249 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:37.287216    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"]
Sep 11 14:43:37.402335 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:37.402309    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67af4bb3-2303-4c90-badd-6c384ce89d4f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1af681-5785d86445-5ww78\" (UID: \"67af4bb3-2303-4c90-badd-6c384ce89d4f\") " pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"
Sep 11 14:43:37.402489 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:37.402354    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qwxd\" (UniqueName: \"kubernetes.io/projected/67af4bb3-2303-4c90-badd-6c384ce89d4f-kube-api-access-7qwxd\") pod \"payload-processing-e2e-api-a-1af681-5785d86445-5ww78\" (UID: \"67af4bb3-2303-4c90-badd-6c384ce89d4f\") " pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"
Sep 11 14:43:37.503868 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:37.503842    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67af4bb3-2303-4c90-badd-6c384ce89d4f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1af681-5785d86445-5ww78\" (UID: \"67af4bb3-2303-4c90-badd-6c384ce89d4f\") " pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"
Sep 11 14:43:37.503868 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:37.503888    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qwxd\" (UniqueName: \"kubernetes.io/projected/67af4bb3-2303-4c90-badd-6c384ce89d4f-kube-api-access-7qwxd\") pod \"payload-processing-e2e-api-a-1af681-5785d86445-5ww78\" (UID: \"67af4bb3-2303-4c90-badd-6c384ce89d4f\") " pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"
Sep 11 14:43:37.504494 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:37.504475    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67af4bb3-2303-4c90-badd-6c384ce89d4f-plugins-config-volume\") pod \"payload-processing-e2e-api-a-1af681-5785d86445-5ww78\" (UID: \"67af4bb3-2303-4c90-badd-6c384ce89d4f\") " pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"
Sep 11 14:43:37.514843 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:37.514814    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qwxd\" (UniqueName: \"kubernetes.io/projected/67af4bb3-2303-4c90-badd-6c384ce89d4f-kube-api-access-7qwxd\") pod \"payload-processing-e2e-api-a-1af681-5785d86445-5ww78\" (UID: \"67af4bb3-2303-4c90-badd-6c384ce89d4f\") " pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"
Sep 11 14:43:37.584782 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:37.584728    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"
Sep 11 14:43:37.866267 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:37.866245    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"]
Sep 11 14:43:37.868497 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:43:37.868471    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67af4bb3_2303_4c90_badd_6c384ce89d4f.slice/crio-82aaa6d62dce604cc97796aefca62d50d1e519e5d6049b24739b52778d496eea WatchSource:0}: Error finding container 82aaa6d62dce604cc97796aefca62d50d1e519e5d6049b24739b52778d496eea: Status 404 returned error can't find the container with id 82aaa6d62dce604cc97796aefca62d50d1e519e5d6049b24739b52778d496eea
Sep 11 14:43:38.075537 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:38.075500    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78" event={"ID":"67af4bb3-2303-4c90-badd-6c384ce89d4f","Type":"ContainerStarted","Data":"ac4f399381c70f1c03bcf1b32bf17a371cab2648270491dfa54e48815a5c49ba"}
Sep 11 14:43:38.075721 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:38.075560    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78" event={"ID":"67af4bb3-2303-4c90-badd-6c384ce89d4f","Type":"ContainerStarted","Data":"82aaa6d62dce604cc97796aefca62d50d1e519e5d6049b24739b52778d496eea"}
Sep 11 14:43:38.075721 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:38.075667    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"
Sep 11 14:43:38.117915 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:38.117796    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78" podStartSLOduration=1.117779668 podStartE2EDuration="1.117779668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:43:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:43:38.117283478 +0000 UTC m=+1714.331869138" watchObservedRunningTime="2026-09-11 14:43:38.117779668 +0000 UTC m=+1714.332365350"
Sep 11 14:43:42.435338 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:42.435305    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:43:49.086187 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:43:49.086158    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"
Sep 11 14:44:04.583618 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:04.583585    2569 scope.go:117] "RemoveContainer" containerID="6134b2deda93e5b602ef9ecee4338b869306f62a403db4d7add83d3ac5ae1492"
Sep 11 14:44:08.516506 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.516470    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"]
Sep 11 14:44:08.520070 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.520052    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"
Sep 11 14:44:08.523376 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.523358    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-fc74dd\""
Sep 11 14:44:08.529868 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.529846    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"]
Sep 11 14:44:08.533292 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.533274    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"
Sep 11 14:44:08.536072 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.536051    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-fc74dd-dockercfg-75scr\""
Sep 11 14:44:08.553348 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.553325    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"]
Sep 11 14:44:08.574623 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.574601    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"]
Sep 11 14:44:08.667584 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.667551    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc2r5\" (UniqueName: \"kubernetes.io/projected/85724c45-0536-46d2-8d88-6d2ed51044eb-kube-api-access-nc2r5\") pod \"payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9\" (UID: \"85724c45-0536-46d2-8d88-6d2ed51044eb\") " pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"
Sep 11 14:44:08.667706 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.667654    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b070f85c-6040-40ec-a523-73fa2142a23e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg\" (UID: \"b070f85c-6040-40ec-a523-73fa2142a23e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"
Sep 11 14:44:08.667788 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.667776    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgk7m\" (UniqueName: \"kubernetes.io/projected/b070f85c-6040-40ec-a523-73fa2142a23e-kube-api-access-hgk7m\") pod \"payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg\" (UID: \"b070f85c-6040-40ec-a523-73fa2142a23e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"
Sep 11 14:44:08.667831 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.667799    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85724c45-0536-46d2-8d88-6d2ed51044eb-plugins-config-volume\") pod \"payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9\" (UID: \"85724c45-0536-46d2-8d88-6d2ed51044eb\") " pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"
Sep 11 14:44:08.769088 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.769000    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b070f85c-6040-40ec-a523-73fa2142a23e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg\" (UID: \"b070f85c-6040-40ec-a523-73fa2142a23e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"
Sep 11 14:44:08.769257 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.769123    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgk7m\" (UniqueName: \"kubernetes.io/projected/b070f85c-6040-40ec-a523-73fa2142a23e-kube-api-access-hgk7m\") pod \"payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg\" (UID: \"b070f85c-6040-40ec-a523-73fa2142a23e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"
Sep 11 14:44:08.769257 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.769149    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85724c45-0536-46d2-8d88-6d2ed51044eb-plugins-config-volume\") pod \"payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9\" (UID: \"85724c45-0536-46d2-8d88-6d2ed51044eb\") " pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"
Sep 11 14:44:08.769257 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.769178    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc2r5\" (UniqueName: \"kubernetes.io/projected/85724c45-0536-46d2-8d88-6d2ed51044eb-kube-api-access-nc2r5\") pod \"payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9\" (UID: \"85724c45-0536-46d2-8d88-6d2ed51044eb\") " pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"
Sep 11 14:44:08.769780 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.769760    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b070f85c-6040-40ec-a523-73fa2142a23e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg\" (UID: \"b070f85c-6040-40ec-a523-73fa2142a23e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"
Sep 11 14:44:08.769822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.769766    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85724c45-0536-46d2-8d88-6d2ed51044eb-plugins-config-volume\") pod \"payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9\" (UID: \"85724c45-0536-46d2-8d88-6d2ed51044eb\") " pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"
Sep 11 14:44:08.791336 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.791308    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgk7m\" (UniqueName: \"kubernetes.io/projected/b070f85c-6040-40ec-a523-73fa2142a23e-kube-api-access-hgk7m\") pod \"payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg\" (UID: \"b070f85c-6040-40ec-a523-73fa2142a23e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"
Sep 11 14:44:08.794833 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.794810    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc2r5\" (UniqueName: \"kubernetes.io/projected/85724c45-0536-46d2-8d88-6d2ed51044eb-kube-api-access-nc2r5\") pod \"payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9\" (UID: \"85724c45-0536-46d2-8d88-6d2ed51044eb\") " pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"
Sep 11 14:44:08.831790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.831755    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"
Sep 11 14:44:08.842802 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:08.842779    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"
Sep 11 14:44:09.137826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:09.137800    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"]
Sep 11 14:44:09.138792 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:44:09.138770    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb070f85c_6040_40ec_a523_73fa2142a23e.slice/crio-19a5990c465bc611156f05874690fa6b01dfcd798164ab7da2d9e174a23c675a WatchSource:0}: Error finding container 19a5990c465bc611156f05874690fa6b01dfcd798164ab7da2d9e174a23c675a: Status 404 returned error can't find the container with id 19a5990c465bc611156f05874690fa6b01dfcd798164ab7da2d9e174a23c675a
Sep 11 14:44:09.144551 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:09.144532    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"]
Sep 11 14:44:09.145044 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:44:09.145020    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85724c45_0536_46d2_8d88_6d2ed51044eb.slice/crio-880d5c41f1f7569b85ab5925d5f2068403d24f4eee0e0dea1817d12f15a1a4f0 WatchSource:0}: Error finding container 880d5c41f1f7569b85ab5925d5f2068403d24f4eee0e0dea1817d12f15a1a4f0: Status 404 returned error can't find the container with id 880d5c41f1f7569b85ab5925d5f2068403d24f4eee0e0dea1817d12f15a1a4f0
Sep 11 14:44:09.237045 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:09.237001    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg" event={"ID":"b070f85c-6040-40ec-a523-73fa2142a23e","Type":"ContainerStarted","Data":"33e66f04c0a2f5e7f46e7c84255f4b4bd038ad348aa6986877cefef70530aad2"}
Sep 11 14:44:09.237213 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:09.237100    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg" event={"ID":"b070f85c-6040-40ec-a523-73fa2142a23e","Type":"ContainerStarted","Data":"19a5990c465bc611156f05874690fa6b01dfcd798164ab7da2d9e174a23c675a"}
Sep 11 14:44:09.237286 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:09.237270    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"
Sep 11 14:44:09.239283 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:09.239255    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9" event={"ID":"85724c45-0536-46d2-8d88-6d2ed51044eb","Type":"ContainerStarted","Data":"0cf190c0577b1291986c73d5a3606eac4625e6ebb7abfc407f28e3e7d682bfcb"}
Sep 11 14:44:09.239418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:09.239299    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9" event={"ID":"85724c45-0536-46d2-8d88-6d2ed51044eb","Type":"ContainerStarted","Data":"880d5c41f1f7569b85ab5925d5f2068403d24f4eee0e0dea1817d12f15a1a4f0"}
Sep 11 14:44:09.239418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:09.239338    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"
Sep 11 14:44:09.261166 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:09.261105    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg" podStartSLOduration=1.261086331 podStartE2EDuration="1.261086331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:44:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:44:09.258114615 +0000 UTC m=+1745.472700276" watchObservedRunningTime="2026-09-11 14:44:09.261086331 +0000 UTC m=+1745.475671992"
Sep 11 14:44:09.283398 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:09.283351    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9" podStartSLOduration=1.283335151 podStartE2EDuration="1.283335151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:44:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:44:09.281082201 +0000 UTC m=+1745.495667862" watchObservedRunningTime="2026-09-11 14:44:09.283335151 +0000 UTC m=+1745.497920812"
Sep 11 14:44:16.943620 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:16.943577    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:44:20.246102 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:20.246054    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"
Sep 11 14:44:20.246490 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:20.246230    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"
Sep 11 14:44:39.364907 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:39.364848    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"]
Sep 11 14:44:39.365396 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:39.365066    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78" podUID="67af4bb3-2303-4c90-badd-6c384ce89d4f" containerName="payload-processing" containerID="cri-o://ac4f399381c70f1c03bcf1b32bf17a371cab2648270491dfa54e48815a5c49ba" gracePeriod=30
Sep 11 14:44:39.485131 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:39.485102    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"]
Sep 11 14:44:39.627129 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:39.627058    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"
Sep 11 14:44:39.730317 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:39.730286    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67af4bb3-2303-4c90-badd-6c384ce89d4f-plugins-config-volume\") pod \"67af4bb3-2303-4c90-badd-6c384ce89d4f\" (UID: \"67af4bb3-2303-4c90-badd-6c384ce89d4f\") "
Sep 11 14:44:39.730535 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:39.730333    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qwxd\" (UniqueName: \"kubernetes.io/projected/67af4bb3-2303-4c90-badd-6c384ce89d4f-kube-api-access-7qwxd\") pod \"67af4bb3-2303-4c90-badd-6c384ce89d4f\" (UID: \"67af4bb3-2303-4c90-badd-6c384ce89d4f\") "
Sep 11 14:44:39.730736 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:39.730705    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67af4bb3-2303-4c90-badd-6c384ce89d4f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "67af4bb3-2303-4c90-badd-6c384ce89d4f" (UID: "67af4bb3-2303-4c90-badd-6c384ce89d4f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:39.732556 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:39.732532    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67af4bb3-2303-4c90-badd-6c384ce89d4f-kube-api-access-7qwxd" (OuterVolumeSpecName: "kube-api-access-7qwxd") pod "67af4bb3-2303-4c90-badd-6c384ce89d4f" (UID: "67af4bb3-2303-4c90-badd-6c384ce89d4f"). InnerVolumeSpecName "kube-api-access-7qwxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:39.831311 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:39.831286    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/67af4bb3-2303-4c90-badd-6c384ce89d4f-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:39.831311 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:39.831311    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qwxd\" (UniqueName: \"kubernetes.io/projected/67af4bb3-2303-4c90-badd-6c384ce89d4f-kube-api-access-7qwxd\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:40.407523 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:40.407487    2569 generic.go:356] "Generic (PLEG): container finished" podID="67af4bb3-2303-4c90-badd-6c384ce89d4f" containerID="ac4f399381c70f1c03bcf1b32bf17a371cab2648270491dfa54e48815a5c49ba" exitCode=0
Sep 11 14:44:40.407946 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:40.407533    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"
Sep 11 14:44:40.407946 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:40.407536    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78" event={"ID":"67af4bb3-2303-4c90-badd-6c384ce89d4f","Type":"ContainerDied","Data":"ac4f399381c70f1c03bcf1b32bf17a371cab2648270491dfa54e48815a5c49ba"}
Sep 11 14:44:40.407946 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:40.407667    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78" event={"ID":"67af4bb3-2303-4c90-badd-6c384ce89d4f","Type":"ContainerDied","Data":"82aaa6d62dce604cc97796aefca62d50d1e519e5d6049b24739b52778d496eea"}
Sep 11 14:44:40.407946 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:40.407696    2569 scope.go:117] "RemoveContainer" containerID="ac4f399381c70f1c03bcf1b32bf17a371cab2648270491dfa54e48815a5c49ba"
Sep 11 14:44:40.416676 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:40.416659    2569 scope.go:117] "RemoveContainer" containerID="ac4f399381c70f1c03bcf1b32bf17a371cab2648270491dfa54e48815a5c49ba"
Sep 11 14:44:40.416954 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:44:40.416937    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac4f399381c70f1c03bcf1b32bf17a371cab2648270491dfa54e48815a5c49ba\": container with ID starting with ac4f399381c70f1c03bcf1b32bf17a371cab2648270491dfa54e48815a5c49ba not found: ID does not exist" containerID="ac4f399381c70f1c03bcf1b32bf17a371cab2648270491dfa54e48815a5c49ba"
Sep 11 14:44:40.417015 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:40.416959    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac4f399381c70f1c03bcf1b32bf17a371cab2648270491dfa54e48815a5c49ba"} err="failed to get container status \"ac4f399381c70f1c03bcf1b32bf17a371cab2648270491dfa54e48815a5c49ba\": rpc error: code = NotFound desc = could not find container \"ac4f399381c70f1c03bcf1b32bf17a371cab2648270491dfa54e48815a5c49ba\": container with ID starting with ac4f399381c70f1c03bcf1b32bf17a371cab2648270491dfa54e48815a5c49ba not found: ID does not exist"
Sep 11 14:44:40.431518 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:40.431492    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"]
Sep 11 14:44:40.437913 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:40.437868    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-1af681-5785d86445-5ww78"]
Sep 11 14:44:41.844755 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:41.844722    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"]
Sep 11 14:44:42.270740 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:42.270704    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67af4bb3-2303-4c90-badd-6c384ce89d4f" path="/var/lib/kubelet/pods/67af4bb3-2303-4c90-badd-6c384ce89d4f/volumes"
Sep 11 14:44:42.814030 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:42.813994    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:44:47.681634 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:47.681594    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn"]
Sep 11 14:44:47.682222 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:47.682201    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67af4bb3-2303-4c90-badd-6c384ce89d4f" containerName="payload-processing"
Sep 11 14:44:47.682313 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:47.682227    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="67af4bb3-2303-4c90-badd-6c384ce89d4f" containerName="payload-processing"
Sep 11 14:44:47.682374 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:47.682330    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="67af4bb3-2303-4c90-badd-6c384ce89d4f" containerName="payload-processing"
Sep 11 14:44:47.686805 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:47.686784    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn"
Sep 11 14:44:47.689937 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:47.689918    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:44:47.690032 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:47.689938    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:44:47.695492 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:47.695471    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn"]
Sep 11 14:44:47.800369 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:47.800341    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/294aed92-7782-47a4-b54b-33deba5780e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fc74dd-znffn\" (UID: \"294aed92-7782-47a4-b54b-33deba5780e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn"
Sep 11 14:44:47.901588 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:47.901562    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/294aed92-7782-47a4-b54b-33deba5780e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fc74dd-znffn\" (UID: \"294aed92-7782-47a4-b54b-33deba5780e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn"
Sep 11 14:44:47.902166 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:47.902147    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/294aed92-7782-47a4-b54b-33deba5780e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-fc74dd-znffn\" (UID: \"294aed92-7782-47a4-b54b-33deba5780e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn"
Sep 11 14:44:47.997491 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:47.997422    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn"
Sep 11 14:44:48.294218 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:44:48.294191    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294aed92_7782_47a4_b54b_33deba5780e4.slice/crio-57c285e591010729aeb5ec2e9203ba2b71f4a365a677857073256c99bd7450fb WatchSource:0}: Error finding container 57c285e591010729aeb5ec2e9203ba2b71f4a365a677857073256c99bd7450fb: Status 404 returned error can't find the container with id 57c285e591010729aeb5ec2e9203ba2b71f4a365a677857073256c99bd7450fb
Sep 11 14:44:48.295038 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:48.295011    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn"]
Sep 11 14:44:48.449717 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:48.449682    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn" event={"ID":"294aed92-7782-47a4-b54b-33deba5780e4","Type":"ContainerStarted","Data":"57c285e591010729aeb5ec2e9203ba2b71f4a365a677857073256c99bd7450fb"}
Sep 11 14:44:49.462150 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:49.462114    2569 generic.go:356] "Generic (PLEG): container finished" podID="294aed92-7782-47a4-b54b-33deba5780e4" containerID="f43e567367c6fd6b5b23c19b18605509ab337a84b439eb3022379b9310bf1df9" exitCode=0
Sep 11 14:44:49.462669 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:49.462189    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn" event={"ID":"294aed92-7782-47a4-b54b-33deba5780e4","Type":"ContainerDied","Data":"f43e567367c6fd6b5b23c19b18605509ab337a84b439eb3022379b9310bf1df9"}
Sep 11 14:44:50.598511 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:50.598486    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn"
Sep 11 14:44:50.726748 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:50.726684    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/294aed92-7782-47a4-b54b-33deba5780e4-maas-api-service-ca\") pod \"294aed92-7782-47a4-b54b-33deba5780e4\" (UID: \"294aed92-7782-47a4-b54b-33deba5780e4\") "
Sep 11 14:44:50.727049 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:50.727026    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/294aed92-7782-47a4-b54b-33deba5780e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "294aed92-7782-47a4-b54b-33deba5780e4" (UID: "294aed92-7782-47a4-b54b-33deba5780e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:44:50.827856 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:50.827828    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/294aed92-7782-47a4-b54b-33deba5780e4-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:51.474356 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:51.474324    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn" event={"ID":"294aed92-7782-47a4-b54b-33deba5780e4","Type":"ContainerDied","Data":"57c285e591010729aeb5ec2e9203ba2b71f4a365a677857073256c99bd7450fb"}
Sep 11 14:44:51.474356 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:51.474354    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn"
Sep 11 14:44:51.474564 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:51.474374    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57c285e591010729aeb5ec2e9203ba2b71f4a365a677857073256c99bd7450fb"
Sep 11 14:44:54.503742 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.503701    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9" podUID="1c34b1fd-4bf9-4f57-a6f2-d548d8601983" containerName="main" containerID="cri-o://61f0634255a32e2dd340ddbd34bb21e079ead9ed944551c091d1a561acd48251" gracePeriod=45
Sep 11 14:44:54.761168 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.761112    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:44:54.862790 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.862765    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-tmp-dir\") pod \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") "
Sep 11 14:44:54.862968 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.862797    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-525x9\" (UniqueName: \"kubernetes.io/projected/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-kube-api-access-525x9\") pod \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") "
Sep 11 14:44:54.862968 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.862857    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-model-cache\") pod \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") "
Sep 11 14:44:54.862968 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.862899    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-tls-certs\") pod \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") "
Sep 11 14:44:54.862968 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.862939    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-dshm\") pod \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") "
Sep 11 14:44:54.863195 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.862995    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-home\") pod \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\" (UID: \"1c34b1fd-4bf9-4f57-a6f2-d548d8601983\") "
Sep 11 14:44:54.863195 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.863087    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1c34b1fd-4bf9-4f57-a6f2-d548d8601983" (UID: "1c34b1fd-4bf9-4f57-a6f2-d548d8601983"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:44:54.863195 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.863132    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-model-cache" (OuterVolumeSpecName: "model-cache") pod "1c34b1fd-4bf9-4f57-a6f2-d548d8601983" (UID: "1c34b1fd-4bf9-4f57-a6f2-d548d8601983"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:44:54.863368 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.863350    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-home" (OuterVolumeSpecName: "home") pod "1c34b1fd-4bf9-4f57-a6f2-d548d8601983" (UID: "1c34b1fd-4bf9-4f57-a6f2-d548d8601983"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:44:54.863412 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.863369    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-tmp-dir\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:54.863412 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.863385    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-model-cache\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:54.865086 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.865061    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1c34b1fd-4bf9-4f57-a6f2-d548d8601983" (UID: "1c34b1fd-4bf9-4f57-a6f2-d548d8601983"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:44:54.865155 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.865126    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-dshm" (OuterVolumeSpecName: "dshm") pod "1c34b1fd-4bf9-4f57-a6f2-d548d8601983" (UID: "1c34b1fd-4bf9-4f57-a6f2-d548d8601983"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:44:54.865193 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.865168    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-kube-api-access-525x9" (OuterVolumeSpecName: "kube-api-access-525x9") pod "1c34b1fd-4bf9-4f57-a6f2-d548d8601983" (UID: "1c34b1fd-4bf9-4f57-a6f2-d548d8601983"). InnerVolumeSpecName "kube-api-access-525x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:54.964778 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.964751    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-tls-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:54.964778 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.964775    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-dshm\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:54.964778 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.964783    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-home\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:54.964982 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:54.964790    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-525x9\" (UniqueName: \"kubernetes.io/projected/1c34b1fd-4bf9-4f57-a6f2-d548d8601983-kube-api-access-525x9\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:55.502167 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:55.502090    2569 generic.go:356] "Generic (PLEG): container finished" podID="1c34b1fd-4bf9-4f57-a6f2-d548d8601983" containerID="61f0634255a32e2dd340ddbd34bb21e079ead9ed944551c091d1a561acd48251" exitCode=0
Sep 11 14:44:55.502167 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:55.502133    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"
Sep 11 14:44:55.502167 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:55.502160    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9" event={"ID":"1c34b1fd-4bf9-4f57-a6f2-d548d8601983","Type":"ContainerDied","Data":"61f0634255a32e2dd340ddbd34bb21e079ead9ed944551c091d1a561acd48251"}
Sep 11 14:44:55.502390 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:55.502197    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9" event={"ID":"1c34b1fd-4bf9-4f57-a6f2-d548d8601983","Type":"ContainerDied","Data":"2230f2aa0854b925f8d35a59743dcfd6d2ad5b47710634ef5c109eafd6d042a6"}
Sep 11 14:44:55.502390 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:55.502220    2569 scope.go:117] "RemoveContainer" containerID="61f0634255a32e2dd340ddbd34bb21e079ead9ed944551c091d1a561acd48251"
Sep 11 14:44:55.511431 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:55.511270    2569 scope.go:117] "RemoveContainer" containerID="61f0634255a32e2dd340ddbd34bb21e079ead9ed944551c091d1a561acd48251"
Sep 11 14:44:55.511664 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:44:55.511555    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61f0634255a32e2dd340ddbd34bb21e079ead9ed944551c091d1a561acd48251\": container with ID starting with 61f0634255a32e2dd340ddbd34bb21e079ead9ed944551c091d1a561acd48251 not found: ID does not exist" containerID="61f0634255a32e2dd340ddbd34bb21e079ead9ed944551c091d1a561acd48251"
Sep 11 14:44:55.511664 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:55.511579    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61f0634255a32e2dd340ddbd34bb21e079ead9ed944551c091d1a561acd48251"} err="failed to get container status \"61f0634255a32e2dd340ddbd34bb21e079ead9ed944551c091d1a561acd48251\": rpc error: code = NotFound desc = could not find container \"61f0634255a32e2dd340ddbd34bb21e079ead9ed944551c091d1a561acd48251\": container with ID starting with 61f0634255a32e2dd340ddbd34bb21e079ead9ed944551c091d1a561acd48251 not found: ID does not exist"
Sep 11 14:44:55.524185 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:55.524164    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"]
Sep 11 14:44:55.533307 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:55.533281    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8feb68/sub-test-model-8feb68-kserve-5866c9b56f-5xnn9"]
Sep 11 14:44:56.270897 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:56.270845    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c34b1fd-4bf9-4f57-a6f2-d548d8601983" path="/var/lib/kubelet/pods/1c34b1fd-4bf9-4f57-a6f2-d548d8601983/volumes"
Sep 11 14:44:56.863864 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:56.863798    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf" podUID="da2e95cf-c18a-4f41-85a4-fc2a8377a058" containerName="main" containerID="cri-o://1cf299a1b30ae433616dd8fc651bd2341c71a462ee4ec46724b97a47cdfbbc4c" gracePeriod=45
Sep 11 14:44:57.114522 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.114465    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:44:57.182046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.182017    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-dshm\") pod \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") "
Sep 11 14:44:57.182216 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.182059    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-model-cache\") pod \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") "
Sep 11 14:44:57.182216 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.182089    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-home\") pod \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") "
Sep 11 14:44:57.182216 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.182157    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-tmp-dir\") pod \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") "
Sep 11 14:44:57.182216 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.182213    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sns6n\" (UniqueName: \"kubernetes.io/projected/da2e95cf-c18a-4f41-85a4-fc2a8377a058-kube-api-access-sns6n\") pod \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") "
Sep 11 14:44:57.182422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.182273    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da2e95cf-c18a-4f41-85a4-fc2a8377a058-tls-certs\") pod \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\" (UID: \"da2e95cf-c18a-4f41-85a4-fc2a8377a058\") "
Sep 11 14:44:57.182422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.182311    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-model-cache" (OuterVolumeSpecName: "model-cache") pod "da2e95cf-c18a-4f41-85a4-fc2a8377a058" (UID: "da2e95cf-c18a-4f41-85a4-fc2a8377a058"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:44:57.182422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.182346    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-home" (OuterVolumeSpecName: "home") pod "da2e95cf-c18a-4f41-85a4-fc2a8377a058" (UID: "da2e95cf-c18a-4f41-85a4-fc2a8377a058"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:44:57.182551 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.182453    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "da2e95cf-c18a-4f41-85a4-fc2a8377a058" (UID: "da2e95cf-c18a-4f41-85a4-fc2a8377a058"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:44:57.182649 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.182632    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-tmp-dir\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:57.182719 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.182651    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-model-cache\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:57.182719 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.182660    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-home\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:57.184387 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.184367    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-dshm" (OuterVolumeSpecName: "dshm") pod "da2e95cf-c18a-4f41-85a4-fc2a8377a058" (UID: "da2e95cf-c18a-4f41-85a4-fc2a8377a058"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:44:57.184387 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.184371    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da2e95cf-c18a-4f41-85a4-fc2a8377a058-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "da2e95cf-c18a-4f41-85a4-fc2a8377a058" (UID: "da2e95cf-c18a-4f41-85a4-fc2a8377a058"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:44:57.184514 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.184426    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da2e95cf-c18a-4f41-85a4-fc2a8377a058-kube-api-access-sns6n" (OuterVolumeSpecName: "kube-api-access-sns6n") pod "da2e95cf-c18a-4f41-85a4-fc2a8377a058" (UID: "da2e95cf-c18a-4f41-85a4-fc2a8377a058"). InnerVolumeSpecName "kube-api-access-sns6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:44:57.283674 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.283640    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/da2e95cf-c18a-4f41-85a4-fc2a8377a058-tls-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:57.283674 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.283664    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/da2e95cf-c18a-4f41-85a4-fc2a8377a058-dshm\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:57.283674 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.283672    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sns6n\" (UniqueName: \"kubernetes.io/projected/da2e95cf-c18a-4f41-85a4-fc2a8377a058-kube-api-access-sns6n\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:44:57.514005 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.513977    2569 generic.go:356] "Generic (PLEG): container finished" podID="da2e95cf-c18a-4f41-85a4-fc2a8377a058" containerID="1cf299a1b30ae433616dd8fc651bd2341c71a462ee4ec46724b97a47cdfbbc4c" exitCode=0
Sep 11 14:44:57.514144 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.514017    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"
Sep 11 14:44:57.514144 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.514067    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf" event={"ID":"da2e95cf-c18a-4f41-85a4-fc2a8377a058","Type":"ContainerDied","Data":"1cf299a1b30ae433616dd8fc651bd2341c71a462ee4ec46724b97a47cdfbbc4c"}
Sep 11 14:44:57.514144 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.514105    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf" event={"ID":"da2e95cf-c18a-4f41-85a4-fc2a8377a058","Type":"ContainerDied","Data":"51a68663f843f72898073bfd87ec9344ac6a05945a507049f260d38c50f2eb70"}
Sep 11 14:44:57.514144 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.514121    2569 scope.go:117] "RemoveContainer" containerID="1cf299a1b30ae433616dd8fc651bd2341c71a462ee4ec46724b97a47cdfbbc4c"
Sep 11 14:44:57.523030 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.523012    2569 scope.go:117] "RemoveContainer" containerID="1cf299a1b30ae433616dd8fc651bd2341c71a462ee4ec46724b97a47cdfbbc4c"
Sep 11 14:44:57.523308 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:44:57.523286    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cf299a1b30ae433616dd8fc651bd2341c71a462ee4ec46724b97a47cdfbbc4c\": container with ID starting with 1cf299a1b30ae433616dd8fc651bd2341c71a462ee4ec46724b97a47cdfbbc4c not found: ID does not exist" containerID="1cf299a1b30ae433616dd8fc651bd2341c71a462ee4ec46724b97a47cdfbbc4c"
Sep 11 14:44:57.523378 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.523317    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cf299a1b30ae433616dd8fc651bd2341c71a462ee4ec46724b97a47cdfbbc4c"} err="failed to get container status \"1cf299a1b30ae433616dd8fc651bd2341c71a462ee4ec46724b97a47cdfbbc4c\": rpc error: code = NotFound desc = could not find container \"1cf299a1b30ae433616dd8fc651bd2341c71a462ee4ec46724b97a47cdfbbc4c\": container with ID starting with 1cf299a1b30ae433616dd8fc651bd2341c71a462ee4ec46724b97a47cdfbbc4c not found: ID does not exist"
Sep 11 14:44:57.538224 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.538202    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"]
Sep 11 14:44:57.541715 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:57.541697    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/sub-test-model-977c12-kserve-679df97849-clcnf"]
Sep 11 14:44:58.270919 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:58.270861    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da2e95cf-c18a-4f41-85a4-fc2a8377a058" path="/var/lib/kubelet/pods/da2e95cf-c18a-4f41-85a4-fc2a8377a058/volumes"
Sep 11 14:44:59.052985 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:44:59.052952    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:45:00.210471 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.210440    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818965-l87wm"]
Sep 11 14:45:00.210869 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.210856    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da2e95cf-c18a-4f41-85a4-fc2a8377a058" containerName="main"
Sep 11 14:45:00.210869 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.210888    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="da2e95cf-c18a-4f41-85a4-fc2a8377a058" containerName="main"
Sep 11 14:45:00.210984 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.210901    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294aed92-7782-47a4-b54b-33deba5780e4" containerName="revoke-keys"
Sep 11 14:45:00.210984 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.210907    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="294aed92-7782-47a4-b54b-33deba5780e4" containerName="revoke-keys"
Sep 11 14:45:00.210984 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.210914    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c34b1fd-4bf9-4f57-a6f2-d548d8601983" containerName="main"
Sep 11 14:45:00.210984 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.210920    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c34b1fd-4bf9-4f57-a6f2-d548d8601983" containerName="main"
Sep 11 14:45:00.210984 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.210982    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="294aed92-7782-47a4-b54b-33deba5780e4" containerName="revoke-keys"
Sep 11 14:45:00.211136 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.210994    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="da2e95cf-c18a-4f41-85a4-fc2a8377a058" containerName="main"
Sep 11 14:45:00.211136 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.211003    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c34b1fd-4bf9-4f57-a6f2-d548d8601983" containerName="main"
Sep 11 14:45:00.215396 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.215376    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-l87wm"
Sep 11 14:45:00.220483 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:45:00.220452    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-29818965-l87wm\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" podUID="7ef16e15-61b9-4c49-becc-6dd37be091d9" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-l87wm"
Sep 11 14:45:00.222048 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.222030    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:45:00.224792 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.224775    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-l87wm"
Sep 11 14:45:00.243366 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.243338    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818965-l87wm"]
Sep 11 14:45:00.254505 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.254478    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl"]
Sep 11 14:45:00.259982 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.259958    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"]
Sep 11 14:45:00.260111 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.260070    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl"
Sep 11 14:45:00.263719 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.263702    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"
Sep 11 14:45:00.273511 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.273350    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl"
Sep 11 14:45:00.280810 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.280778    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"
Sep 11 14:45:00.284850 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.284825    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl"]
Sep 11 14:45:00.308894 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.308837    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"]
Sep 11 14:45:00.532181 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.532154    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818965-l87wm"]
Sep 11 14:45:00.533594 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:45:00.533566    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef16e15_61b9_4c49_becc_6dd37be091d9.slice/crio-d5cfc2d65a3046400a7668ce5a39de7e395d57a24d8edf13eb5c8239c18d772e WatchSource:0}: Error finding container d5cfc2d65a3046400a7668ce5a39de7e395d57a24d8edf13eb5c8239c18d772e: Status 404 returned error can't find the container with id d5cfc2d65a3046400a7668ce5a39de7e395d57a24d8edf13eb5c8239c18d772e
Sep 11 14:45:00.602140 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.602117    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl"]
Sep 11 14:45:00.602377 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:45:00.602358    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ccfe77_71ce_41d3_9c3a_86a4a9c89f88.slice/crio-441d1e000a9cd4236b8be9939ab2fbd28bd6a8d55c332f4aa895077b2e5f435f WatchSource:0}: Error finding container 441d1e000a9cd4236b8be9939ab2fbd28bd6a8d55c332f4aa895077b2e5f435f: Status 404 returned error can't find the container with id 441d1e000a9cd4236b8be9939ab2fbd28bd6a8d55c332f4aa895077b2e5f435f
Sep 11 14:45:00.603371 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:45:00.603352    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd032c7ad_8fd1_4e20_934b_de622536c1e4.slice/crio-314b14134c51f9b71b0dd42f94b8f437e226c054b02511019ab1eff09fa77d0c WatchSource:0}: Error finding container 314b14134c51f9b71b0dd42f94b8f437e226c054b02511019ab1eff09fa77d0c: Status 404 returned error can't find the container with id 314b14134c51f9b71b0dd42f94b8f437e226c054b02511019ab1eff09fa77d0c
Sep 11 14:45:00.604446 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:00.604426    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"]
Sep 11 14:45:01.539131 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:01.539098    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd" event={"ID":"b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88","Type":"ContainerStarted","Data":"2b7f50725778c2ad78e5d1d6274e9a0fd1afe5d5cbb81876cec52cadee54f0c9"}
Sep 11 14:45:01.539429 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:01.539152    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd" event={"ID":"b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88","Type":"ContainerStarted","Data":"441d1e000a9cd4236b8be9939ab2fbd28bd6a8d55c332f4aa895077b2e5f435f"}
Sep 11 14:45:01.540502 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:01.540475    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl" event={"ID":"d032c7ad-8fd1-4e20-934b-de622536c1e4","Type":"ContainerStarted","Data":"4f5268dc4cebaef950eccb04c1866c8f9ff7c5064bc7f6f89adc85f77fa2da48"}
Sep 11 14:45:01.540591 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:01.540526    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl" event={"ID":"d032c7ad-8fd1-4e20-934b-de622536c1e4","Type":"ContainerStarted","Data":"314b14134c51f9b71b0dd42f94b8f437e226c054b02511019ab1eff09fa77d0c"}
Sep 11 14:45:01.541961 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:01.541936    2569 generic.go:356] "Generic (PLEG): container finished" podID="7ef16e15-61b9-4c49-becc-6dd37be091d9" containerID="752a7b2749fff8423bab89a381d9f6f2e7e3ff3e228952264bca3876a9be92c7" exitCode=0
Sep 11 14:45:01.542059 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:01.542015    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-l87wm" event={"ID":"7ef16e15-61b9-4c49-becc-6dd37be091d9","Type":"ContainerDied","Data":"752a7b2749fff8423bab89a381d9f6f2e7e3ff3e228952264bca3876a9be92c7"}
Sep 11 14:45:01.542112 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:01.542065    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-l87wm" event={"ID":"7ef16e15-61b9-4c49-becc-6dd37be091d9","Type":"ContainerStarted","Data":"d5cfc2d65a3046400a7668ce5a39de7e395d57a24d8edf13eb5c8239c18d772e"}
Sep 11 14:45:01.585464 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:01.585422    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl" podStartSLOduration=1.585407263 podStartE2EDuration="1.585407263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:45:01.584252117 +0000 UTC m=+1797.798837778" watchObservedRunningTime="2026-09-11 14:45:01.585407263 +0000 UTC m=+1797.799992940"
Sep 11 14:45:02.549791 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:02.549744    2569 generic.go:356] "Generic (PLEG): container finished" podID="d032c7ad-8fd1-4e20-934b-de622536c1e4" containerID="4f5268dc4cebaef950eccb04c1866c8f9ff7c5064bc7f6f89adc85f77fa2da48" exitCode=0
Sep 11 14:45:02.550224 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:02.549822    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl" event={"ID":"d032c7ad-8fd1-4e20-934b-de622536c1e4","Type":"ContainerDied","Data":"4f5268dc4cebaef950eccb04c1866c8f9ff7c5064bc7f6f89adc85f77fa2da48"}
Sep 11 14:45:02.551908 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:02.551857    2569 generic.go:356] "Generic (PLEG): container finished" podID="b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88" containerID="2b7f50725778c2ad78e5d1d6274e9a0fd1afe5d5cbb81876cec52cadee54f0c9" exitCode=0
Sep 11 14:45:02.552018 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:02.551910    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd" event={"ID":"b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88","Type":"ContainerDied","Data":"2b7f50725778c2ad78e5d1d6274e9a0fd1afe5d5cbb81876cec52cadee54f0c9"}
Sep 11 14:45:02.704062 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:02.704041    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-l87wm"
Sep 11 14:45:02.722605 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:02.722583    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"
Sep 11 14:45:03.404602 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.404571    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"]
Sep 11 14:45:03.413483 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.413457    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"]
Sep 11 14:45:03.445313 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.445281    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"]
Sep 11 14:45:03.445584 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.445532    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9" podUID="85724c45-0536-46d2-8d88-6d2ed51044eb" containerName="payload-processing" containerID="cri-o://0cf190c0577b1291986c73d5a3606eac4625e6ebb7abfc407f28e3e7d682bfcb" gracePeriod=30
Sep 11 14:45:03.452648 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.452167    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"]
Sep 11 14:45:03.452648 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.452416    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg" podUID="b070f85c-6040-40ec-a523-73fa2142a23e" containerName="payload-pre-processing" containerID="cri-o://33e66f04c0a2f5e7f46e7c84255f4b4bd038ad348aa6986877cefef70530aad2" gracePeriod=30
Sep 11 14:45:03.558837 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.558811    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"
Sep 11 14:45:03.559261 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.558846    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="441d1e000a9cd4236b8be9939ab2fbd28bd6a8d55c332f4aa895077b2e5f435f"
Sep 11 14:45:03.560401 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.560379    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-l87wm"
Sep 11 14:45:03.560537 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.560410    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818965-l87wm" event={"ID":"7ef16e15-61b9-4c49-becc-6dd37be091d9","Type":"ContainerDied","Data":"d5cfc2d65a3046400a7668ce5a39de7e395d57a24d8edf13eb5c8239c18d772e"}
Sep 11 14:45:03.560537 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.560466    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5cfc2d65a3046400a7668ce5a39de7e395d57a24d8edf13eb5c8239c18d772e"
Sep 11 14:45:03.580347 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:45:03.580315    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" podUID="b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"
Sep 11 14:45:03.585904 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:45:03.585291    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" podUID="b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"
Sep 11 14:45:03.724197 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.724168    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"
Sep 11 14:45:03.746277 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.746250    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl"
Sep 11 14:45:03.756840 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.756816    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"
Sep 11 14:45:03.766093 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:45:03.766061    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" podUID="b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"
Sep 11 14:45:03.807059 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:45:03.807023    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" podUID="b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"
Sep 11 14:45:03.838637 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.838609    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc2r5\" (UniqueName: \"kubernetes.io/projected/85724c45-0536-46d2-8d88-6d2ed51044eb-kube-api-access-nc2r5\") pod \"85724c45-0536-46d2-8d88-6d2ed51044eb\" (UID: \"85724c45-0536-46d2-8d88-6d2ed51044eb\") "
Sep 11 14:45:03.838844 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.838815    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b070f85c-6040-40ec-a523-73fa2142a23e-plugins-config-volume\") pod \"b070f85c-6040-40ec-a523-73fa2142a23e\" (UID: \"b070f85c-6040-40ec-a523-73fa2142a23e\") "
Sep 11 14:45:03.838943 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.838862    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgk7m\" (UniqueName: \"kubernetes.io/projected/b070f85c-6040-40ec-a523-73fa2142a23e-kube-api-access-hgk7m\") pod \"b070f85c-6040-40ec-a523-73fa2142a23e\" (UID: \"b070f85c-6040-40ec-a523-73fa2142a23e\") "
Sep 11 14:45:03.839005 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.838984    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85724c45-0536-46d2-8d88-6d2ed51044eb-plugins-config-volume\") pod \"85724c45-0536-46d2-8d88-6d2ed51044eb\" (UID: \"85724c45-0536-46d2-8d88-6d2ed51044eb\") "
Sep 11 14:45:03.839429 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.839392    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn"]
Sep 11 14:45:03.839696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.839667    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85724c45-0536-46d2-8d88-6d2ed51044eb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "85724c45-0536-46d2-8d88-6d2ed51044eb" (UID: "85724c45-0536-46d2-8d88-6d2ed51044eb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:45:03.840014 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.839993    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b070f85c-6040-40ec-a523-73fa2142a23e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b070f85c-6040-40ec-a523-73fa2142a23e" (UID: "b070f85c-6040-40ec-a523-73fa2142a23e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:45:03.841719 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.841694    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85724c45-0536-46d2-8d88-6d2ed51044eb-kube-api-access-nc2r5" (OuterVolumeSpecName: "kube-api-access-nc2r5") pod "85724c45-0536-46d2-8d88-6d2ed51044eb" (UID: "85724c45-0536-46d2-8d88-6d2ed51044eb"). InnerVolumeSpecName "kube-api-access-nc2r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:45:03.841911 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.841856    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b070f85c-6040-40ec-a523-73fa2142a23e-kube-api-access-hgk7m" (OuterVolumeSpecName: "kube-api-access-hgk7m") pod "b070f85c-6040-40ec-a523-73fa2142a23e" (UID: "b070f85c-6040-40ec-a523-73fa2142a23e"). InnerVolumeSpecName "kube-api-access-hgk7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:45:03.850994 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.850960    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-fc74dd-znffn"]
Sep 11 14:45:03.940783 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.940756    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85724c45-0536-46d2-8d88-6d2ed51044eb-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:03.940783 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.940780    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc2r5\" (UniqueName: \"kubernetes.io/projected/85724c45-0536-46d2-8d88-6d2ed51044eb-kube-api-access-nc2r5\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:03.940966 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.940792    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b070f85c-6040-40ec-a523-73fa2142a23e-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:03.940966 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:03.940800    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgk7m\" (UniqueName: \"kubernetes.io/projected/b070f85c-6040-40ec-a523-73fa2142a23e-kube-api-access-hgk7m\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:04.271090 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:45:04.271012    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd\" is forbidden: User \"system:node:ip-10-0-137-70.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"odh-ai-gateway-infra\": no relationship found between node 'ip-10-0-137-70.ec2.internal' and this object" podUID="b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fc74dd-29818965-z2ssd"
Sep 11 14:45:04.271542 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.271518    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="294aed92-7782-47a4-b54b-33deba5780e4" path="/var/lib/kubelet/pods/294aed92-7782-47a4-b54b-33deba5780e4/volumes"
Sep 11 14:45:04.271800 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.271787    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88" path="/var/lib/kubelet/pods/b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88/volumes"
Sep 11 14:45:04.330008 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.329980    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:45:04.334070 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.334050    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:45:04.566378 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.566301    2569 generic.go:356] "Generic (PLEG): container finished" podID="85724c45-0536-46d2-8d88-6d2ed51044eb" containerID="0cf190c0577b1291986c73d5a3606eac4625e6ebb7abfc407f28e3e7d682bfcb" exitCode=0
Sep 11 14:45:04.566378 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.566342    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"
Sep 11 14:45:04.566845 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.566383    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9" event={"ID":"85724c45-0536-46d2-8d88-6d2ed51044eb","Type":"ContainerDied","Data":"0cf190c0577b1291986c73d5a3606eac4625e6ebb7abfc407f28e3e7d682bfcb"}
Sep 11 14:45:04.566845 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.566436    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9" event={"ID":"85724c45-0536-46d2-8d88-6d2ed51044eb","Type":"ContainerDied","Data":"880d5c41f1f7569b85ab5925d5f2068403d24f4eee0e0dea1817d12f15a1a4f0"}
Sep 11 14:45:04.566845 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.566459    2569 scope.go:117] "RemoveContainer" containerID="0cf190c0577b1291986c73d5a3606eac4625e6ebb7abfc407f28e3e7d682bfcb"
Sep 11 14:45:04.568192 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.568169    2569 generic.go:356] "Generic (PLEG): container finished" podID="b070f85c-6040-40ec-a523-73fa2142a23e" containerID="33e66f04c0a2f5e7f46e7c84255f4b4bd038ad348aa6986877cefef70530aad2" exitCode=0
Sep 11 14:45:04.568346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.568209    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"
Sep 11 14:45:04.568346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.568239    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg" event={"ID":"b070f85c-6040-40ec-a523-73fa2142a23e","Type":"ContainerDied","Data":"33e66f04c0a2f5e7f46e7c84255f4b4bd038ad348aa6986877cefef70530aad2"}
Sep 11 14:45:04.568346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.568287    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg" event={"ID":"b070f85c-6040-40ec-a523-73fa2142a23e","Type":"ContainerDied","Data":"19a5990c465bc611156f05874690fa6b01dfcd798164ab7da2d9e174a23c675a"}
Sep 11 14:45:04.570283 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.570261    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl" event={"ID":"d032c7ad-8fd1-4e20-934b-de622536c1e4","Type":"ContainerDied","Data":"314b14134c51f9b71b0dd42f94b8f437e226c054b02511019ab1eff09fa77d0c"}
Sep 11 14:45:04.570411 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.570304    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="314b14134c51f9b71b0dd42f94b8f437e226c054b02511019ab1eff09fa77d0c"
Sep 11 14:45:04.570411 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.570273    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl"
Sep 11 14:45:04.576536 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.576521    2569 scope.go:117] "RemoveContainer" containerID="0cf190c0577b1291986c73d5a3606eac4625e6ebb7abfc407f28e3e7d682bfcb"
Sep 11 14:45:04.576801 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:45:04.576783    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0cf190c0577b1291986c73d5a3606eac4625e6ebb7abfc407f28e3e7d682bfcb\": container with ID starting with 0cf190c0577b1291986c73d5a3606eac4625e6ebb7abfc407f28e3e7d682bfcb not found: ID does not exist" containerID="0cf190c0577b1291986c73d5a3606eac4625e6ebb7abfc407f28e3e7d682bfcb"
Sep 11 14:45:04.576888 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.576811    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0cf190c0577b1291986c73d5a3606eac4625e6ebb7abfc407f28e3e7d682bfcb"} err="failed to get container status \"0cf190c0577b1291986c73d5a3606eac4625e6ebb7abfc407f28e3e7d682bfcb\": rpc error: code = NotFound desc = could not find container \"0cf190c0577b1291986c73d5a3606eac4625e6ebb7abfc407f28e3e7d682bfcb\": container with ID starting with 0cf190c0577b1291986c73d5a3606eac4625e6ebb7abfc407f28e3e7d682bfcb not found: ID does not exist"
Sep 11 14:45:04.576888 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.576834    2569 scope.go:117] "RemoveContainer" containerID="33e66f04c0a2f5e7f46e7c84255f4b4bd038ad348aa6986877cefef70530aad2"
Sep 11 14:45:04.584580 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.584566    2569 scope.go:117] "RemoveContainer" containerID="33e66f04c0a2f5e7f46e7c84255f4b4bd038ad348aa6986877cefef70530aad2"
Sep 11 14:45:04.584859 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:45:04.584841    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33e66f04c0a2f5e7f46e7c84255f4b4bd038ad348aa6986877cefef70530aad2\": container with ID starting with 33e66f04c0a2f5e7f46e7c84255f4b4bd038ad348aa6986877cefef70530aad2 not found: ID does not exist" containerID="33e66f04c0a2f5e7f46e7c84255f4b4bd038ad348aa6986877cefef70530aad2"
Sep 11 14:45:04.584946 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.584865    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e66f04c0a2f5e7f46e7c84255f4b4bd038ad348aa6986877cefef70530aad2"} err="failed to get container status \"33e66f04c0a2f5e7f46e7c84255f4b4bd038ad348aa6986877cefef70530aad2\": rpc error: code = NotFound desc = could not find container \"33e66f04c0a2f5e7f46e7c84255f4b4bd038ad348aa6986877cefef70530aad2\": container with ID starting with 33e66f04c0a2f5e7f46e7c84255f4b4bd038ad348aa6986877cefef70530aad2 not found: ID does not exist"
Sep 11 14:45:04.589337 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.589174    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"]
Sep 11 14:45:04.591423 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.591404    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-fc74dd-6fb4565f8b-8rhqg"]
Sep 11 14:45:04.633518 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.633496    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"]
Sep 11 14:45:04.644328 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:04.644306    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-fc74dd-76f796cf9c-g7hm9"]
Sep 11 14:45:06.270613 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:06.270578    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85724c45-0536-46d2-8d88-6d2ed51044eb" path="/var/lib/kubelet/pods/85724c45-0536-46d2-8d88-6d2ed51044eb/volumes"
Sep 11 14:45:06.271015 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:06.270932    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b070f85c-6040-40ec-a523-73fa2142a23e" path="/var/lib/kubelet/pods/b070f85c-6040-40ec-a523-73fa2142a23e/volumes"
Sep 11 14:45:07.925840 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.925799    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"]
Sep 11 14:45:07.926355 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926336    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d032c7ad-8fd1-4e20-934b-de622536c1e4" containerName="cleanup"
Sep 11 14:45:07.926450 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926364    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d032c7ad-8fd1-4e20-934b-de622536c1e4" containerName="cleanup"
Sep 11 14:45:07.926450 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926379    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b070f85c-6040-40ec-a523-73fa2142a23e" containerName="payload-pre-processing"
Sep 11 14:45:07.926450 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926387    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b070f85c-6040-40ec-a523-73fa2142a23e" containerName="payload-pre-processing"
Sep 11 14:45:07.926450 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926396    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ef16e15-61b9-4c49-becc-6dd37be091d9" containerName="cleanup"
Sep 11 14:45:07.926450 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926404    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ef16e15-61b9-4c49-becc-6dd37be091d9" containerName="cleanup"
Sep 11 14:45:07.926696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926452    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88" containerName="cleanup"
Sep 11 14:45:07.926696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926461    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88" containerName="cleanup"
Sep 11 14:45:07.926696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926472    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85724c45-0536-46d2-8d88-6d2ed51044eb" containerName="payload-processing"
Sep 11 14:45:07.926696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926482    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="85724c45-0536-46d2-8d88-6d2ed51044eb" containerName="payload-processing"
Sep 11 14:45:07.926696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926581    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="85724c45-0536-46d2-8d88-6d2ed51044eb" containerName="payload-processing"
Sep 11 14:45:07.926696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926613    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ef16e15-61b9-4c49-becc-6dd37be091d9" containerName="cleanup"
Sep 11 14:45:07.926696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926630    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5ccfe77-71ce-41d3-9c3a-86a4a9c89f88" containerName="cleanup"
Sep 11 14:45:07.926696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926640    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d032c7ad-8fd1-4e20-934b-de622536c1e4" containerName="cleanup"
Sep 11 14:45:07.926696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.926649    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b070f85c-6040-40ec-a523-73fa2142a23e" containerName="payload-pre-processing"
Sep 11 14:45:07.929852 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.929831    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:07.932753 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.932730    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-977c12\"/\"openshift-service-ca.crt\""
Sep 11 14:45:07.934003 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.933970    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-977c12\"/\"default-dockercfg-vwpdv\""
Sep 11 14:45:07.934146 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.934018    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-977c12\"/\"kube-root-ca.crt\""
Sep 11 14:45:07.934281 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.934267    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-977c12\"/\"rate-test-model-977c12-kserve-self-signed-certs\""
Sep 11 14:45:07.943220 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:07.943193    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"]
Sep 11 14:45:08.074677 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.074649    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-tmp-dir\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.074828 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.074694    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-model-cache\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.074828 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.074716    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57749406-1e4b-4af5-b6de-f1aa0a9573ba-tls-certs\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.074828 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.074731    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-home\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.074828 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.074813    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-dshm\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.074992 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.074916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlxsr\" (UniqueName: \"kubernetes.io/projected/57749406-1e4b-4af5-b6de-f1aa0a9573ba-kube-api-access-mlxsr\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.175967 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.175857    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlxsr\" (UniqueName: \"kubernetes.io/projected/57749406-1e4b-4af5-b6de-f1aa0a9573ba-kube-api-access-mlxsr\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.175967 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.175911    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-tmp-dir\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.175967 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.175963    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-model-cache\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.176237 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.175996    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57749406-1e4b-4af5-b6de-f1aa0a9573ba-tls-certs\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.176301 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.176244    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-home\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.176353 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.176301    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-dshm\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.176408 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.176364    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-model-cache\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.176778 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.176749    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-tmp-dir\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.176910 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.176786    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-home\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.178826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.178800    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-dshm\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.179737 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.179618    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57749406-1e4b-4af5-b6de-f1aa0a9573ba-tls-certs\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.187721 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.187689    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlxsr\" (UniqueName: \"kubernetes.io/projected/57749406-1e4b-4af5-b6de-f1aa0a9573ba-kube-api-access-mlxsr\") pod \"rate-test-model-977c12-kserve-6699bf687f-szvrp\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") " pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.239383 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.239359    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:08.517847 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.517826    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"]
Sep 11 14:45:08.519362 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:45:08.519336    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57749406_1e4b_4af5_b6de_f1aa0a9573ba.slice/crio-edeccd392280688b4f830fbc9f6e3ecff13aeb2d224cb8a24e0356158ba0ed2a WatchSource:0}: Error finding container edeccd392280688b4f830fbc9f6e3ecff13aeb2d224cb8a24e0356158ba0ed2a: Status 404 returned error can't find the container with id edeccd392280688b4f830fbc9f6e3ecff13aeb2d224cb8a24e0356158ba0ed2a
Sep 11 14:45:08.591369 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.591335    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp" event={"ID":"57749406-1e4b-4af5-b6de-f1aa0a9573ba","Type":"ContainerStarted","Data":"f8795b9efa37a983287ca7bcc6d2a2bd0afb449a18b8ec8115b0b4324b2e4588"}
Sep 11 14:45:08.591479 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.591388    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp" event={"ID":"57749406-1e4b-4af5-b6de-f1aa0a9573ba","Type":"ContainerStarted","Data":"edeccd392280688b4f830fbc9f6e3ecff13aeb2d224cb8a24e0356158ba0ed2a"}
Sep 11 14:45:08.611590 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:08.611542    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp" podStartSLOduration=1.611526339 podStartE2EDuration="1.611526339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:45:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:45:08.610913773 +0000 UTC m=+1804.825499434" watchObservedRunningTime="2026-09-11 14:45:08.611526339 +0000 UTC m=+1804.826112041"
Sep 11 14:45:11.357397 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:11.357360    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995"]
Sep 11 14:45:11.360695 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:11.360673    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995"
Sep 11 14:45:11.368414 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:11.368395    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:45:11.368505 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:11.368409    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:45:11.378623 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:11.378602    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995"]
Sep 11 14:45:11.506384 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:11.506350    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7b81bf-7ebd-4020-8bfe-a69c55b6c430-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995\" (UID: \"8e7b81bf-7ebd-4020-8bfe-a69c55b6c430\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995"
Sep 11 14:45:11.607323 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:11.607288    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7b81bf-7ebd-4020-8bfe-a69c55b6c430-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995\" (UID: \"8e7b81bf-7ebd-4020-8bfe-a69c55b6c430\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995"
Sep 11 14:45:11.607958 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:11.607910    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7b81bf-7ebd-4020-8bfe-a69c55b6c430-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995\" (UID: \"8e7b81bf-7ebd-4020-8bfe-a69c55b6c430\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995"
Sep 11 14:45:11.671594 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:11.671565    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995"
Sep 11 14:45:11.957787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:11.957757    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995"]
Sep 11 14:45:11.960267 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:45:11.960236    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e7b81bf_7ebd_4020_8bfe_a69c55b6c430.slice/crio-4aaa1d875b9aa4bb8fb3a044fe2feb8db0b7bde578e028efa8ce27aecba32c4d WatchSource:0}: Error finding container 4aaa1d875b9aa4bb8fb3a044fe2feb8db0b7bde578e028efa8ce27aecba32c4d: Status 404 returned error can't find the container with id 4aaa1d875b9aa4bb8fb3a044fe2feb8db0b7bde578e028efa8ce27aecba32c4d
Sep 11 14:45:12.319501 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:12.319475    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:45:12.615673 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:12.615647    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995" event={"ID":"8e7b81bf-7ebd-4020-8bfe-a69c55b6c430","Type":"ContainerStarted","Data":"6f99b618afe9e43650e83321d222008feec939c96deae08dfe7b3a1e8b3d4e8d"}
Sep 11 14:45:12.616005 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:12.615696    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995" event={"ID":"8e7b81bf-7ebd-4020-8bfe-a69c55b6c430","Type":"ContainerStarted","Data":"4aaa1d875b9aa4bb8fb3a044fe2feb8db0b7bde578e028efa8ce27aecba32c4d"}
Sep 11 14:45:12.634744 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:12.634695    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995" podStartSLOduration=1.634677089 podStartE2EDuration="1.634677089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:45:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:45:12.633056031 +0000 UTC m=+1808.847641719" watchObservedRunningTime="2026-09-11 14:45:12.634677089 +0000 UTC m=+1808.849262757"
Sep 11 14:45:13.623313 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:13.623277    2569 generic.go:356] "Generic (PLEG): container finished" podID="8e7b81bf-7ebd-4020-8bfe-a69c55b6c430" containerID="6f99b618afe9e43650e83321d222008feec939c96deae08dfe7b3a1e8b3d4e8d" exitCode=0
Sep 11 14:45:13.623313 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:13.623316    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995" event={"ID":"8e7b81bf-7ebd-4020-8bfe-a69c55b6c430","Type":"ContainerDied","Data":"6f99b618afe9e43650e83321d222008feec939c96deae08dfe7b3a1e8b3d4e8d"}
Sep 11 14:45:14.759536 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:14.759512    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995"
Sep 11 14:45:14.940140 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:14.940105    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7b81bf-7ebd-4020-8bfe-a69c55b6c430-maas-api-service-ca\") pod \"8e7b81bf-7ebd-4020-8bfe-a69c55b6c430\" (UID: \"8e7b81bf-7ebd-4020-8bfe-a69c55b6c430\") "
Sep 11 14:45:14.940471 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:14.940447    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e7b81bf-7ebd-4020-8bfe-a69c55b6c430-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8e7b81bf-7ebd-4020-8bfe-a69c55b6c430" (UID: "8e7b81bf-7ebd-4020-8bfe-a69c55b6c430"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:45:15.041828 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:15.041797    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e7b81bf-7ebd-4020-8bfe-a69c55b6c430-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:15.636483 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:15.636450    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995" event={"ID":"8e7b81bf-7ebd-4020-8bfe-a69c55b6c430","Type":"ContainerDied","Data":"4aaa1d875b9aa4bb8fb3a044fe2feb8db0b7bde578e028efa8ce27aecba32c4d"}
Sep 11 14:45:15.636483 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:15.636475    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995"
Sep 11 14:45:15.636698 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:15.636498    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4aaa1d875b9aa4bb8fb3a044fe2feb8db0b7bde578e028efa8ce27aecba32c4d"
Sep 11 14:45:18.240240 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:18.240204    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:18.240240 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:18.240248    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:18.253121 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:18.253096    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:18.663159 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:18.663132    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:45:22.114897 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.114837    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"]
Sep 11 14:45:22.115365 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.115123    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5" podUID="c49967f3-c5c9-415b-9b33-5712502b59bd" containerName="payload-processing" containerID="cri-o://b51114d02a3015d9468e2b3257ab874eed281cd4a65f1229eb684a65a2a74fb9" gracePeriod=30
Sep 11 14:45:22.377103 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.377029    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"
Sep 11 14:45:22.404945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.404912    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c49967f3-c5c9-415b-9b33-5712502b59bd-plugins-config-volume\") pod \"c49967f3-c5c9-415b-9b33-5712502b59bd\" (UID: \"c49967f3-c5c9-415b-9b33-5712502b59bd\") "
Sep 11 14:45:22.405122 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.405019    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8cmgx\" (UniqueName: \"kubernetes.io/projected/c49967f3-c5c9-415b-9b33-5712502b59bd-kube-api-access-8cmgx\") pod \"c49967f3-c5c9-415b-9b33-5712502b59bd\" (UID: \"c49967f3-c5c9-415b-9b33-5712502b59bd\") "
Sep 11 14:45:22.405301 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.405274    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c49967f3-c5c9-415b-9b33-5712502b59bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c49967f3-c5c9-415b-9b33-5712502b59bd" (UID: "c49967f3-c5c9-415b-9b33-5712502b59bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:45:22.407283 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.407260    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c49967f3-c5c9-415b-9b33-5712502b59bd-kube-api-access-8cmgx" (OuterVolumeSpecName: "kube-api-access-8cmgx") pod "c49967f3-c5c9-415b-9b33-5712502b59bd" (UID: "c49967f3-c5c9-415b-9b33-5712502b59bd"). InnerVolumeSpecName "kube-api-access-8cmgx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:45:22.454397 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.454346    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995"]
Sep 11 14:45:22.456323 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.456293    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-28858c-n8995"]
Sep 11 14:45:22.505985 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.505957    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8cmgx\" (UniqueName: \"kubernetes.io/projected/c49967f3-c5c9-415b-9b33-5712502b59bd-kube-api-access-8cmgx\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:22.505985 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.505983    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c49967f3-c5c9-415b-9b33-5712502b59bd-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:22.672219 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.672137    2569 generic.go:356] "Generic (PLEG): container finished" podID="c49967f3-c5c9-415b-9b33-5712502b59bd" containerID="b51114d02a3015d9468e2b3257ab874eed281cd4a65f1229eb684a65a2a74fb9" exitCode=0
Sep 11 14:45:22.672219 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.672181    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"
Sep 11 14:45:22.672219 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.672208    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5" event={"ID":"c49967f3-c5c9-415b-9b33-5712502b59bd","Type":"ContainerDied","Data":"b51114d02a3015d9468e2b3257ab874eed281cd4a65f1229eb684a65a2a74fb9"}
Sep 11 14:45:22.672416 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.672249    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5" event={"ID":"c49967f3-c5c9-415b-9b33-5712502b59bd","Type":"ContainerDied","Data":"a2cb86ee3e8d1639f78814a634683b031d9d3d19f039aca0e69d5d1b7852f8e7"}
Sep 11 14:45:22.672416 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.672271    2569 scope.go:117] "RemoveContainer" containerID="b51114d02a3015d9468e2b3257ab874eed281cd4a65f1229eb684a65a2a74fb9"
Sep 11 14:45:22.681068 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.681052    2569 scope.go:117] "RemoveContainer" containerID="b51114d02a3015d9468e2b3257ab874eed281cd4a65f1229eb684a65a2a74fb9"
Sep 11 14:45:22.681339 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:45:22.681321    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b51114d02a3015d9468e2b3257ab874eed281cd4a65f1229eb684a65a2a74fb9\": container with ID starting with b51114d02a3015d9468e2b3257ab874eed281cd4a65f1229eb684a65a2a74fb9 not found: ID does not exist" containerID="b51114d02a3015d9468e2b3257ab874eed281cd4a65f1229eb684a65a2a74fb9"
Sep 11 14:45:22.681454 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.681348    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b51114d02a3015d9468e2b3257ab874eed281cd4a65f1229eb684a65a2a74fb9"} err="failed to get container status \"b51114d02a3015d9468e2b3257ab874eed281cd4a65f1229eb684a65a2a74fb9\": rpc error: code = NotFound desc = could not find container \"b51114d02a3015d9468e2b3257ab874eed281cd4a65f1229eb684a65a2a74fb9\": container with ID starting with b51114d02a3015d9468e2b3257ab874eed281cd4a65f1229eb684a65a2a74fb9 not found: ID does not exist"
Sep 11 14:45:22.697820 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.697799    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"]
Sep 11 14:45:22.703920 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:22.703900    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-28858c-5b8d4dfdb5-r74s5"]
Sep 11 14:45:24.270308 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:24.270276    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e7b81bf-7ebd-4020-8bfe-a69c55b6c430" path="/var/lib/kubelet/pods/8e7b81bf-7ebd-4020-8bfe-a69c55b6c430/volumes"
Sep 11 14:45:24.270656 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:24.270618    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c49967f3-c5c9-415b-9b33-5712502b59bd" path="/var/lib/kubelet/pods/c49967f3-c5c9-415b-9b33-5712502b59bd/volumes"
Sep 11 14:45:27.717422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:27.717380    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:45:29.779668 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:29.779632    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"]
Sep 11 14:45:29.780094 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:29.779835    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc" podUID="39f88921-4254-4359-bb33-f3d76a3e7027" containerName="istio-proxy" containerID="cri-o://14c52a33e9509b1a578445aa6a4090318ae820c87eb292ffdbcb352c718e7eb3" gracePeriod=30
Sep 11 14:45:30.152146 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.152061    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz"]
Sep 11 14:45:30.152433 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.152420    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c49967f3-c5c9-415b-9b33-5712502b59bd" containerName="payload-processing"
Sep 11 14:45:30.152480 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.152434    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c49967f3-c5c9-415b-9b33-5712502b59bd" containerName="payload-processing"
Sep 11 14:45:30.152480 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.152445    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e7b81bf-7ebd-4020-8bfe-a69c55b6c430" containerName="revoke-keys"
Sep 11 14:45:30.152480 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.152451    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e7b81bf-7ebd-4020-8bfe-a69c55b6c430" containerName="revoke-keys"
Sep 11 14:45:30.152573 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.152512    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e7b81bf-7ebd-4020-8bfe-a69c55b6c430" containerName="revoke-keys"
Sep 11 14:45:30.152573 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.152522    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c49967f3-c5c9-415b-9b33-5712502b59bd" containerName="payload-processing"
Sep 11 14:45:30.156993 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.156972    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz"
Sep 11 14:45:30.159825 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.159801    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:45:30.159971 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.159922    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:45:30.166411 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.166384    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz"]
Sep 11 14:45:30.272270 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.272237    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e137a3ff-1886-407f-91b2-68b7ec7b3807-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz\" (UID: \"e137a3ff-1886-407f-91b2-68b7ec7b3807\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz"
Sep 11 14:45:30.373061 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.373027    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e137a3ff-1886-407f-91b2-68b7ec7b3807-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz\" (UID: \"e137a3ff-1886-407f-91b2-68b7ec7b3807\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz"
Sep 11 14:45:30.373624 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.373605    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e137a3ff-1886-407f-91b2-68b7ec7b3807-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz\" (UID: \"e137a3ff-1886-407f-91b2-68b7ec7b3807\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz"
Sep 11 14:45:30.468339 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.468310    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz"
Sep 11 14:45:30.747266 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:30.747241    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz"]
Sep 11 14:45:30.749230 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:45:30.749202    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode137a3ff_1886_407f_91b2_68b7ec7b3807.slice/crio-09ebc5a9ca401f0bbfbb540b5b0ec33d1517f8d497735e46edecb438219fee8f WatchSource:0}: Error finding container 09ebc5a9ca401f0bbfbb540b5b0ec33d1517f8d497735e46edecb438219fee8f: Status 404 returned error can't find the container with id 09ebc5a9ca401f0bbfbb540b5b0ec33d1517f8d497735e46edecb438219fee8f
Sep 11 14:45:31.719043 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:31.719006    2569 generic.go:356] "Generic (PLEG): container finished" podID="e137a3ff-1886-407f-91b2-68b7ec7b3807" containerID="6fd1786e423183b032bf07e2ff1934c22e84255b2f35960c68761d3fb47fd375" exitCode=0
Sep 11 14:45:31.719398 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:31.719059    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz" event={"ID":"e137a3ff-1886-407f-91b2-68b7ec7b3807","Type":"ContainerDied","Data":"6fd1786e423183b032bf07e2ff1934c22e84255b2f35960c68761d3fb47fd375"}
Sep 11 14:45:31.719398 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:31.719113    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz" event={"ID":"e137a3ff-1886-407f-91b2-68b7ec7b3807","Type":"ContainerStarted","Data":"09ebc5a9ca401f0bbfbb540b5b0ec33d1517f8d497735e46edecb438219fee8f"}
Sep 11 14:45:32.856913 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:32.856890    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz"
Sep 11 14:45:32.895047 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:32.895019    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e137a3ff-1886-407f-91b2-68b7ec7b3807-maas-api-service-ca\") pod \"e137a3ff-1886-407f-91b2-68b7ec7b3807\" (UID: \"e137a3ff-1886-407f-91b2-68b7ec7b3807\") "
Sep 11 14:45:32.895330 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:32.895308    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e137a3ff-1886-407f-91b2-68b7ec7b3807-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e137a3ff-1886-407f-91b2-68b7ec7b3807" (UID: "e137a3ff-1886-407f-91b2-68b7ec7b3807"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:45:32.995915 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:32.995835    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e137a3ff-1886-407f-91b2-68b7ec7b3807-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:33.730802 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:33.730766    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz" event={"ID":"e137a3ff-1886-407f-91b2-68b7ec7b3807","Type":"ContainerDied","Data":"09ebc5a9ca401f0bbfbb540b5b0ec33d1517f8d497735e46edecb438219fee8f"}
Sep 11 14:45:33.731010 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:33.730813    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09ebc5a9ca401f0bbfbb540b5b0ec33d1517f8d497735e46edecb438219fee8f"
Sep 11 14:45:33.731010 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:33.730809    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz"
Sep 11 14:45:35.028353 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.028330    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:45:35.112650 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.112578    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39f88921-4254-4359-bb33-f3d76a3e7027-istio-token\") pod \"39f88921-4254-4359-bb33-f3d76a3e7027\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") "
Sep 11 14:45:35.112774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.112710    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39f88921-4254-4359-bb33-f3d76a3e7027-istiod-ca-cert\") pod \"39f88921-4254-4359-bb33-f3d76a3e7027\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") "
Sep 11 14:45:35.112774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.112740    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-credential-socket\") pod \"39f88921-4254-4359-bb33-f3d76a3e7027\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") "
Sep 11 14:45:35.112897 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.112799    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-istio-data\") pod \"39f88921-4254-4359-bb33-f3d76a3e7027\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") "
Sep 11 14:45:35.112897 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.112834    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39f88921-4254-4359-bb33-f3d76a3e7027-istio-podinfo\") pod \"39f88921-4254-4359-bb33-f3d76a3e7027\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") "
Sep 11 14:45:35.112897 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.112860    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v7rd\" (UniqueName: \"kubernetes.io/projected/39f88921-4254-4359-bb33-f3d76a3e7027-kube-api-access-8v7rd\") pod \"39f88921-4254-4359-bb33-f3d76a3e7027\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") "
Sep 11 14:45:35.113056 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.112945    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-workload-socket\") pod \"39f88921-4254-4359-bb33-f3d76a3e7027\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") "
Sep 11 14:45:35.113056 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.112985    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-workload-certs\") pod \"39f88921-4254-4359-bb33-f3d76a3e7027\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") "
Sep 11 14:45:35.113056 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.113034    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-istio-envoy\") pod \"39f88921-4254-4359-bb33-f3d76a3e7027\" (UID: \"39f88921-4254-4359-bb33-f3d76a3e7027\") "
Sep 11 14:45:35.113206 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.113124    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "39f88921-4254-4359-bb33-f3d76a3e7027" (UID: "39f88921-4254-4359-bb33-f3d76a3e7027"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:45:35.113206 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.113156    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f88921-4254-4359-bb33-f3d76a3e7027-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "39f88921-4254-4359-bb33-f3d76a3e7027" (UID: "39f88921-4254-4359-bb33-f3d76a3e7027"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:45:35.113311 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.113256    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "39f88921-4254-4359-bb33-f3d76a3e7027" (UID: "39f88921-4254-4359-bb33-f3d76a3e7027"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:45:35.113393 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.113373    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "39f88921-4254-4359-bb33-f3d76a3e7027" (UID: "39f88921-4254-4359-bb33-f3d76a3e7027"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:45:35.113457 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.113408    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-istio-data" (OuterVolumeSpecName: "istio-data") pod "39f88921-4254-4359-bb33-f3d76a3e7027" (UID: "39f88921-4254-4359-bb33-f3d76a3e7027"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:45:35.113528 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.113511    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/39f88921-4254-4359-bb33-f3d76a3e7027-istiod-ca-cert\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:35.113587 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.113534    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-credential-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:35.113587 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.113549    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-istio-data\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:35.113587 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.113563    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-workload-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:35.113587 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.113575    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-workload-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:35.115224 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.115203    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "39f88921-4254-4359-bb33-f3d76a3e7027" (UID: "39f88921-4254-4359-bb33-f3d76a3e7027"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:45:35.115328 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.115228    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/39f88921-4254-4359-bb33-f3d76a3e7027-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "39f88921-4254-4359-bb33-f3d76a3e7027" (UID: "39f88921-4254-4359-bb33-f3d76a3e7027"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 14:45:35.115482 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.115466    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39f88921-4254-4359-bb33-f3d76a3e7027-istio-token" (OuterVolumeSpecName: "istio-token") pod "39f88921-4254-4359-bb33-f3d76a3e7027" (UID: "39f88921-4254-4359-bb33-f3d76a3e7027"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:45:35.115574 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.115548    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39f88921-4254-4359-bb33-f3d76a3e7027-kube-api-access-8v7rd" (OuterVolumeSpecName: "kube-api-access-8v7rd") pod "39f88921-4254-4359-bb33-f3d76a3e7027" (UID: "39f88921-4254-4359-bb33-f3d76a3e7027"). InnerVolumeSpecName "kube-api-access-8v7rd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:45:35.214219 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.214193    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/39f88921-4254-4359-bb33-f3d76a3e7027-istio-podinfo\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:35.214219 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.214217    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v7rd\" (UniqueName: \"kubernetes.io/projected/39f88921-4254-4359-bb33-f3d76a3e7027-kube-api-access-8v7rd\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:35.214387 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.214228    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/39f88921-4254-4359-bb33-f3d76a3e7027-istio-envoy\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:35.214387 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.214236    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/39f88921-4254-4359-bb33-f3d76a3e7027-istio-token\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:35.742687 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.742652    2569 generic.go:356] "Generic (PLEG): container finished" podID="39f88921-4254-4359-bb33-f3d76a3e7027" containerID="14c52a33e9509b1a578445aa6a4090318ae820c87eb292ffdbcb352c718e7eb3" exitCode=0
Sep 11 14:45:35.742856 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.742701    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"
Sep 11 14:45:35.742856 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.742719    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc" event={"ID":"39f88921-4254-4359-bb33-f3d76a3e7027","Type":"ContainerDied","Data":"14c52a33e9509b1a578445aa6a4090318ae820c87eb292ffdbcb352c718e7eb3"}
Sep 11 14:45:35.742856 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.742761    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc" event={"ID":"39f88921-4254-4359-bb33-f3d76a3e7027","Type":"ContainerDied","Data":"d17462822bba3455a79ed60601a17b2dfd79278f36232a67a42d6fd2817599bc"}
Sep 11 14:45:35.742856 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.742782    2569 scope.go:117] "RemoveContainer" containerID="14c52a33e9509b1a578445aa6a4090318ae820c87eb292ffdbcb352c718e7eb3"
Sep 11 14:45:35.752514 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.752499    2569 scope.go:117] "RemoveContainer" containerID="f66c1c7bf57526a32f69e144a5f98bf15086bbebe8051f45f2236915dbf1f561"
Sep 11 14:45:35.760739 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.760723    2569 scope.go:117] "RemoveContainer" containerID="14c52a33e9509b1a578445aa6a4090318ae820c87eb292ffdbcb352c718e7eb3"
Sep 11 14:45:35.761024 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:45:35.761004    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14c52a33e9509b1a578445aa6a4090318ae820c87eb292ffdbcb352c718e7eb3\": container with ID starting with 14c52a33e9509b1a578445aa6a4090318ae820c87eb292ffdbcb352c718e7eb3 not found: ID does not exist" containerID="14c52a33e9509b1a578445aa6a4090318ae820c87eb292ffdbcb352c718e7eb3"
Sep 11 14:45:35.761104 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.761034    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14c52a33e9509b1a578445aa6a4090318ae820c87eb292ffdbcb352c718e7eb3"} err="failed to get container status \"14c52a33e9509b1a578445aa6a4090318ae820c87eb292ffdbcb352c718e7eb3\": rpc error: code = NotFound desc = could not find container \"14c52a33e9509b1a578445aa6a4090318ae820c87eb292ffdbcb352c718e7eb3\": container with ID starting with 14c52a33e9509b1a578445aa6a4090318ae820c87eb292ffdbcb352c718e7eb3 not found: ID does not exist"
Sep 11 14:45:35.761104 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.761053    2569 scope.go:117] "RemoveContainer" containerID="f66c1c7bf57526a32f69e144a5f98bf15086bbebe8051f45f2236915dbf1f561"
Sep 11 14:45:35.761308 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:45:35.761290    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f66c1c7bf57526a32f69e144a5f98bf15086bbebe8051f45f2236915dbf1f561\": container with ID starting with f66c1c7bf57526a32f69e144a5f98bf15086bbebe8051f45f2236915dbf1f561 not found: ID does not exist" containerID="f66c1c7bf57526a32f69e144a5f98bf15086bbebe8051f45f2236915dbf1f561"
Sep 11 14:45:35.761354 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.761315    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f66c1c7bf57526a32f69e144a5f98bf15086bbebe8051f45f2236915dbf1f561"} err="failed to get container status \"f66c1c7bf57526a32f69e144a5f98bf15086bbebe8051f45f2236915dbf1f561\": rpc error: code = NotFound desc = could not find container \"f66c1c7bf57526a32f69e144a5f98bf15086bbebe8051f45f2236915dbf1f561\": container with ID starting with f66c1c7bf57526a32f69e144a5f98bf15086bbebe8051f45f2236915dbf1f561 not found: ID does not exist"
Sep 11 14:45:35.783308 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.783288    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"]
Sep 11 14:45:35.792703 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:35.792676    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-28858c-openshift-default-66c599dbf8-4nmjc"]
Sep 11 14:45:36.270405 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:36.270370    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39f88921-4254-4359-bb33-f3d76a3e7027" path="/var/lib/kubelet/pods/39f88921-4254-4359-bb33-f3d76a3e7027/volumes"
Sep 11 14:45:40.641750 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:40.641719    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:45:40.921779 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:40.921695    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl"]
Sep 11 14:45:40.927231 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:40.927206    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-7eeb45-29818965-268dl"]
Sep 11 14:45:40.964359 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:40.964326    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"]
Sep 11 14:45:40.964649 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:40.964613    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m" podUID="f408c1d6-6934-495e-bedd-24410e3eb466" containerName="payload-processing" containerID="cri-o://276a16dc8f8d5b8d448a1c842294c91d9693b82b04fb5e790ce758964d561b69" gracePeriod=30
Sep 11 14:45:41.236580 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.236556    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"
Sep 11 14:45:41.364261 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.364228    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f408c1d6-6934-495e-bedd-24410e3eb466-plugins-config-volume\") pod \"f408c1d6-6934-495e-bedd-24410e3eb466\" (UID: \"f408c1d6-6934-495e-bedd-24410e3eb466\") "
Sep 11 14:45:41.364476 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.364314    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2wvb\" (UniqueName: \"kubernetes.io/projected/f408c1d6-6934-495e-bedd-24410e3eb466-kube-api-access-n2wvb\") pod \"f408c1d6-6934-495e-bedd-24410e3eb466\" (UID: \"f408c1d6-6934-495e-bedd-24410e3eb466\") "
Sep 11 14:45:41.364577 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.364553    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f408c1d6-6934-495e-bedd-24410e3eb466-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f408c1d6-6934-495e-bedd-24410e3eb466" (UID: "f408c1d6-6934-495e-bedd-24410e3eb466"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:45:41.364689 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.364677    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f408c1d6-6934-495e-bedd-24410e3eb466-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:41.366472 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.366447    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f408c1d6-6934-495e-bedd-24410e3eb466-kube-api-access-n2wvb" (OuterVolumeSpecName: "kube-api-access-n2wvb") pod "f408c1d6-6934-495e-bedd-24410e3eb466" (UID: "f408c1d6-6934-495e-bedd-24410e3eb466"). InnerVolumeSpecName "kube-api-access-n2wvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:45:41.374478 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.374450    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz"]
Sep 11 14:45:41.381717 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.381698    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-7eeb45-gkmkz"]
Sep 11 14:45:41.465319 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.465291    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2wvb\" (UniqueName: \"kubernetes.io/projected/f408c1d6-6934-495e-bedd-24410e3eb466-kube-api-access-n2wvb\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:45:41.774330 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.774292    2569 generic.go:356] "Generic (PLEG): container finished" podID="f408c1d6-6934-495e-bedd-24410e3eb466" containerID="276a16dc8f8d5b8d448a1c842294c91d9693b82b04fb5e790ce758964d561b69" exitCode=0
Sep 11 14:45:41.774734 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.774336    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"
Sep 11 14:45:41.774734 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.774380    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m" event={"ID":"f408c1d6-6934-495e-bedd-24410e3eb466","Type":"ContainerDied","Data":"276a16dc8f8d5b8d448a1c842294c91d9693b82b04fb5e790ce758964d561b69"}
Sep 11 14:45:41.774734 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.774434    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m" event={"ID":"f408c1d6-6934-495e-bedd-24410e3eb466","Type":"ContainerDied","Data":"f49c839195c06f975d54f0c20e0ddf9d8975d986a2d1888a3bf39448005ac075"}
Sep 11 14:45:41.774734 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.774460    2569 scope.go:117] "RemoveContainer" containerID="276a16dc8f8d5b8d448a1c842294c91d9693b82b04fb5e790ce758964d561b69"
Sep 11 14:45:41.783181 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.783163    2569 scope.go:117] "RemoveContainer" containerID="276a16dc8f8d5b8d448a1c842294c91d9693b82b04fb5e790ce758964d561b69"
Sep 11 14:45:41.789577 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:45:41.783944    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276a16dc8f8d5b8d448a1c842294c91d9693b82b04fb5e790ce758964d561b69\": container with ID starting with 276a16dc8f8d5b8d448a1c842294c91d9693b82b04fb5e790ce758964d561b69 not found: ID does not exist" containerID="276a16dc8f8d5b8d448a1c842294c91d9693b82b04fb5e790ce758964d561b69"
Sep 11 14:45:41.789577 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.783994    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276a16dc8f8d5b8d448a1c842294c91d9693b82b04fb5e790ce758964d561b69"} err="failed to get container status \"276a16dc8f8d5b8d448a1c842294c91d9693b82b04fb5e790ce758964d561b69\": rpc error: code = NotFound desc = could not find container \"276a16dc8f8d5b8d448a1c842294c91d9693b82b04fb5e790ce758964d561b69\": container with ID starting with 276a16dc8f8d5b8d448a1c842294c91d9693b82b04fb5e790ce758964d561b69 not found: ID does not exist"
Sep 11 14:45:41.798677 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.798651    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"]
Sep 11 14:45:41.811410 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:41.811387    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-7eeb45-7886df6c8c-5cp6m"]
Sep 11 14:45:42.271331 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:42.271294    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d032c7ad-8fd1-4e20-934b-de622536c1e4" path="/var/lib/kubelet/pods/d032c7ad-8fd1-4e20-934b-de622536c1e4/volumes"
Sep 11 14:45:42.271608 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:42.271595    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e137a3ff-1886-407f-91b2-68b7ec7b3807" path="/var/lib/kubelet/pods/e137a3ff-1886-407f-91b2-68b7ec7b3807/volumes"
Sep 11 14:45:42.271934 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:42.271921    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f408c1d6-6934-495e-bedd-24410e3eb466" path="/var/lib/kubelet/pods/f408c1d6-6934-495e-bedd-24410e3eb466/volumes"
Sep 11 14:45:52.317989 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:52.317955    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:45:59.276648 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:45:59.276611    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"]
Sep 11 14:46:00.139653 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.139619    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"]
Sep 11 14:46:00.140042 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.140029    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39f88921-4254-4359-bb33-f3d76a3e7027" containerName="istio-proxy"
Sep 11 14:46:00.140102 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.140044    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f88921-4254-4359-bb33-f3d76a3e7027" containerName="istio-proxy"
Sep 11 14:46:00.140102 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.140056    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f408c1d6-6934-495e-bedd-24410e3eb466" containerName="payload-processing"
Sep 11 14:46:00.140102 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.140062    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f408c1d6-6934-495e-bedd-24410e3eb466" containerName="payload-processing"
Sep 11 14:46:00.140102 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.140068    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e137a3ff-1886-407f-91b2-68b7ec7b3807" containerName="revoke-keys"
Sep 11 14:46:00.140102 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.140074    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e137a3ff-1886-407f-91b2-68b7ec7b3807" containerName="revoke-keys"
Sep 11 14:46:00.140286 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.140131    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="39f88921-4254-4359-bb33-f3d76a3e7027" containerName="istio-proxy"
Sep 11 14:46:00.140286 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.140139    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="39f88921-4254-4359-bb33-f3d76a3e7027" containerName="istio-proxy"
Sep 11 14:46:00.140286 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.140145    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e137a3ff-1886-407f-91b2-68b7ec7b3807" containerName="revoke-keys"
Sep 11 14:46:00.140286 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.140151    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f408c1d6-6934-495e-bedd-24410e3eb466" containerName="payload-processing"
Sep 11 14:46:00.144516 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.144495    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.147599 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.147577    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-9fedd5-openshift-default-dockercfg-bpddp\""
Sep 11 14:46:00.164458 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.164432    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"]
Sep 11 14:46:00.210835 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.210795    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8rr6\" (UniqueName: \"kubernetes.io/projected/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-kube-api-access-s8rr6\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.211045 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.210849    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-workload-certs\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.211045 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.210917    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-data\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.211045 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.210953    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-token\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.211185 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.211086    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-podinfo\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.211185 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.211117    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istiod-ca-cert\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.211185 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.211135    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-credential-socket\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.211283 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.211197    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-envoy\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.211283 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.211233    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-workload-socket\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.312717 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.312683    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-podinfo\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.312717 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.312724    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istiod-ca-cert\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.313298 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.312745    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-credential-socket\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.313298 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.312779    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-envoy\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.313298 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.312812    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-workload-socket\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.313298 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.312849    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8rr6\" (UniqueName: \"kubernetes.io/projected/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-kube-api-access-s8rr6\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.313298 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.312901    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-workload-certs\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.313298 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.312938    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-data\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.313298 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.312975    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-token\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.313298 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.313185    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-credential-socket\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.313298 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.313262    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-workload-socket\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.313794 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.313313    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-workload-certs\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.313794 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.313407    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-data\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.313794 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.313516    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istiod-ca-cert\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.315209 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.315193    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-envoy\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.315665 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.315650    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-podinfo\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.324236 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.324210    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8rr6\" (UniqueName: \"kubernetes.io/projected/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-kube-api-access-s8rr6\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.326743 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.326710    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-token\") pod \"e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") " pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.454966 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.454938    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:00.755564 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.755403    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"]
Sep 11 14:46:00.758283 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:46:00.758254    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fb05110_3b09_4c6c_a9bc_7c7bfb84d459.slice/crio-6b3fb2c0191adbc3e711aad6ab1dc5756e38b5ca1990a549f72a2575cbc35f0e WatchSource:0}: Error finding container 6b3fb2c0191adbc3e711aad6ab1dc5756e38b5ca1990a549f72a2575cbc35f0e: Status 404 returned error can't find the container with id 6b3fb2c0191adbc3e711aad6ab1dc5756e38b5ca1990a549f72a2575cbc35f0e
Sep 11 14:46:00.760371 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.760338    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:46:00.760447 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.760403    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:46:00.760447 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.760431    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:46:00.882347 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.882316    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" event={"ID":"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459","Type":"ContainerStarted","Data":"571fd0ffb0200a1c5cfc92d8b8d83fb7514ce7b83b595406ad95bca23dd94e38"}
Sep 11 14:46:00.882515 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.882366    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" event={"ID":"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459","Type":"ContainerStarted","Data":"6b3fb2c0191adbc3e711aad6ab1dc5756e38b5ca1990a549f72a2575cbc35f0e"}
Sep 11 14:46:00.909406 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:00.909357    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" podStartSLOduration=0.909341481 podStartE2EDuration="909.341481ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:46:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:46:00.906543317 +0000 UTC m=+1857.121128977" watchObservedRunningTime="2026-09-11 14:46:00.909341481 +0000 UTC m=+1857.123927142"
Sep 11 14:46:01.455823 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:01.455787    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:01.456829 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:01.456807    2569 patch_prober.go:28] interesting pod/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 14:46:01.456909 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:01.456857    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 14:46:02.459783 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:02.459756    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:02.893002 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:02.892916    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:02.893854 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:02.893832    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:06.918574 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:06.918537    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:46:08.017412 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.017369    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"]
Sep 11 14:46:08.017814 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.017801    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39f88921-4254-4359-bb33-f3d76a3e7027" containerName="istio-proxy"
Sep 11 14:46:08.017864 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.017817    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f88921-4254-4359-bb33-f3d76a3e7027" containerName="istio-proxy"
Sep 11 14:46:08.020964 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.020948    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"
Sep 11 14:46:08.029703 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.029683    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-9fedd5\""
Sep 11 14:46:08.030700 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.030683    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-9fedd5-dockercfg-xvl5m\""
Sep 11 14:46:08.038193 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.038171    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"]
Sep 11 14:46:08.184123 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.184092    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqndz\" (UniqueName: \"kubernetes.io/projected/e8ed079c-ea25-45f5-a908-7b78c51f582c-kube-api-access-zqndz\") pod \"payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm\" (UID: \"e8ed079c-ea25-45f5-a908-7b78c51f582c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"
Sep 11 14:46:08.184252 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.184128    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8ed079c-ea25-45f5-a908-7b78c51f582c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm\" (UID: \"e8ed079c-ea25-45f5-a908-7b78c51f582c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"
Sep 11 14:46:08.291178 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.286037    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqndz\" (UniqueName: \"kubernetes.io/projected/e8ed079c-ea25-45f5-a908-7b78c51f582c-kube-api-access-zqndz\") pod \"payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm\" (UID: \"e8ed079c-ea25-45f5-a908-7b78c51f582c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"
Sep 11 14:46:08.291178 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.286096    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8ed079c-ea25-45f5-a908-7b78c51f582c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm\" (UID: \"e8ed079c-ea25-45f5-a908-7b78c51f582c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"
Sep 11 14:46:08.291178 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.287054    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8ed079c-ea25-45f5-a908-7b78c51f582c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm\" (UID: \"e8ed079c-ea25-45f5-a908-7b78c51f582c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"
Sep 11 14:46:08.296916 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.296866    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqndz\" (UniqueName: \"kubernetes.io/projected/e8ed079c-ea25-45f5-a908-7b78c51f582c-kube-api-access-zqndz\") pod \"payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm\" (UID: \"e8ed079c-ea25-45f5-a908-7b78c51f582c\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"
Sep 11 14:46:08.332961 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.332939    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"
Sep 11 14:46:08.607276 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.607243    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"]
Sep 11 14:46:08.608379 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:46:08.608357    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8ed079c_ea25_45f5_a908_7b78c51f582c.slice/crio-02f2517b0e151697dc922b51c537f183cc5aeee44633ed23e29ed28ee73fbd40 WatchSource:0}: Error finding container 02f2517b0e151697dc922b51c537f183cc5aeee44633ed23e29ed28ee73fbd40: Status 404 returned error can't find the container with id 02f2517b0e151697dc922b51c537f183cc5aeee44633ed23e29ed28ee73fbd40
Sep 11 14:46:08.925046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.925000    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm" event={"ID":"e8ed079c-ea25-45f5-a908-7b78c51f582c","Type":"ContainerStarted","Data":"3a0c409bb0c54a86603ebfdead52547ca5df037a3337f06a395ef5df0b36c50b"}
Sep 11 14:46:08.925210 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.925064    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm" event={"ID":"e8ed079c-ea25-45f5-a908-7b78c51f582c","Type":"ContainerStarted","Data":"02f2517b0e151697dc922b51c537f183cc5aeee44633ed23e29ed28ee73fbd40"}
Sep 11 14:46:08.925210 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.925091    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"
Sep 11 14:46:08.947170 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:08.947118    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm" podStartSLOduration=1.947097611 podStartE2EDuration="1.947097611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:46:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:46:08.946391865 +0000 UTC m=+1865.160977526" watchObservedRunningTime="2026-09-11 14:46:08.947097611 +0000 UTC m=+1865.161683272"
Sep 11 14:46:14.295237 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.295180    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp" podUID="57749406-1e4b-4af5-b6de-f1aa0a9573ba" containerName="main" containerID="cri-o://f8795b9efa37a983287ca7bcc6d2a2bd0afb449a18b8ec8115b0b4324b2e4588" gracePeriod=45
Sep 11 14:46:14.577446 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.577422    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:46:14.657598 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.657571    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-home\") pod \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") "
Sep 11 14:46:14.657804 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.657781    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-dshm\") pod \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") "
Sep 11 14:46:14.657901 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.657845    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57749406-1e4b-4af5-b6de-f1aa0a9573ba-tls-certs\") pod \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") "
Sep 11 14:46:14.657901 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.657847    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-home" (OuterVolumeSpecName: "home") pod "57749406-1e4b-4af5-b6de-f1aa0a9573ba" (UID: "57749406-1e4b-4af5-b6de-f1aa0a9573ba"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:46:14.658024 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.657910    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mlxsr\" (UniqueName: \"kubernetes.io/projected/57749406-1e4b-4af5-b6de-f1aa0a9573ba-kube-api-access-mlxsr\") pod \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") "
Sep 11 14:46:14.658024 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.657975    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-model-cache\") pod \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") "
Sep 11 14:46:14.658136 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.658022    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-tmp-dir\") pod \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\" (UID: \"57749406-1e4b-4af5-b6de-f1aa0a9573ba\") "
Sep 11 14:46:14.658380 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.658255    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-model-cache" (OuterVolumeSpecName: "model-cache") pod "57749406-1e4b-4af5-b6de-f1aa0a9573ba" (UID: "57749406-1e4b-4af5-b6de-f1aa0a9573ba"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:46:14.658675 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.658382    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-model-cache\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:46:14.658675 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.658404    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-home\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:46:14.658675 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.658479    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "57749406-1e4b-4af5-b6de-f1aa0a9573ba" (UID: "57749406-1e4b-4af5-b6de-f1aa0a9573ba"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:46:14.660233 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.660210    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-dshm" (OuterVolumeSpecName: "dshm") pod "57749406-1e4b-4af5-b6de-f1aa0a9573ba" (UID: "57749406-1e4b-4af5-b6de-f1aa0a9573ba"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:46:14.660322 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.660228    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57749406-1e4b-4af5-b6de-f1aa0a9573ba-kube-api-access-mlxsr" (OuterVolumeSpecName: "kube-api-access-mlxsr") pod "57749406-1e4b-4af5-b6de-f1aa0a9573ba" (UID: "57749406-1e4b-4af5-b6de-f1aa0a9573ba"). InnerVolumeSpecName "kube-api-access-mlxsr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:46:14.660363 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.660312    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57749406-1e4b-4af5-b6de-f1aa0a9573ba-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "57749406-1e4b-4af5-b6de-f1aa0a9573ba" (UID: "57749406-1e4b-4af5-b6de-f1aa0a9573ba"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:46:14.759029 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.758994    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-tmp-dir\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:46:14.759029 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.759023    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/57749406-1e4b-4af5-b6de-f1aa0a9573ba-dshm\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:46:14.759029 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.759031    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/57749406-1e4b-4af5-b6de-f1aa0a9573ba-tls-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:46:14.759318 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.759041    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mlxsr\" (UniqueName: \"kubernetes.io/projected/57749406-1e4b-4af5-b6de-f1aa0a9573ba-kube-api-access-mlxsr\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:46:14.961284 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.961250    2569 generic.go:356] "Generic (PLEG): container finished" podID="57749406-1e4b-4af5-b6de-f1aa0a9573ba" containerID="f8795b9efa37a983287ca7bcc6d2a2bd0afb449a18b8ec8115b0b4324b2e4588" exitCode=0
Sep 11 14:46:14.961458 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.961297    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"
Sep 11 14:46:14.961458 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.961311    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp" event={"ID":"57749406-1e4b-4af5-b6de-f1aa0a9573ba","Type":"ContainerDied","Data":"f8795b9efa37a983287ca7bcc6d2a2bd0afb449a18b8ec8115b0b4324b2e4588"}
Sep 11 14:46:14.961458 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.961350    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp" event={"ID":"57749406-1e4b-4af5-b6de-f1aa0a9573ba","Type":"ContainerDied","Data":"edeccd392280688b4f830fbc9f6e3ecff13aeb2d224cb8a24e0356158ba0ed2a"}
Sep 11 14:46:14.961458 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.961367    2569 scope.go:117] "RemoveContainer" containerID="f8795b9efa37a983287ca7bcc6d2a2bd0afb449a18b8ec8115b0b4324b2e4588"
Sep 11 14:46:14.973263 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.973239    2569 scope.go:117] "RemoveContainer" containerID="f8795b9efa37a983287ca7bcc6d2a2bd0afb449a18b8ec8115b0b4324b2e4588"
Sep 11 14:46:14.973598 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:46:14.973572    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8795b9efa37a983287ca7bcc6d2a2bd0afb449a18b8ec8115b0b4324b2e4588\": container with ID starting with f8795b9efa37a983287ca7bcc6d2a2bd0afb449a18b8ec8115b0b4324b2e4588 not found: ID does not exist" containerID="f8795b9efa37a983287ca7bcc6d2a2bd0afb449a18b8ec8115b0b4324b2e4588"
Sep 11 14:46:14.973654 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.973615    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8795b9efa37a983287ca7bcc6d2a2bd0afb449a18b8ec8115b0b4324b2e4588"} err="failed to get container status \"f8795b9efa37a983287ca7bcc6d2a2bd0afb449a18b8ec8115b0b4324b2e4588\": rpc error: code = NotFound desc = could not find container \"f8795b9efa37a983287ca7bcc6d2a2bd0afb449a18b8ec8115b0b4324b2e4588\": container with ID starting with f8795b9efa37a983287ca7bcc6d2a2bd0afb449a18b8ec8115b0b4324b2e4588 not found: ID does not exist"
Sep 11 14:46:14.990635 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.990613    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"]
Sep 11 14:46:14.998298 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:14.998278    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-977c12/rate-test-model-977c12-kserve-6699bf687f-szvrp"]
Sep 11 14:46:16.271367 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:16.271333    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57749406-1e4b-4af5-b6de-f1aa0a9573ba" path="/var/lib/kubelet/pods/57749406-1e4b-4af5-b6de-f1aa0a9573ba/volumes"
Sep 11 14:46:17.530451 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:17.530407    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:46:18.934090 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:18.934043    2569 patch_prober.go:28] interesting pod/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 14:46:18.934589 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:18.934129    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 14:46:19.932023 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:19.931993    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"
Sep 11 14:46:20.997403 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:20.997375    2569 generic.go:356] "Generic (PLEG): container finished" podID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerID="571fd0ffb0200a1c5cfc92d8b8d83fb7514ce7b83b595406ad95bca23dd94e38" exitCode=0
Sep 11 14:46:20.997938 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:20.997453    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" event={"ID":"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459","Type":"ContainerDied","Data":"571fd0ffb0200a1c5cfc92d8b8d83fb7514ce7b83b595406ad95bca23dd94e38"}
Sep 11 14:46:20.998020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:20.997974    2569 scope.go:117] "RemoveContainer" containerID="571fd0ffb0200a1c5cfc92d8b8d83fb7514ce7b83b595406ad95bca23dd94e38"
Sep 11 14:46:20.999046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:20.999017    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:46:20.999119 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:20.999088    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:46:20.999159 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:20.999119    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:46:22.005324 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:22.005288    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" event={"ID":"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459","Type":"ContainerStarted","Data":"1400d2dae50fa4f81621364395ffaa823bc9883189758aa09cb69f17357d67b5"}
Sep 11 14:46:22.455774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:22.455735    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:22.456047 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:22.456023    2569 patch_prober.go:28] interesting pod/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 14:46:22.456105 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:22.456085    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 14:46:23.455863 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:23.455826    2569 patch_prober.go:28] interesting pod/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 14:46:23.456266 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:23.455919    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 14:46:24.455333 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:24.455288    2569 patch_prober.go:28] interesting pod/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 14:46:24.455523 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:24.455349    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 14:46:25.455577 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:25.455538    2569 patch_prober.go:28] interesting pod/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 14:46:25.455995 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:25.455596    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 14:46:26.455826 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:26.455785    2569 patch_prober.go:28] interesting pod/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 14:46:26.456244 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:26.455843    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 14:46:27.458781 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:27.458743    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:27.459292 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:27.459149    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:27.459704 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:27.459689    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:46:41.329489 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.329451    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"]
Sep 11 14:46:41.329910 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.329802    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57749406-1e4b-4af5-b6de-f1aa0a9573ba" containerName="main"
Sep 11 14:46:41.329910 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.329813    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="57749406-1e4b-4af5-b6de-f1aa0a9573ba" containerName="main"
Sep 11 14:46:41.329910 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.329909    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="57749406-1e4b-4af5-b6de-f1aa0a9573ba" containerName="main"
Sep 11 14:46:41.331830 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.331814    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"
Sep 11 14:46:41.335174 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.335153    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-92ca78-dockercfg-szdqn\""
Sep 11 14:46:41.335616 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.335600    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-92ca78\""
Sep 11 14:46:41.345958 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.345935    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"]
Sep 11 14:46:41.395887 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.395859    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bd667ca-5896-44dc-a5d0-d1e612da730d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s\" (UID: \"2bd667ca-5896-44dc-a5d0-d1e612da730d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"
Sep 11 14:46:41.396068 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.396047    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvnjh\" (UniqueName: \"kubernetes.io/projected/2bd667ca-5896-44dc-a5d0-d1e612da730d-kube-api-access-xvnjh\") pod \"payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s\" (UID: \"2bd667ca-5896-44dc-a5d0-d1e612da730d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"
Sep 11 14:46:41.497248 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.497210    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvnjh\" (UniqueName: \"kubernetes.io/projected/2bd667ca-5896-44dc-a5d0-d1e612da730d-kube-api-access-xvnjh\") pod \"payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s\" (UID: \"2bd667ca-5896-44dc-a5d0-d1e612da730d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"
Sep 11 14:46:41.497248 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.497250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bd667ca-5896-44dc-a5d0-d1e612da730d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s\" (UID: \"2bd667ca-5896-44dc-a5d0-d1e612da730d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"
Sep 11 14:46:41.497915 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.497898    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bd667ca-5896-44dc-a5d0-d1e612da730d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s\" (UID: \"2bd667ca-5896-44dc-a5d0-d1e612da730d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"
Sep 11 14:46:41.506566 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.506543    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvnjh\" (UniqueName: \"kubernetes.io/projected/2bd667ca-5896-44dc-a5d0-d1e612da730d-kube-api-access-xvnjh\") pod \"payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s\" (UID: \"2bd667ca-5896-44dc-a5d0-d1e612da730d\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"
Sep 11 14:46:41.642231 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.642168    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"
Sep 11 14:46:41.918541 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:41.918516    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"]
Sep 11 14:46:41.920593 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:46:41.920564    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd667ca_5896_44dc_a5d0_d1e612da730d.slice/crio-48fecc6e3140980accc19a50e07b9d053eb4d1fcec5322a7e6f33068f8d37712 WatchSource:0}: Error finding container 48fecc6e3140980accc19a50e07b9d053eb4d1fcec5322a7e6f33068f8d37712: Status 404 returned error can't find the container with id 48fecc6e3140980accc19a50e07b9d053eb4d1fcec5322a7e6f33068f8d37712
Sep 11 14:46:42.113192 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:42.113156    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s" event={"ID":"2bd667ca-5896-44dc-a5d0-d1e612da730d","Type":"ContainerStarted","Data":"95bc85bc1a4642cdf3ac3f9b96a5e6bc8127eec45277ecc1e397b53a6861cf23"}
Sep 11 14:46:42.113354 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:42.113207    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s" event={"ID":"2bd667ca-5896-44dc-a5d0-d1e612da730d","Type":"ContainerStarted","Data":"48fecc6e3140980accc19a50e07b9d053eb4d1fcec5322a7e6f33068f8d37712"}
Sep 11 14:46:42.113354 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:42.113238    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"
Sep 11 14:46:42.135379 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:42.135334    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s" podStartSLOduration=1.135317686 podStartE2EDuration="1.135317686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:46:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:46:42.133789056 +0000 UTC m=+1898.348374724" watchObservedRunningTime="2026-09-11 14:46:42.135317686 +0000 UTC m=+1898.349903347"
Sep 11 14:46:44.712165 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:44.712136    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:46:53.121061 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:46:53.121030    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"
Sep 11 14:47:20.795250 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.795214    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"]
Sep 11 14:47:20.798700 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.798685    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.801346 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.801320    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-9fedd5\"/\"kube-root-ca.crt\""
Sep 11 14:47:20.801484 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.801373    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-9fedd5\"/\"openshift-service-ca.crt\""
Sep 11 14:47:20.802105 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.802088    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-9fedd5\"/\"default-dockercfg-rtvl2\""
Sep 11 14:47:20.802235 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.802218    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-9fedd5\"/\"ipp-route-9fedd5-kserve-self-signed-certs\""
Sep 11 14:47:20.808273 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.808250    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"]
Sep 11 14:47:20.820229 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.820201    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-home\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.820345 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.820263    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lv6p\" (UniqueName: \"kubernetes.io/projected/a239c845-3b84-4ead-a87a-f8eef5c96d69-kube-api-access-8lv6p\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.820391 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.820354    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a239c845-3b84-4ead-a87a-f8eef5c96d69-tls-certs\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.820391 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.820384    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-model-cache\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.820467 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.820416    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-tmp-dir\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.820508 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.820478    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-dshm\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.920951 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.920906    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a239c845-3b84-4ead-a87a-f8eef5c96d69-tls-certs\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.921107 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.920974    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-model-cache\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.921107 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.920997    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-tmp-dir\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.921107 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.921026    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-dshm\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.921107 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.921057    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-home\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.921107 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.921094    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lv6p\" (UniqueName: \"kubernetes.io/projected/a239c845-3b84-4ead-a87a-f8eef5c96d69-kube-api-access-8lv6p\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.921487 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.921464    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-tmp-dir\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.921560 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.921508    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-model-cache\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.921560 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.921548    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-home\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.923290 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.923267    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-dshm\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.923528 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.923512    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a239c845-3b84-4ead-a87a-f8eef5c96d69-tls-certs\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:20.932554 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:20.932534    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lv6p\" (UniqueName: \"kubernetes.io/projected/a239c845-3b84-4ead-a87a-f8eef5c96d69-kube-api-access-8lv6p\") pod \"ipp-route-9fedd5-kserve-55fd94998c-5g8wd\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") " pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:21.109632 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:21.109554    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:21.387631 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:21.387603    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"]
Sep 11 14:47:21.389435 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:47:21.389409    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda239c845_3b84_4ead_a87a_f8eef5c96d69.slice/crio-7ff56d5d29f9c975ae827e0e796a5427747d155b9228e5b8259b3e349070bad9 WatchSource:0}: Error finding container 7ff56d5d29f9c975ae827e0e796a5427747d155b9228e5b8259b3e349070bad9: Status 404 returned error can't find the container with id 7ff56d5d29f9c975ae827e0e796a5427747d155b9228e5b8259b3e349070bad9
Sep 11 14:47:22.323384 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:22.323341    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd" event={"ID":"a239c845-3b84-4ead-a87a-f8eef5c96d69","Type":"ContainerStarted","Data":"ee1e08157565c13b08d22ed3341d50e9d514a487e42a8d764670d1765c68f25d"}
Sep 11 14:47:22.323766 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:22.323393    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd" event={"ID":"a239c845-3b84-4ead-a87a-f8eef5c96d69","Type":"ContainerStarted","Data":"7ff56d5d29f9c975ae827e0e796a5427747d155b9228e5b8259b3e349070bad9"}
Sep 11 14:47:22.345137 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:22.345091    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd" podStartSLOduration=2.345075392 podStartE2EDuration="2.345075392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:47:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:47:22.342642126 +0000 UTC m=+1938.557227806" watchObservedRunningTime="2026-09-11 14:47:22.345075392 +0000 UTC m=+1938.559661052"
Sep 11 14:47:24.526783 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:24.526752    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:47:31.110356 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:31.110322    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:31.110803 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:31.110372    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:31.122629 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:31.122605    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:31.382620 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:31.382538    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:47:52.418571 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:52.418532    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:47:58.753658 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:58.753576    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm_e8ed079c-ea25-45f5-a908-7b78c51f582c/payload-processing/0.log"
Sep 11 14:47:59.640683 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.640649    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"]
Sep 11 14:47:59.644406 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.644383    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.651344 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.651316    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-55ef8c-openshift-default-dockercfg-gxwvx\""
Sep 11 14:47:59.677722 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.677697    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"]
Sep 11 14:47:59.725815 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.725766    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.725962 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.725831    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-workload-certs\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.725962 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.725865    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-data\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.725962 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.725945    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-workload-socket\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.726160 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.725969    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-podinfo\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.726160 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.726077    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-envoy\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.726274 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.726163    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-credential-socket\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.726274 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.726198    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-token\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.726274 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.726267    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7gxp\" (UniqueName: \"kubernetes.io/projected/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-kube-api-access-b7gxp\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.827442 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.827399    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-envoy\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.827442 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.827448    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-credential-socket\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.828020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.827467    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-token\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.828020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.827503    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7gxp\" (UniqueName: \"kubernetes.io/projected/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-kube-api-access-b7gxp\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.828020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.827535    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.828020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.827557    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-workload-certs\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.828020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.827584    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-data\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.828020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.827936    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-credential-socket\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.828020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.827685    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-workload-socket\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.828020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.827990    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-workload-certs\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.828020 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.828010    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-podinfo\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.828507 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.828055    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-data\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.828507 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.828308    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.828507 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.828417    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-workload-socket\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.829944 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.829917    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-envoy\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.830457 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.830437    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-podinfo\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.840939 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.840905    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-token\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.841524 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.841504    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7gxp\" (UniqueName: \"kubernetes.io/projected/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-kube-api-access-b7gxp\") pod \"e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") " pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:47:59.955469 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:47:59.955448    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:48:00.238212 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:00.238187    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"]
Sep 11 14:48:00.239618 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:48:00.239594    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f0d9cf5_dfa6_4898_9e9e_733370425f8e.slice/crio-87e3cff7c1ed9f2d9dd761fc2e39efb5ba2e52847fd66d55343df214d3a8d208 WatchSource:0}: Error finding container 87e3cff7c1ed9f2d9dd761fc2e39efb5ba2e52847fd66d55343df214d3a8d208: Status 404 returned error can't find the container with id 87e3cff7c1ed9f2d9dd761fc2e39efb5ba2e52847fd66d55343df214d3a8d208
Sep 11 14:48:00.241673 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:00.241641    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:48:00.241734 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:00.241704    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:48:00.241775 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:00.241733    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:48:00.519262 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:00.519166    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6" event={"ID":"9f0d9cf5-dfa6-4898-9e9e-733370425f8e","Type":"ContainerStarted","Data":"e55cb1707fa97b1c6cd6c41477402825ecd5ed3adfff024b6d7da41da771e7b1"}
Sep 11 14:48:00.519262 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:00.519227    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6" event={"ID":"9f0d9cf5-dfa6-4898-9e9e-733370425f8e","Type":"ContainerStarted","Data":"87e3cff7c1ed9f2d9dd761fc2e39efb5ba2e52847fd66d55343df214d3a8d208"}
Sep 11 14:48:00.544066 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:00.543999    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6" podStartSLOduration=1.543983374 podStartE2EDuration="1.543983374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:48:00.541486162 +0000 UTC m=+1976.756071835" watchObservedRunningTime="2026-09-11 14:48:00.543983374 +0000 UTC m=+1976.758569034"
Sep 11 14:48:00.955774 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:00.955743    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:48:01.961216 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:01.961185    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:48:02.531027 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:02.530993    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:48:02.531998 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:02.531972    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:48:04.674186 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:04.674158    2569 scope.go:117] "RemoveContainer" containerID="de1602f7b04f1dfd204c5d19455d382b1408a41a2cbbb2fba64525338e735039"
Sep 11 14:48:07.595241 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:07.595209    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"]
Sep 11 14:48:07.598695 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:07.598677    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"
Sep 11 14:48:07.601940 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:07.601919    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-55ef8c-dockercfg-24gzm\""
Sep 11 14:48:07.602583 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:07.602563    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-55ef8c\""
Sep 11 14:48:07.625217 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:07.625192    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"]
Sep 11 14:48:07.700827 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:07.700677    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28b065d7-3ef6-4ed3-a1f8-e50b39b58db1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh\" (UID: \"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"
Sep 11 14:48:07.700827 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:07.700735    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m92cc\" (UniqueName: \"kubernetes.io/projected/28b065d7-3ef6-4ed3-a1f8-e50b39b58db1-kube-api-access-m92cc\") pod \"payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh\" (UID: \"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"
Sep 11 14:48:07.801780 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:07.801741    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28b065d7-3ef6-4ed3-a1f8-e50b39b58db1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh\" (UID: \"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"
Sep 11 14:48:07.801780 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:07.801781    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m92cc\" (UniqueName: \"kubernetes.io/projected/28b065d7-3ef6-4ed3-a1f8-e50b39b58db1-kube-api-access-m92cc\") pod \"payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh\" (UID: \"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"
Sep 11 14:48:07.802454 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:07.802429    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28b065d7-3ef6-4ed3-a1f8-e50b39b58db1-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh\" (UID: \"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"
Sep 11 14:48:07.814906 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:07.814864    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m92cc\" (UniqueName: \"kubernetes.io/projected/28b065d7-3ef6-4ed3-a1f8-e50b39b58db1-kube-api-access-m92cc\") pod \"payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh\" (UID: \"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"
Sep 11 14:48:07.908389 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:07.908327    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"
Sep 11 14:48:08.187602 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:08.187576    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"]
Sep 11 14:48:08.189806 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:48:08.189776    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28b065d7_3ef6_4ed3_a1f8_e50b39b58db1.slice/crio-273010ce31f398ef55c4f2c953ab3bedd88579326556b2bd14c1e67f363d4575 WatchSource:0}: Error finding container 273010ce31f398ef55c4f2c953ab3bedd88579326556b2bd14c1e67f363d4575: Status 404 returned error can't find the container with id 273010ce31f398ef55c4f2c953ab3bedd88579326556b2bd14c1e67f363d4575
Sep 11 14:48:08.563561 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:08.563471    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh" event={"ID":"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1","Type":"ContainerStarted","Data":"b78a628413944061fa5b1265863ac8cbc53352ec4120541889a792a6b7a61c7a"}
Sep 11 14:48:08.563561 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:08.563526    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh" event={"ID":"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1","Type":"ContainerStarted","Data":"273010ce31f398ef55c4f2c953ab3bedd88579326556b2bd14c1e67f363d4575"}
Sep 11 14:48:08.563561 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:08.563552    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"
Sep 11 14:48:08.582854 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:08.582809    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh" podStartSLOduration=1.582794125 podStartE2EDuration="1.582794125s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:48:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:48:08.581430381 +0000 UTC m=+1984.796016042" watchObservedRunningTime="2026-09-11 14:48:08.582794125 +0000 UTC m=+1984.797379786"
Sep 11 14:48:11.520682 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:11.520648    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:48:19.570502 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:19.570466    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"
Sep 11 14:48:21.639187 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:21.639155    2569 generic.go:356] "Generic (PLEG): container finished" podID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerID="e55cb1707fa97b1c6cd6c41477402825ecd5ed3adfff024b6d7da41da771e7b1" exitCode=0
Sep 11 14:48:21.639604 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:21.639231    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6" event={"ID":"9f0d9cf5-dfa6-4898-9e9e-733370425f8e","Type":"ContainerDied","Data":"e55cb1707fa97b1c6cd6c41477402825ecd5ed3adfff024b6d7da41da771e7b1"}
Sep 11 14:48:21.639604 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:21.639590    2569 scope.go:117] "RemoveContainer" containerID="e55cb1707fa97b1c6cd6c41477402825ecd5ed3adfff024b6d7da41da771e7b1"
Sep 11 14:48:21.640660 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:21.640623    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:48:21.640755 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:21.640694    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:48:21.640755 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:21.640737    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 14:48:22.652550 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:22.652504    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6" event={"ID":"9f0d9cf5-dfa6-4898-9e9e-733370425f8e","Type":"ContainerStarted","Data":"e613982d7c231794b1f78853e93c68209de7a023979b791affaebf5ded2011c7"}
Sep 11 14:48:22.956114 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:22.956073    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:48:22.956422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:22.956401    2569 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 14:48:22.956475 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:22.956452    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6" podUID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 14:48:23.956342 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:23.956306    2569 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 14:48:23.956720 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:23.956387    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6" podUID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 14:48:24.956208 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:24.956169    2569 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 14:48:24.956385 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:24.956229    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6" podUID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 14:48:25.956684 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:25.956647    2569 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 14:48:25.957097 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:25.956703    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6" podUID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 14:48:26.956318 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:26.956282    2569 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 14:48:26.956497 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:26.956358    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6" podUID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 14:48:27.960212 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:27.960184    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:48:27.960601 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:27.960582    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:48:27.961152 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:27.961134    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:48:33.607647 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:33.607612    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475"]
Sep 11 14:48:33.611297 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:33.611278    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475"
Sep 11 14:48:33.614256 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:33.614238    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:48:33.614345 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:33.614242    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:48:33.629469 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:33.629445    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475"]
Sep 11 14:48:33.635732 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:33.635711    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ad67344-ad65-4498-bacc-f8acec3b670d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475\" (UID: \"2ad67344-ad65-4498-bacc-f8acec3b670d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475"
Sep 11 14:48:33.736843 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:33.736815    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ad67344-ad65-4498-bacc-f8acec3b670d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475\" (UID: \"2ad67344-ad65-4498-bacc-f8acec3b670d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475"
Sep 11 14:48:33.737402 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:33.737385    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ad67344-ad65-4498-bacc-f8acec3b670d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475\" (UID: \"2ad67344-ad65-4498-bacc-f8acec3b670d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475"
Sep 11 14:48:33.921436 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:33.921357    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475"
Sep 11 14:48:34.203602 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:34.203568    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475"]
Sep 11 14:48:34.207095 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:48:34.207058    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ad67344_ad65_4498_bacc_f8acec3b670d.slice/crio-e5db50daa5214ae8ba4a5e44dec440cdb67cafc9e790e4d85d76b259b0cf428a WatchSource:0}: Error finding container e5db50daa5214ae8ba4a5e44dec440cdb67cafc9e790e4d85d76b259b0cf428a: Status 404 returned error can't find the container with id e5db50daa5214ae8ba4a5e44dec440cdb67cafc9e790e4d85d76b259b0cf428a
Sep 11 14:48:34.716116 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:34.716084    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475" event={"ID":"2ad67344-ad65-4498-bacc-f8acec3b670d","Type":"ContainerStarted","Data":"0d1025bdd96d9d137cc4ad55590316d88f5562a5a663a942e8b4fefc569f4796"}
Sep 11 14:48:34.716531 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:34.716145    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475" event={"ID":"2ad67344-ad65-4498-bacc-f8acec3b670d","Type":"ContainerStarted","Data":"e5db50daa5214ae8ba4a5e44dec440cdb67cafc9e790e4d85d76b259b0cf428a"}
Sep 11 14:48:34.737383 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:34.737333    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475" podStartSLOduration=1.737316029 podStartE2EDuration="1.737316029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:48:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:48:34.734596161 +0000 UTC m=+2010.949181845" watchObservedRunningTime="2026-09-11 14:48:34.737316029 +0000 UTC m=+2010.951901701"
Sep 11 14:48:35.722849 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:35.722812    2569 generic.go:356] "Generic (PLEG): container finished" podID="2ad67344-ad65-4498-bacc-f8acec3b670d" containerID="0d1025bdd96d9d137cc4ad55590316d88f5562a5a663a942e8b4fefc569f4796" exitCode=0
Sep 11 14:48:35.723320 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:35.722896    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475" event={"ID":"2ad67344-ad65-4498-bacc-f8acec3b670d","Type":"ContainerDied","Data":"0d1025bdd96d9d137cc4ad55590316d88f5562a5a663a942e8b4fefc569f4796"}
Sep 11 14:48:36.864474 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:36.864450    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475"
Sep 11 14:48:36.965726 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:36.965694    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ad67344-ad65-4498-bacc-f8acec3b670d-maas-api-service-ca\") pod \"2ad67344-ad65-4498-bacc-f8acec3b670d\" (UID: \"2ad67344-ad65-4498-bacc-f8acec3b670d\") "
Sep 11 14:48:36.966047 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:36.966026    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ad67344-ad65-4498-bacc-f8acec3b670d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2ad67344-ad65-4498-bacc-f8acec3b670d" (UID: "2ad67344-ad65-4498-bacc-f8acec3b670d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:48:37.066592 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:37.066523    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ad67344-ad65-4498-bacc-f8acec3b670d-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:48:37.734366 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:37.734328    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475" event={"ID":"2ad67344-ad65-4498-bacc-f8acec3b670d","Type":"ContainerDied","Data":"e5db50daa5214ae8ba4a5e44dec440cdb67cafc9e790e4d85d76b259b0cf428a"}
Sep 11 14:48:37.734553 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:37.734378    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5db50daa5214ae8ba4a5e44dec440cdb67cafc9e790e4d85d76b259b0cf428a"
Sep 11 14:48:37.734553 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:37.734344    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475"
Sep 11 14:48:44.804469 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:44.804434    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"]
Sep 11 14:48:44.804918 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:44.804628    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh" podUID="28b065d7-3ef6-4ed3-a1f8-e50b39b58db1" containerName="payload-pre-processing" containerID="cri-o://b78a628413944061fa5b1265863ac8cbc53352ec4120541889a792a6b7a61c7a" gracePeriod=30
Sep 11 14:48:44.997979 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:44.997948    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475"]
Sep 11 14:48:45.001384 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.001360    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-55ef8c-5p475"]
Sep 11 14:48:45.061938 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.061863    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"
Sep 11 14:48:45.133625 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.133590    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28b065d7-3ef6-4ed3-a1f8-e50b39b58db1-plugins-config-volume\") pod \"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1\" (UID: \"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1\") "
Sep 11 14:48:45.134360 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.134338    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m92cc\" (UniqueName: \"kubernetes.io/projected/28b065d7-3ef6-4ed3-a1f8-e50b39b58db1-kube-api-access-m92cc\") pod \"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1\" (UID: \"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1\") "
Sep 11 14:48:45.135126 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.134211    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28b065d7-3ef6-4ed3-a1f8-e50b39b58db1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "28b065d7-3ef6-4ed3-a1f8-e50b39b58db1" (UID: "28b065d7-3ef6-4ed3-a1f8-e50b39b58db1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:48:45.137714 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.137688    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28b065d7-3ef6-4ed3-a1f8-e50b39b58db1-kube-api-access-m92cc" (OuterVolumeSpecName: "kube-api-access-m92cc") pod "28b065d7-3ef6-4ed3-a1f8-e50b39b58db1" (UID: "28b065d7-3ef6-4ed3-a1f8-e50b39b58db1"). InnerVolumeSpecName "kube-api-access-m92cc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:48:45.235836 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.235802    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28b065d7-3ef6-4ed3-a1f8-e50b39b58db1-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:48:45.235836 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.235830    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m92cc\" (UniqueName: \"kubernetes.io/projected/28b065d7-3ef6-4ed3-a1f8-e50b39b58db1-kube-api-access-m92cc\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:48:45.776812 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.776778    2569 generic.go:356] "Generic (PLEG): container finished" podID="28b065d7-3ef6-4ed3-a1f8-e50b39b58db1" containerID="b78a628413944061fa5b1265863ac8cbc53352ec4120541889a792a6b7a61c7a" exitCode=0
Sep 11 14:48:45.776812 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.776827    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh" event={"ID":"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1","Type":"ContainerDied","Data":"b78a628413944061fa5b1265863ac8cbc53352ec4120541889a792a6b7a61c7a"}
Sep 11 14:48:45.777099 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.776828    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"
Sep 11 14:48:45.777099 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.776870    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh" event={"ID":"28b065d7-3ef6-4ed3-a1f8-e50b39b58db1","Type":"ContainerDied","Data":"273010ce31f398ef55c4f2c953ab3bedd88579326556b2bd14c1e67f363d4575"}
Sep 11 14:48:45.777099 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.776913    2569 scope.go:117] "RemoveContainer" containerID="b78a628413944061fa5b1265863ac8cbc53352ec4120541889a792a6b7a61c7a"
Sep 11 14:48:45.786661 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.786643    2569 scope.go:117] "RemoveContainer" containerID="b78a628413944061fa5b1265863ac8cbc53352ec4120541889a792a6b7a61c7a"
Sep 11 14:48:45.786937 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:48:45.786917    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b78a628413944061fa5b1265863ac8cbc53352ec4120541889a792a6b7a61c7a\": container with ID starting with b78a628413944061fa5b1265863ac8cbc53352ec4120541889a792a6b7a61c7a not found: ID does not exist" containerID="b78a628413944061fa5b1265863ac8cbc53352ec4120541889a792a6b7a61c7a"
Sep 11 14:48:45.786978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.786950    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b78a628413944061fa5b1265863ac8cbc53352ec4120541889a792a6b7a61c7a"} err="failed to get container status \"b78a628413944061fa5b1265863ac8cbc53352ec4120541889a792a6b7a61c7a\": rpc error: code = NotFound desc = could not find container \"b78a628413944061fa5b1265863ac8cbc53352ec4120541889a792a6b7a61c7a\": container with ID starting with b78a628413944061fa5b1265863ac8cbc53352ec4120541889a792a6b7a61c7a not found: ID does not exist"
Sep 11 14:48:45.815547 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.815524    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"]
Sep 11 14:48:45.823949 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:45.823930    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-55ef8c-85758dc94b-nvvzh"]
Sep 11 14:48:46.271409 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:46.271373    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28b065d7-3ef6-4ed3-a1f8-e50b39b58db1" path="/var/lib/kubelet/pods/28b065d7-3ef6-4ed3-a1f8-e50b39b58db1/volumes"
Sep 11 14:48:46.271761 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:46.271746    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ad67344-ad65-4498-bacc-f8acec3b670d" path="/var/lib/kubelet/pods/2ad67344-ad65-4498-bacc-f8acec3b670d/volumes"
Sep 11 14:48:49.469713 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:49.469673    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:48:52.336333 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:52.336302    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"]
Sep 11 14:48:52.336713 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:52.336505    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6" podUID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerName="istio-proxy" containerID="cri-o://e613982d7c231794b1f78853e93c68209de7a023979b791affaebf5ded2011c7" gracePeriod=30
Sep 11 14:48:57.598332 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.598306    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:48:57.737769 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.737738    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7gxp\" (UniqueName: \"kubernetes.io/projected/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-kube-api-access-b7gxp\") pod \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") "
Sep 11 14:48:57.737970 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.737781    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-data\") pod \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") "
Sep 11 14:48:57.737970 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.737802    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-podinfo\") pod \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") "
Sep 11 14:48:57.737970 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.737922    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-credential-socket\") pod \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") "
Sep 11 14:48:57.738165 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.738012    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-envoy\") pod \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") "
Sep 11 14:48:57.738165 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.738066    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-token\") pod \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") "
Sep 11 14:48:57.738165 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.738096    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istiod-ca-cert\") pod \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") "
Sep 11 14:48:57.738165 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.738130    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-workload-certs\") pod \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") "
Sep 11 14:48:57.738165 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.738125    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-data" (OuterVolumeSpecName: "istio-data") pod "9f0d9cf5-dfa6-4898-9e9e-733370425f8e" (UID: "9f0d9cf5-dfa6-4898-9e9e-733370425f8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:48:57.738377 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.738172    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9f0d9cf5-dfa6-4898-9e9e-733370425f8e" (UID: "9f0d9cf5-dfa6-4898-9e9e-733370425f8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:48:57.738377 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.738208    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-workload-socket\") pod \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\" (UID: \"9f0d9cf5-dfa6-4898-9e9e-733370425f8e\") "
Sep 11 14:48:57.738548 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.738527    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-data\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:48:57.738784 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.738556    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-credential-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:48:57.738841 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.738780    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9f0d9cf5-dfa6-4898-9e9e-733370425f8e" (UID: "9f0d9cf5-dfa6-4898-9e9e-733370425f8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:48:57.738841 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.738805    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9f0d9cf5-dfa6-4898-9e9e-733370425f8e" (UID: "9f0d9cf5-dfa6-4898-9e9e-733370425f8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:48:57.738987 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.738927    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9f0d9cf5-dfa6-4898-9e9e-733370425f8e" (UID: "9f0d9cf5-dfa6-4898-9e9e-733370425f8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:48:57.740244 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.740214    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9f0d9cf5-dfa6-4898-9e9e-733370425f8e" (UID: "9f0d9cf5-dfa6-4898-9e9e-733370425f8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 14:48:57.740353 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.740288    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9f0d9cf5-dfa6-4898-9e9e-733370425f8e" (UID: "9f0d9cf5-dfa6-4898-9e9e-733370425f8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:48:57.740353 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.740294    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-kube-api-access-b7gxp" (OuterVolumeSpecName: "kube-api-access-b7gxp") pod "9f0d9cf5-dfa6-4898-9e9e-733370425f8e" (UID: "9f0d9cf5-dfa6-4898-9e9e-733370425f8e"). InnerVolumeSpecName "kube-api-access-b7gxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:48:57.740563 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.740546    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f0d9cf5-dfa6-4898-9e9e-733370425f8e" (UID: "9f0d9cf5-dfa6-4898-9e9e-733370425f8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:48:57.839170 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.839144    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-token\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:48:57.839170 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.839166    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istiod-ca-cert\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:48:57.839170 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.839175    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-workload-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:48:57.839452 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.839185    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-workload-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:48:57.839452 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.839193    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7gxp\" (UniqueName: \"kubernetes.io/projected/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-kube-api-access-b7gxp\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:48:57.839452 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.839201    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-podinfo\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:48:57.839452 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.839208    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f0d9cf5-dfa6-4898-9e9e-733370425f8e-istio-envoy\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:48:57.842017 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.841989    2569 generic.go:356] "Generic (PLEG): container finished" podID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerID="e613982d7c231794b1f78853e93c68209de7a023979b791affaebf5ded2011c7" exitCode=0
Sep 11 14:48:57.842120 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.842043    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"
Sep 11 14:48:57.842120 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.842071    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6" event={"ID":"9f0d9cf5-dfa6-4898-9e9e-733370425f8e","Type":"ContainerDied","Data":"e613982d7c231794b1f78853e93c68209de7a023979b791affaebf5ded2011c7"}
Sep 11 14:48:57.842194 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.842125    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6" event={"ID":"9f0d9cf5-dfa6-4898-9e9e-733370425f8e","Type":"ContainerDied","Data":"87e3cff7c1ed9f2d9dd761fc2e39efb5ba2e52847fd66d55343df214d3a8d208"}
Sep 11 14:48:57.842194 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.842149    2569 scope.go:117] "RemoveContainer" containerID="e613982d7c231794b1f78853e93c68209de7a023979b791affaebf5ded2011c7"
Sep 11 14:48:57.851984 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.851969    2569 scope.go:117] "RemoveContainer" containerID="e55cb1707fa97b1c6cd6c41477402825ecd5ed3adfff024b6d7da41da771e7b1"
Sep 11 14:48:57.860549 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.860528    2569 scope.go:117] "RemoveContainer" containerID="e613982d7c231794b1f78853e93c68209de7a023979b791affaebf5ded2011c7"
Sep 11 14:48:57.860804 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:48:57.860785    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e613982d7c231794b1f78853e93c68209de7a023979b791affaebf5ded2011c7\": container with ID starting with e613982d7c231794b1f78853e93c68209de7a023979b791affaebf5ded2011c7 not found: ID does not exist" containerID="e613982d7c231794b1f78853e93c68209de7a023979b791affaebf5ded2011c7"
Sep 11 14:48:57.860844 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.860812    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e613982d7c231794b1f78853e93c68209de7a023979b791affaebf5ded2011c7"} err="failed to get container status \"e613982d7c231794b1f78853e93c68209de7a023979b791affaebf5ded2011c7\": rpc error: code = NotFound desc = could not find container \"e613982d7c231794b1f78853e93c68209de7a023979b791affaebf5ded2011c7\": container with ID starting with e613982d7c231794b1f78853e93c68209de7a023979b791affaebf5ded2011c7 not found: ID does not exist"
Sep 11 14:48:57.860844 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.860830    2569 scope.go:117] "RemoveContainer" containerID="e55cb1707fa97b1c6cd6c41477402825ecd5ed3adfff024b6d7da41da771e7b1"
Sep 11 14:48:57.861119 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:48:57.861099    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e55cb1707fa97b1c6cd6c41477402825ecd5ed3adfff024b6d7da41da771e7b1\": container with ID starting with e55cb1707fa97b1c6cd6c41477402825ecd5ed3adfff024b6d7da41da771e7b1 not found: ID does not exist" containerID="e55cb1707fa97b1c6cd6c41477402825ecd5ed3adfff024b6d7da41da771e7b1"
Sep 11 14:48:57.861165 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.861124    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e55cb1707fa97b1c6cd6c41477402825ecd5ed3adfff024b6d7da41da771e7b1"} err="failed to get container status \"e55cb1707fa97b1c6cd6c41477402825ecd5ed3adfff024b6d7da41da771e7b1\": rpc error: code = NotFound desc = could not find container \"e55cb1707fa97b1c6cd6c41477402825ecd5ed3adfff024b6d7da41da771e7b1\": container with ID starting with e55cb1707fa97b1c6cd6c41477402825ecd5ed3adfff024b6d7da41da771e7b1 not found: ID does not exist"
Sep 11 14:48:57.867856 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.867834    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"]
Sep 11 14:48:57.874597 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:57.874577    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-55ef8c-openshift-default-859f69f8f6-kjnf6"]
Sep 11 14:48:58.271414 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:48:58.271383    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" path="/var/lib/kubelet/pods/9f0d9cf5-dfa6-4898-9e9e-733370425f8e/volumes"
Sep 11 14:49:09.618889 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:09.618851    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:49:12.162327 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.162296    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"]
Sep 11 14:49:12.162764 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.162515    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm" podUID="e8ed079c-ea25-45f5-a908-7b78c51f582c" containerName="payload-processing" containerID="cri-o://3a0c409bb0c54a86603ebfdead52547ca5df037a3337f06a395ef5df0b36c50b" gracePeriod=30
Sep 11 14:49:12.415205 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.415148    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"
Sep 11 14:49:12.556640 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.556611    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqndz\" (UniqueName: \"kubernetes.io/projected/e8ed079c-ea25-45f5-a908-7b78c51f582c-kube-api-access-zqndz\") pod \"e8ed079c-ea25-45f5-a908-7b78c51f582c\" (UID: \"e8ed079c-ea25-45f5-a908-7b78c51f582c\") "
Sep 11 14:49:12.556811 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.556681    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8ed079c-ea25-45f5-a908-7b78c51f582c-plugins-config-volume\") pod \"e8ed079c-ea25-45f5-a908-7b78c51f582c\" (UID: \"e8ed079c-ea25-45f5-a908-7b78c51f582c\") "
Sep 11 14:49:12.557049 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.557026    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8ed079c-ea25-45f5-a908-7b78c51f582c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e8ed079c-ea25-45f5-a908-7b78c51f582c" (UID: "e8ed079c-ea25-45f5-a908-7b78c51f582c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:49:12.558852 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.558830    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8ed079c-ea25-45f5-a908-7b78c51f582c-kube-api-access-zqndz" (OuterVolumeSpecName: "kube-api-access-zqndz") pod "e8ed079c-ea25-45f5-a908-7b78c51f582c" (UID: "e8ed079c-ea25-45f5-a908-7b78c51f582c"). InnerVolumeSpecName "kube-api-access-zqndz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:49:12.658047 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.658017    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqndz\" (UniqueName: \"kubernetes.io/projected/e8ed079c-ea25-45f5-a908-7b78c51f582c-kube-api-access-zqndz\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:49:12.658047 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.658042    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8ed079c-ea25-45f5-a908-7b78c51f582c-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:49:12.919808 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.919774    2569 generic.go:356] "Generic (PLEG): container finished" podID="e8ed079c-ea25-45f5-a908-7b78c51f582c" containerID="3a0c409bb0c54a86603ebfdead52547ca5df037a3337f06a395ef5df0b36c50b" exitCode=0
Sep 11 14:49:12.919979 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.919824    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"
Sep 11 14:49:12.919979 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.919888    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm" event={"ID":"e8ed079c-ea25-45f5-a908-7b78c51f582c","Type":"ContainerDied","Data":"3a0c409bb0c54a86603ebfdead52547ca5df037a3337f06a395ef5df0b36c50b"}
Sep 11 14:49:12.919979 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.919946    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm" event={"ID":"e8ed079c-ea25-45f5-a908-7b78c51f582c","Type":"ContainerDied","Data":"02f2517b0e151697dc922b51c537f183cc5aeee44633ed23e29ed28ee73fbd40"}
Sep 11 14:49:12.919979 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.919973    2569 scope.go:117] "RemoveContainer" containerID="3a0c409bb0c54a86603ebfdead52547ca5df037a3337f06a395ef5df0b36c50b"
Sep 11 14:49:12.929421 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.929402    2569 scope.go:117] "RemoveContainer" containerID="3a0c409bb0c54a86603ebfdead52547ca5df037a3337f06a395ef5df0b36c50b"
Sep 11 14:49:12.929730 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:49:12.929710    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a0c409bb0c54a86603ebfdead52547ca5df037a3337f06a395ef5df0b36c50b\": container with ID starting with 3a0c409bb0c54a86603ebfdead52547ca5df037a3337f06a395ef5df0b36c50b not found: ID does not exist" containerID="3a0c409bb0c54a86603ebfdead52547ca5df037a3337f06a395ef5df0b36c50b"
Sep 11 14:49:12.929813 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.929738    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a0c409bb0c54a86603ebfdead52547ca5df037a3337f06a395ef5df0b36c50b"} err="failed to get container status \"3a0c409bb0c54a86603ebfdead52547ca5df037a3337f06a395ef5df0b36c50b\": rpc error: code = NotFound desc = could not find container \"3a0c409bb0c54a86603ebfdead52547ca5df037a3337f06a395ef5df0b36c50b\": container with ID starting with 3a0c409bb0c54a86603ebfdead52547ca5df037a3337f06a395ef5df0b36c50b not found: ID does not exist"
Sep 11 14:49:12.946983 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.946957    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"]
Sep 11 14:49:12.949520 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:12.949501    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-9fedd5-64cf9fb999-xzhlm"]
Sep 11 14:49:14.270215 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:14.270181    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8ed079c-ea25-45f5-a908-7b78c51f582c" path="/var/lib/kubelet/pods/e8ed079c-ea25-45f5-a908-7b78c51f582c/volumes"
Sep 11 14:49:17.776623 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:17.776589    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"]
Sep 11 14:49:22.732038 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:22.732006    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:49:32.796086 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:32.795990    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd" podUID="a239c845-3b84-4ead-a87a-f8eef5c96d69" containerName="main" containerID="cri-o://ee1e08157565c13b08d22ed3341d50e9d514a487e42a8d764670d1765c68f25d" gracePeriod=45
Sep 11 14:49:33.024213 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.024180    2569 generic.go:356] "Generic (PLEG): container finished" podID="a239c845-3b84-4ead-a87a-f8eef5c96d69" containerID="ee1e08157565c13b08d22ed3341d50e9d514a487e42a8d764670d1765c68f25d" exitCode=0
Sep 11 14:49:33.024373 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.024253    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd" event={"ID":"a239c845-3b84-4ead-a87a-f8eef5c96d69","Type":"ContainerDied","Data":"ee1e08157565c13b08d22ed3341d50e9d514a487e42a8d764670d1765c68f25d"}
Sep 11 14:49:33.048280 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.048227    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:49:33.116427 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.116397    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-tmp-dir\") pod \"a239c845-3b84-4ead-a87a-f8eef5c96d69\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") "
Sep 11 14:49:33.116566 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.116458    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lv6p\" (UniqueName: \"kubernetes.io/projected/a239c845-3b84-4ead-a87a-f8eef5c96d69-kube-api-access-8lv6p\") pod \"a239c845-3b84-4ead-a87a-f8eef5c96d69\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") "
Sep 11 14:49:33.116566 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.116502    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a239c845-3b84-4ead-a87a-f8eef5c96d69-tls-certs\") pod \"a239c845-3b84-4ead-a87a-f8eef5c96d69\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") "
Sep 11 14:49:33.116566 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.116535    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-model-cache\") pod \"a239c845-3b84-4ead-a87a-f8eef5c96d69\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") "
Sep 11 14:49:33.117046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.116706    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-dshm\") pod \"a239c845-3b84-4ead-a87a-f8eef5c96d69\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") "
Sep 11 14:49:33.117046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.116717    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a239c845-3b84-4ead-a87a-f8eef5c96d69" (UID: "a239c845-3b84-4ead-a87a-f8eef5c96d69"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:49:33.117046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.116756    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-home\") pod \"a239c845-3b84-4ead-a87a-f8eef5c96d69\" (UID: \"a239c845-3b84-4ead-a87a-f8eef5c96d69\") "
Sep 11 14:49:33.117046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.116757    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-model-cache" (OuterVolumeSpecName: "model-cache") pod "a239c845-3b84-4ead-a87a-f8eef5c96d69" (UID: "a239c845-3b84-4ead-a87a-f8eef5c96d69"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:49:33.117046 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.116950    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-home" (OuterVolumeSpecName: "home") pod "a239c845-3b84-4ead-a87a-f8eef5c96d69" (UID: "a239c845-3b84-4ead-a87a-f8eef5c96d69"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:49:33.117331 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.117095    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-home\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:49:33.117331 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.117116    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-tmp-dir\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:49:33.117331 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.117129    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-model-cache\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:49:33.118779 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.118754    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a239c845-3b84-4ead-a87a-f8eef5c96d69-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a239c845-3b84-4ead-a87a-f8eef5c96d69" (UID: "a239c845-3b84-4ead-a87a-f8eef5c96d69"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:49:33.118929 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.118897    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a239c845-3b84-4ead-a87a-f8eef5c96d69-kube-api-access-8lv6p" (OuterVolumeSpecName: "kube-api-access-8lv6p") pod "a239c845-3b84-4ead-a87a-f8eef5c96d69" (UID: "a239c845-3b84-4ead-a87a-f8eef5c96d69"). InnerVolumeSpecName "kube-api-access-8lv6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:49:33.119196 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.119172    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-dshm" (OuterVolumeSpecName: "dshm") pod "a239c845-3b84-4ead-a87a-f8eef5c96d69" (UID: "a239c845-3b84-4ead-a87a-f8eef5c96d69"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:49:33.218271 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.218247    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a239c845-3b84-4ead-a87a-f8eef5c96d69-dshm\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:49:33.218271 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.218271    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lv6p\" (UniqueName: \"kubernetes.io/projected/a239c845-3b84-4ead-a87a-f8eef5c96d69-kube-api-access-8lv6p\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:49:33.218420 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:33.218282    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a239c845-3b84-4ead-a87a-f8eef5c96d69-tls-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:49:34.030239 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:34.030215    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"
Sep 11 14:49:34.030682 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:34.030260    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd" event={"ID":"a239c845-3b84-4ead-a87a-f8eef5c96d69","Type":"ContainerDied","Data":"7ff56d5d29f9c975ae827e0e796a5427747d155b9228e5b8259b3e349070bad9"}
Sep 11 14:49:34.030682 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:34.030305    2569 scope.go:117] "RemoveContainer" containerID="ee1e08157565c13b08d22ed3341d50e9d514a487e42a8d764670d1765c68f25d"
Sep 11 14:49:34.052914 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:34.052859    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"]
Sep 11 14:49:34.055054 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:34.055025    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-9fedd5/ipp-route-9fedd5-kserve-55fd94998c-5g8wd"]
Sep 11 14:49:34.271306 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:49:34.271272    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a239c845-3b84-4ead-a87a-f8eef5c96d69" path="/var/lib/kubelet/pods/a239c845-3b84-4ead-a87a-f8eef5c96d69/volumes"
Sep 11 14:50:01.628179 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:01.628142    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"]
Sep 11 14:50:01.628710 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:01.628406    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy" containerID="cri-o://1400d2dae50fa4f81621364395ffaa823bc9883189758aa09cb69f17357d67b5" gracePeriod=30
Sep 11 14:50:02.064525 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.064491    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w"]
Sep 11 14:50:02.064897 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.064868    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28b065d7-3ef6-4ed3-a1f8-e50b39b58db1" containerName="payload-pre-processing"
Sep 11 14:50:02.064897 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.064897    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="28b065d7-3ef6-4ed3-a1f8-e50b39b58db1" containerName="payload-pre-processing"
Sep 11 14:50:02.064978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.064908    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ad67344-ad65-4498-bacc-f8acec3b670d" containerName="revoke-keys"
Sep 11 14:50:02.064978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.064914    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ad67344-ad65-4498-bacc-f8acec3b670d" containerName="revoke-keys"
Sep 11 14:50:02.064978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.064924    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerName="istio-proxy"
Sep 11 14:50:02.064978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.064930    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerName="istio-proxy"
Sep 11 14:50:02.064978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.064940    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerName="istio-proxy"
Sep 11 14:50:02.064978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.064945    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerName="istio-proxy"
Sep 11 14:50:02.064978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.064952    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a239c845-3b84-4ead-a87a-f8eef5c96d69" containerName="main"
Sep 11 14:50:02.064978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.064957    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a239c845-3b84-4ead-a87a-f8eef5c96d69" containerName="main"
Sep 11 14:50:02.064978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.064969    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8ed079c-ea25-45f5-a908-7b78c51f582c" containerName="payload-processing"
Sep 11 14:50:02.064978 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.064973    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8ed079c-ea25-45f5-a908-7b78c51f582c" containerName="payload-processing"
Sep 11 14:50:02.065281 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.065026    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ad67344-ad65-4498-bacc-f8acec3b670d" containerName="revoke-keys"
Sep 11 14:50:02.065281 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.065035    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a239c845-3b84-4ead-a87a-f8eef5c96d69" containerName="main"
Sep 11 14:50:02.065281 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.065040    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerName="istio-proxy"
Sep 11 14:50:02.065281 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.065045    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f0d9cf5-dfa6-4898-9e9e-733370425f8e" containerName="istio-proxy"
Sep 11 14:50:02.065281 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.065050    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8ed079c-ea25-45f5-a908-7b78c51f582c" containerName="payload-processing"
Sep 11 14:50:02.065281 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.065055    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="28b065d7-3ef6-4ed3-a1f8-e50b39b58db1" containerName="payload-pre-processing"
Sep 11 14:50:02.067942 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.067927    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w"
Sep 11 14:50:02.070768 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.070746    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:50:02.070939 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.070911    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:50:02.079531 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.079507    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w"]
Sep 11 14:50:02.147112 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.147078    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f773df5-8634-4dc9-ac54-e8e0ffe31b37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w\" (UID: \"0f773df5-8634-4dc9-ac54-e8e0ffe31b37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w"
Sep 11 14:50:02.248383 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.248356    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f773df5-8634-4dc9-ac54-e8e0ffe31b37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w\" (UID: \"0f773df5-8634-4dc9-ac54-e8e0ffe31b37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w"
Sep 11 14:50:02.248942 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.248921    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f773df5-8634-4dc9-ac54-e8e0ffe31b37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w\" (UID: \"0f773df5-8634-4dc9-ac54-e8e0ffe31b37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w"
Sep 11 14:50:02.378867 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.378798    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w"
Sep 11 14:50:02.664118 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:02.663993    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w"]
Sep 11 14:50:02.666931 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:50:02.666906    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f773df5_8634_4dc9_ac54_e8e0ffe31b37.slice/crio-b833a377958a59733886eec8ef6298e3eb0a16196c90e30e9b2472c215f5debc WatchSource:0}: Error finding container b833a377958a59733886eec8ef6298e3eb0a16196c90e30e9b2472c215f5debc: Status 404 returned error can't find the container with id b833a377958a59733886eec8ef6298e3eb0a16196c90e30e9b2472c215f5debc
Sep 11 14:50:03.184540 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:03.184461    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w" event={"ID":"0f773df5-8634-4dc9-ac54-e8e0ffe31b37","Type":"ContainerStarted","Data":"8b01165a0fc4645ce11e3b634e7629d123d652b2e4c0837d1dc2e1c0913cd717"}
Sep 11 14:50:03.184540 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:03.184517    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w" event={"ID":"0f773df5-8634-4dc9-ac54-e8e0ffe31b37","Type":"ContainerStarted","Data":"b833a377958a59733886eec8ef6298e3eb0a16196c90e30e9b2472c215f5debc"}
Sep 11 14:50:03.202312 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:03.202269    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w" podStartSLOduration=1.202255171 podStartE2EDuration="1.202255171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:50:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:50:03.200345547 +0000 UTC m=+2099.414931213" watchObservedRunningTime="2026-09-11 14:50:03.202255171 +0000 UTC m=+2099.416840833"
Sep 11 14:50:04.191616 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:04.191577    2569 generic.go:356] "Generic (PLEG): container finished" podID="0f773df5-8634-4dc9-ac54-e8e0ffe31b37" containerID="8b01165a0fc4645ce11e3b634e7629d123d652b2e4c0837d1dc2e1c0913cd717" exitCode=0
Sep 11 14:50:04.192011 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:04.191700    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w" event={"ID":"0f773df5-8634-4dc9-ac54-e8e0ffe31b37","Type":"ContainerDied","Data":"8b01165a0fc4645ce11e3b634e7629d123d652b2e4c0837d1dc2e1c0913cd717"}
Sep 11 14:50:04.363176 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:04.363150    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:50:04.367979 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:04.367956    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:50:05.335266 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:05.335236    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w"
Sep 11 14:50:05.475638 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:05.475561    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f773df5-8634-4dc9-ac54-e8e0ffe31b37-maas-api-service-ca\") pod \"0f773df5-8634-4dc9-ac54-e8e0ffe31b37\" (UID: \"0f773df5-8634-4dc9-ac54-e8e0ffe31b37\") "
Sep 11 14:50:05.475919 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:05.475869    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f773df5-8634-4dc9-ac54-e8e0ffe31b37-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0f773df5-8634-4dc9-ac54-e8e0ffe31b37" (UID: "0f773df5-8634-4dc9-ac54-e8e0ffe31b37"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:50:05.576344 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:05.576310    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f773df5-8634-4dc9-ac54-e8e0ffe31b37-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:06.202263 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.202237    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w"
Sep 11 14:50:06.202263 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.202254    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w" event={"ID":"0f773df5-8634-4dc9-ac54-e8e0ffe31b37","Type":"ContainerDied","Data":"b833a377958a59733886eec8ef6298e3eb0a16196c90e30e9b2472c215f5debc"}
Sep 11 14:50:06.202539 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.202325    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b833a377958a59733886eec8ef6298e3eb0a16196c90e30e9b2472c215f5debc"
Sep 11 14:50:06.883817 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.883793    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:50:06.988347 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.988325    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-podinfo\") pod \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") "
Sep 11 14:50:06.988478 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.988376    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-token\") pod \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") "
Sep 11 14:50:06.988478 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.988404    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-data\") pod \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") "
Sep 11 14:50:06.988478 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.988433    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istiod-ca-cert\") pod \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") "
Sep 11 14:50:06.988598 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.988495    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-workload-socket\") pod \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") "
Sep 11 14:50:06.988598 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.988540    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-envoy\") pod \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") "
Sep 11 14:50:06.988598 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.988576    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-credential-socket\") pod \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") "
Sep 11 14:50:06.988744 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.988608    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-workload-certs\") pod \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") "
Sep 11 14:50:06.988744 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.988636    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8rr6\" (UniqueName: \"kubernetes.io/projected/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-kube-api-access-s8rr6\") pod \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\" (UID: \"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459\") "
Sep 11 14:50:06.988856 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.988745    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-data" (OuterVolumeSpecName: "istio-data") pod "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" (UID: "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:50:06.988856 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.988818    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" (UID: "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:50:06.989013 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.988977    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" (UID: "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:50:06.989098 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.989044    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" (UID: "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:50:06.989098 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.989060    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-data\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:06.989098 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.989080    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istiod-ca-cert\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:06.989258 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.989181    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" (UID: "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:50:06.990775 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.990751    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" (UID: "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 14:50:06.990775 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.990763    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-token" (OuterVolumeSpecName: "istio-token") pod "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" (UID: "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:50:06.990940 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.990796    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" (UID: "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:50:06.991053 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:06.991035    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-kube-api-access-s8rr6" (OuterVolumeSpecName: "kube-api-access-s8rr6") pod "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" (UID: "4fb05110-3b09-4c6c-a9bc-7c7bfb84d459"). InnerVolumeSpecName "kube-api-access-s8rr6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:50:07.089580 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.089558    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-credential-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:07.089580 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.089579    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-workload-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:07.089709 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.089588    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8rr6\" (UniqueName: \"kubernetes.io/projected/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-kube-api-access-s8rr6\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:07.089709 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.089596    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-podinfo\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:07.089709 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.089604    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-token\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:07.089709 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.089611    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-workload-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:07.089709 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.089618    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459-istio-envoy\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:07.208800 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.208770    2569 generic.go:356] "Generic (PLEG): container finished" podID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerID="1400d2dae50fa4f81621364395ffaa823bc9883189758aa09cb69f17357d67b5" exitCode=0
Sep 11 14:50:07.209031 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.208825    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"
Sep 11 14:50:07.209031 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.208850    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" event={"ID":"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459","Type":"ContainerDied","Data":"1400d2dae50fa4f81621364395ffaa823bc9883189758aa09cb69f17357d67b5"}
Sep 11 14:50:07.209031 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.208932    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz" event={"ID":"4fb05110-3b09-4c6c-a9bc-7c7bfb84d459","Type":"ContainerDied","Data":"6b3fb2c0191adbc3e711aad6ab1dc5756e38b5ca1990a549f72a2575cbc35f0e"}
Sep 11 14:50:07.209031 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.208957    2569 scope.go:117] "RemoveContainer" containerID="1400d2dae50fa4f81621364395ffaa823bc9883189758aa09cb69f17357d67b5"
Sep 11 14:50:07.218288 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.218271    2569 scope.go:117] "RemoveContainer" containerID="571fd0ffb0200a1c5cfc92d8b8d83fb7514ce7b83b595406ad95bca23dd94e38"
Sep 11 14:50:07.226300 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.226283    2569 scope.go:117] "RemoveContainer" containerID="1400d2dae50fa4f81621364395ffaa823bc9883189758aa09cb69f17357d67b5"
Sep 11 14:50:07.226558 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:50:07.226540    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1400d2dae50fa4f81621364395ffaa823bc9883189758aa09cb69f17357d67b5\": container with ID starting with 1400d2dae50fa4f81621364395ffaa823bc9883189758aa09cb69f17357d67b5 not found: ID does not exist" containerID="1400d2dae50fa4f81621364395ffaa823bc9883189758aa09cb69f17357d67b5"
Sep 11 14:50:07.226613 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.226568    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1400d2dae50fa4f81621364395ffaa823bc9883189758aa09cb69f17357d67b5"} err="failed to get container status \"1400d2dae50fa4f81621364395ffaa823bc9883189758aa09cb69f17357d67b5\": rpc error: code = NotFound desc = could not find container \"1400d2dae50fa4f81621364395ffaa823bc9883189758aa09cb69f17357d67b5\": container with ID starting with 1400d2dae50fa4f81621364395ffaa823bc9883189758aa09cb69f17357d67b5 not found: ID does not exist"
Sep 11 14:50:07.226613 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.226584    2569 scope.go:117] "RemoveContainer" containerID="571fd0ffb0200a1c5cfc92d8b8d83fb7514ce7b83b595406ad95bca23dd94e38"
Sep 11 14:50:07.226833 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:50:07.226814    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"571fd0ffb0200a1c5cfc92d8b8d83fb7514ce7b83b595406ad95bca23dd94e38\": container with ID starting with 571fd0ffb0200a1c5cfc92d8b8d83fb7514ce7b83b595406ad95bca23dd94e38 not found: ID does not exist" containerID="571fd0ffb0200a1c5cfc92d8b8d83fb7514ce7b83b595406ad95bca23dd94e38"
Sep 11 14:50:07.226907 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.226841    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"571fd0ffb0200a1c5cfc92d8b8d83fb7514ce7b83b595406ad95bca23dd94e38"} err="failed to get container status \"571fd0ffb0200a1c5cfc92d8b8d83fb7514ce7b83b595406ad95bca23dd94e38\": rpc error: code = NotFound desc = could not find container \"571fd0ffb0200a1c5cfc92d8b8d83fb7514ce7b83b595406ad95bca23dd94e38\": container with ID starting with 571fd0ffb0200a1c5cfc92d8b8d83fb7514ce7b83b595406ad95bca23dd94e38 not found: ID does not exist"
Sep 11 14:50:07.247191 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.247134    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"]
Sep 11 14:50:07.252321 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:07.252299    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-9fedd5-openshift-default-b4b5f45d8-g6hcz"]
Sep 11 14:50:08.269972 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:08.269940    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" path="/var/lib/kubelet/pods/4fb05110-3b09-4c6c-a9bc-7c7bfb84d459/volumes"
Sep 11 14:50:12.965124 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:12.965090    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"]
Sep 11 14:50:12.965575 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:12.965298    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s" podUID="2bd667ca-5896-44dc-a5d0-d1e612da730d" containerName="payload-pre-processing" containerID="cri-o://95bc85bc1a4642cdf3ac3f9b96a5e6bc8127eec45277ecc1e397b53a6861cf23" gracePeriod=30
Sep 11 14:50:13.119450 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.119408    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s" podUID="2bd667ca-5896-44dc-a5d0-d1e612da730d" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.76:9004: connect: connection refused"
Sep 11 14:50:13.181961 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.181923    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w"]
Sep 11 14:50:13.185432 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.185402    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-92ca78-5r94w"]
Sep 11 14:50:13.223355 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.223305    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"
Sep 11 14:50:13.242464 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.242435    2569 generic.go:356] "Generic (PLEG): container finished" podID="2bd667ca-5896-44dc-a5d0-d1e612da730d" containerID="95bc85bc1a4642cdf3ac3f9b96a5e6bc8127eec45277ecc1e397b53a6861cf23" exitCode=0
Sep 11 14:50:13.242602 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.242484    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"
Sep 11 14:50:13.242602 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.242542    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s" event={"ID":"2bd667ca-5896-44dc-a5d0-d1e612da730d","Type":"ContainerDied","Data":"95bc85bc1a4642cdf3ac3f9b96a5e6bc8127eec45277ecc1e397b53a6861cf23"}
Sep 11 14:50:13.242733 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.242612    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s" event={"ID":"2bd667ca-5896-44dc-a5d0-d1e612da730d","Type":"ContainerDied","Data":"48fecc6e3140980accc19a50e07b9d053eb4d1fcec5322a7e6f33068f8d37712"}
Sep 11 14:50:13.242733 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.242646    2569 scope.go:117] "RemoveContainer" containerID="95bc85bc1a4642cdf3ac3f9b96a5e6bc8127eec45277ecc1e397b53a6861cf23"
Sep 11 14:50:13.252794 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.252776    2569 scope.go:117] "RemoveContainer" containerID="95bc85bc1a4642cdf3ac3f9b96a5e6bc8127eec45277ecc1e397b53a6861cf23"
Sep 11 14:50:13.253108 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:50:13.253087    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95bc85bc1a4642cdf3ac3f9b96a5e6bc8127eec45277ecc1e397b53a6861cf23\": container with ID starting with 95bc85bc1a4642cdf3ac3f9b96a5e6bc8127eec45277ecc1e397b53a6861cf23 not found: ID does not exist" containerID="95bc85bc1a4642cdf3ac3f9b96a5e6bc8127eec45277ecc1e397b53a6861cf23"
Sep 11 14:50:13.253190 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.253115    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95bc85bc1a4642cdf3ac3f9b96a5e6bc8127eec45277ecc1e397b53a6861cf23"} err="failed to get container status \"95bc85bc1a4642cdf3ac3f9b96a5e6bc8127eec45277ecc1e397b53a6861cf23\": rpc error: code = NotFound desc = could not find container \"95bc85bc1a4642cdf3ac3f9b96a5e6bc8127eec45277ecc1e397b53a6861cf23\": container with ID starting with 95bc85bc1a4642cdf3ac3f9b96a5e6bc8127eec45277ecc1e397b53a6861cf23 not found: ID does not exist"
Sep 11 14:50:13.335913 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.335862    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bd667ca-5896-44dc-a5d0-d1e612da730d-plugins-config-volume\") pod \"2bd667ca-5896-44dc-a5d0-d1e612da730d\" (UID: \"2bd667ca-5896-44dc-a5d0-d1e612da730d\") "
Sep 11 14:50:13.336066 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.335932    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvnjh\" (UniqueName: \"kubernetes.io/projected/2bd667ca-5896-44dc-a5d0-d1e612da730d-kube-api-access-xvnjh\") pod \"2bd667ca-5896-44dc-a5d0-d1e612da730d\" (UID: \"2bd667ca-5896-44dc-a5d0-d1e612da730d\") "
Sep 11 14:50:13.336233 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.336210    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bd667ca-5896-44dc-a5d0-d1e612da730d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2bd667ca-5896-44dc-a5d0-d1e612da730d" (UID: "2bd667ca-5896-44dc-a5d0-d1e612da730d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:50:13.338141 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.338122    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bd667ca-5896-44dc-a5d0-d1e612da730d-kube-api-access-xvnjh" (OuterVolumeSpecName: "kube-api-access-xvnjh") pod "2bd667ca-5896-44dc-a5d0-d1e612da730d" (UID: "2bd667ca-5896-44dc-a5d0-d1e612da730d"). InnerVolumeSpecName "kube-api-access-xvnjh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:50:13.437251 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.437222    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvnjh\" (UniqueName: \"kubernetes.io/projected/2bd667ca-5896-44dc-a5d0-d1e612da730d-kube-api-access-xvnjh\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:13.437251 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.437244    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bd667ca-5896-44dc-a5d0-d1e612da730d-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:13.570000 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.569969    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"]
Sep 11 14:50:13.572464 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:13.572440    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-92ca78-5bd4fff94-w9p4s"]
Sep 11 14:50:14.270187 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:14.270158    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f773df5-8634-4dc9-ac54-e8e0ffe31b37" path="/var/lib/kubelet/pods/0f773df5-8634-4dc9-ac54-e8e0ffe31b37/volumes"
Sep 11 14:50:14.270549 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:14.270476    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bd667ca-5896-44dc-a5d0-d1e612da730d" path="/var/lib/kubelet/pods/2bd667ca-5896-44dc-a5d0-d1e612da730d/volumes"
Sep 11 14:50:16.221113 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:16.221081    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:50:21.149290 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.149254    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7"]
Sep 11 14:50:21.149686 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.149594    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bd667ca-5896-44dc-a5d0-d1e612da730d" containerName="payload-pre-processing"
Sep 11 14:50:21.149686 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.149605    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bd667ca-5896-44dc-a5d0-d1e612da730d" containerName="payload-pre-processing"
Sep 11 14:50:21.149686 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.149615    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy"
Sep 11 14:50:21.149686 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.149620    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy"
Sep 11 14:50:21.149686 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.149629    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy"
Sep 11 14:50:21.149686 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.149634    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy"
Sep 11 14:50:21.149686 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.149643    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f773df5-8634-4dc9-ac54-e8e0ffe31b37" containerName="revoke-keys"
Sep 11 14:50:21.149686 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.149648    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f773df5-8634-4dc9-ac54-e8e0ffe31b37" containerName="revoke-keys"
Sep 11 14:50:21.149980 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.149703    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy"
Sep 11 14:50:21.149980 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.149710    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bd667ca-5896-44dc-a5d0-d1e612da730d" containerName="payload-pre-processing"
Sep 11 14:50:21.149980 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.149717    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fb05110-3b09-4c6c-a9bc-7c7bfb84d459" containerName="istio-proxy"
Sep 11 14:50:21.149980 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.149723    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f773df5-8634-4dc9-ac54-e8e0ffe31b37" containerName="revoke-keys"
Sep 11 14:50:21.154076 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.154057    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7"
Sep 11 14:50:21.158996 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.158977    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:50:21.159092 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.158981    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:50:21.167767 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.167746    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7"]
Sep 11 14:50:21.306654 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.306624    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1e1012-2550-4c46-8c28-a640ab9307a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7\" (UID: \"8a1e1012-2550-4c46-8c28-a640ab9307a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7"
Sep 11 14:50:21.408169 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.408081    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1e1012-2550-4c46-8c28-a640ab9307a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7\" (UID: \"8a1e1012-2550-4c46-8c28-a640ab9307a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7"
Sep 11 14:50:21.408708 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.408686    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1e1012-2550-4c46-8c28-a640ab9307a4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7\" (UID: \"8a1e1012-2550-4c46-8c28-a640ab9307a4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7"
Sep 11 14:50:21.463508 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.463466    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7"
Sep 11 14:50:21.740843 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:21.740811    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7"]
Sep 11 14:50:21.744113 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:50:21.744088    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a1e1012_2550_4c46_8c28_a640ab9307a4.slice/crio-62d2d8641926e89660db20cb2a2d000b51c96f29e00abd5015b979ef97a88795 WatchSource:0}: Error finding container 62d2d8641926e89660db20cb2a2d000b51c96f29e00abd5015b979ef97a88795: Status 404 returned error can't find the container with id 62d2d8641926e89660db20cb2a2d000b51c96f29e00abd5015b979ef97a88795
Sep 11 14:50:22.291021 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:22.290924    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7" event={"ID":"8a1e1012-2550-4c46-8c28-a640ab9307a4","Type":"ContainerStarted","Data":"1c9c65793182c2f67bd77baea6ef2344dba3ea0ac0d2c9eaff47fa3f27a46e90"}
Sep 11 14:50:22.291021 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:22.290996    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7" event={"ID":"8a1e1012-2550-4c46-8c28-a640ab9307a4","Type":"ContainerStarted","Data":"62d2d8641926e89660db20cb2a2d000b51c96f29e00abd5015b979ef97a88795"}
Sep 11 14:50:22.312458 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:22.312415    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7" podStartSLOduration=1.312400617 podStartE2EDuration="1.312400617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:50:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:50:22.310688437 +0000 UTC m=+2118.525274097" watchObservedRunningTime="2026-09-11 14:50:22.312400617 +0000 UTC m=+2118.526986277"
Sep 11 14:50:23.297254 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:23.297212    2569 generic.go:356] "Generic (PLEG): container finished" podID="8a1e1012-2550-4c46-8c28-a640ab9307a4" containerID="1c9c65793182c2f67bd77baea6ef2344dba3ea0ac0d2c9eaff47fa3f27a46e90" exitCode=0
Sep 11 14:50:23.297815 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:23.297303    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7" event={"ID":"8a1e1012-2550-4c46-8c28-a640ab9307a4","Type":"ContainerDied","Data":"1c9c65793182c2f67bd77baea6ef2344dba3ea0ac0d2c9eaff47fa3f27a46e90"}
Sep 11 14:50:24.434424 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:24.434399    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7"
Sep 11 14:50:24.535332 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:24.535303    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1e1012-2550-4c46-8c28-a640ab9307a4-maas-api-service-ca\") pod \"8a1e1012-2550-4c46-8c28-a640ab9307a4\" (UID: \"8a1e1012-2550-4c46-8c28-a640ab9307a4\") "
Sep 11 14:50:24.535626 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:24.535606    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a1e1012-2550-4c46-8c28-a640ab9307a4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8a1e1012-2550-4c46-8c28-a640ab9307a4" (UID: "8a1e1012-2550-4c46-8c28-a640ab9307a4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:50:24.635905 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:24.635820    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a1e1012-2550-4c46-8c28-a640ab9307a4-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:25.308225 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:25.308191    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7"
Sep 11 14:50:25.308389 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:25.308225    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7" event={"ID":"8a1e1012-2550-4c46-8c28-a640ab9307a4","Type":"ContainerDied","Data":"62d2d8641926e89660db20cb2a2d000b51c96f29e00abd5015b979ef97a88795"}
Sep 11 14:50:25.308389 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:25.308264    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="62d2d8641926e89660db20cb2a2d000b51c96f29e00abd5015b979ef97a88795"
Sep 11 14:50:31.918642 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:31.918606    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"]
Sep 11 14:50:31.919156 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:31.918915    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb" podUID="ed53c401-1274-4a61-a11a-71c0b639f1e1" containerName="payload-pre-processing" containerID="cri-o://a314508006e15205e2e0c768cd3bce905682d7e4101f43d3291d4cbfbdd2ea8d" gracePeriod=30
Sep 11 14:50:32.147557 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.147526    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7"]
Sep 11 14:50:32.149764 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.149738    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-8feb68-9tvg7"]
Sep 11 14:50:32.179054 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.179031    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"
Sep 11 14:50:32.270608 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.270573    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a1e1012-2550-4c46-8c28-a640ab9307a4" path="/var/lib/kubelet/pods/8a1e1012-2550-4c46-8c28-a640ab9307a4/volumes"
Sep 11 14:50:32.295757 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.295725    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llchk\" (UniqueName: \"kubernetes.io/projected/ed53c401-1274-4a61-a11a-71c0b639f1e1-kube-api-access-llchk\") pod \"ed53c401-1274-4a61-a11a-71c0b639f1e1\" (UID: \"ed53c401-1274-4a61-a11a-71c0b639f1e1\") "
Sep 11 14:50:32.295914 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.295893    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed53c401-1274-4a61-a11a-71c0b639f1e1-plugins-config-volume\") pod \"ed53c401-1274-4a61-a11a-71c0b639f1e1\" (UID: \"ed53c401-1274-4a61-a11a-71c0b639f1e1\") "
Sep 11 14:50:32.296228 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.296204    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed53c401-1274-4a61-a11a-71c0b639f1e1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ed53c401-1274-4a61-a11a-71c0b639f1e1" (UID: "ed53c401-1274-4a61-a11a-71c0b639f1e1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:50:32.297883 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.297855    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed53c401-1274-4a61-a11a-71c0b639f1e1-kube-api-access-llchk" (OuterVolumeSpecName: "kube-api-access-llchk") pod "ed53c401-1274-4a61-a11a-71c0b639f1e1" (UID: "ed53c401-1274-4a61-a11a-71c0b639f1e1"). InnerVolumeSpecName "kube-api-access-llchk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:50:32.342938 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.342901    2569 generic.go:356] "Generic (PLEG): container finished" podID="ed53c401-1274-4a61-a11a-71c0b639f1e1" containerID="a314508006e15205e2e0c768cd3bce905682d7e4101f43d3291d4cbfbdd2ea8d" exitCode=0
Sep 11 14:50:32.343073 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.342944    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"
Sep 11 14:50:32.343073 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.342971    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb" event={"ID":"ed53c401-1274-4a61-a11a-71c0b639f1e1","Type":"ContainerDied","Data":"a314508006e15205e2e0c768cd3bce905682d7e4101f43d3291d4cbfbdd2ea8d"}
Sep 11 14:50:32.343073 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.343020    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb" event={"ID":"ed53c401-1274-4a61-a11a-71c0b639f1e1","Type":"ContainerDied","Data":"dd0e3446b4762dcf80784220704bb28f9540f587a3eede43df4f23ad149e450e"}
Sep 11 14:50:32.343073 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.343041    2569 scope.go:117] "RemoveContainer" containerID="a314508006e15205e2e0c768cd3bce905682d7e4101f43d3291d4cbfbdd2ea8d"
Sep 11 14:50:32.352290 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.352266    2569 scope.go:117] "RemoveContainer" containerID="a314508006e15205e2e0c768cd3bce905682d7e4101f43d3291d4cbfbdd2ea8d"
Sep 11 14:50:32.352549 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:50:32.352530    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a314508006e15205e2e0c768cd3bce905682d7e4101f43d3291d4cbfbdd2ea8d\": container with ID starting with a314508006e15205e2e0c768cd3bce905682d7e4101f43d3291d4cbfbdd2ea8d not found: ID does not exist" containerID="a314508006e15205e2e0c768cd3bce905682d7e4101f43d3291d4cbfbdd2ea8d"
Sep 11 14:50:32.352616 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.352561    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a314508006e15205e2e0c768cd3bce905682d7e4101f43d3291d4cbfbdd2ea8d"} err="failed to get container status \"a314508006e15205e2e0c768cd3bce905682d7e4101f43d3291d4cbfbdd2ea8d\": rpc error: code = NotFound desc = could not find container \"a314508006e15205e2e0c768cd3bce905682d7e4101f43d3291d4cbfbdd2ea8d\": container with ID starting with a314508006e15205e2e0c768cd3bce905682d7e4101f43d3291d4cbfbdd2ea8d not found: ID does not exist"
Sep 11 14:50:32.371230 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.371206    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"]
Sep 11 14:50:32.374418 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.374397    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-8feb68-79bf4745fd-dkkvb"]
Sep 11 14:50:32.397049 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.397028    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed53c401-1274-4a61-a11a-71c0b639f1e1-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:32.397049 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:32.397048    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llchk\" (UniqueName: \"kubernetes.io/projected/ed53c401-1274-4a61-a11a-71c0b639f1e1-kube-api-access-llchk\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:34.270242 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:34.270210    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed53c401-1274-4a61-a11a-71c0b639f1e1" path="/var/lib/kubelet/pods/ed53c401-1274-4a61-a11a-71c0b639f1e1/volumes"
Sep 11 14:50:34.657183 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:34.657105    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:50:40.295320 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.295284    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6"]
Sep 11 14:50:40.295819 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.295607    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a1e1012-2550-4c46-8c28-a640ab9307a4" containerName="revoke-keys"
Sep 11 14:50:40.295819 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.295617    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a1e1012-2550-4c46-8c28-a640ab9307a4" containerName="revoke-keys"
Sep 11 14:50:40.295819 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.295631    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed53c401-1274-4a61-a11a-71c0b639f1e1" containerName="payload-pre-processing"
Sep 11 14:50:40.295819 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.295637    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed53c401-1274-4a61-a11a-71c0b639f1e1" containerName="payload-pre-processing"
Sep 11 14:50:40.295819 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.295692    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed53c401-1274-4a61-a11a-71c0b639f1e1" containerName="payload-pre-processing"
Sep 11 14:50:40.295819 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.295702    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a1e1012-2550-4c46-8c28-a640ab9307a4" containerName="revoke-keys"
Sep 11 14:50:40.298551 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.298534    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6"
Sep 11 14:50:40.301206 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.301172    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:50:40.301329 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.301310    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6975v\""
Sep 11 14:50:40.310721 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.310694    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6"]
Sep 11 14:50:40.363950 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.363915    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e94f7d-74c3-4404-a1ed-afefca49b0f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6\" (UID: \"66e94f7d-74c3-4404-a1ed-afefca49b0f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6"
Sep 11 14:50:40.464705 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.464671    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e94f7d-74c3-4404-a1ed-afefca49b0f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6\" (UID: \"66e94f7d-74c3-4404-a1ed-afefca49b0f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6"
Sep 11 14:50:40.465307 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.465287    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e94f7d-74c3-4404-a1ed-afefca49b0f3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6\" (UID: \"66e94f7d-74c3-4404-a1ed-afefca49b0f3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6"
Sep 11 14:50:40.608406 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.608310    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6"
Sep 11 14:50:40.887082 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:40.887001    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6"]
Sep 11 14:50:40.890429 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:50:40.890386    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e94f7d_74c3_4404_a1ed_afefca49b0f3.slice/crio-255dcbf179dfec26842cddfeeb08b005fd2f970060ececb1bea0bc610a140def WatchSource:0}: Error finding container 255dcbf179dfec26842cddfeeb08b005fd2f970060ececb1bea0bc610a140def: Status 404 returned error can't find the container with id 255dcbf179dfec26842cddfeeb08b005fd2f970060ececb1bea0bc610a140def
Sep 11 14:50:41.392155 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:41.392119    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6" event={"ID":"66e94f7d-74c3-4404-a1ed-afefca49b0f3","Type":"ContainerStarted","Data":"059ff9eab89fe31a798ae804d863f09077034e7414a50c02b27362d98bfbd7a3"}
Sep 11 14:50:41.392526 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:41.392177    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6" event={"ID":"66e94f7d-74c3-4404-a1ed-afefca49b0f3","Type":"ContainerStarted","Data":"255dcbf179dfec26842cddfeeb08b005fd2f970060ececb1bea0bc610a140def"}
Sep 11 14:50:41.408023 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:41.407944    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6" podStartSLOduration=1.407928718 podStartE2EDuration="1.407928718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:50:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:50:41.407376853 +0000 UTC m=+2137.621962515" watchObservedRunningTime="2026-09-11 14:50:41.407928718 +0000 UTC m=+2137.622514379"
Sep 11 14:50:42.398899 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:42.398852    2569 generic.go:356] "Generic (PLEG): container finished" podID="66e94f7d-74c3-4404-a1ed-afefca49b0f3" containerID="059ff9eab89fe31a798ae804d863f09077034e7414a50c02b27362d98bfbd7a3" exitCode=0
Sep 11 14:50:42.399297 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:42.398946    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6" event={"ID":"66e94f7d-74c3-4404-a1ed-afefca49b0f3","Type":"ContainerDied","Data":"059ff9eab89fe31a798ae804d863f09077034e7414a50c02b27362d98bfbd7a3"}
Sep 11 14:50:43.535953 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:43.535920    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6"
Sep 11 14:50:43.590684 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:43.590650    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e94f7d-74c3-4404-a1ed-afefca49b0f3-maas-api-service-ca\") pod \"66e94f7d-74c3-4404-a1ed-afefca49b0f3\" (UID: \"66e94f7d-74c3-4404-a1ed-afefca49b0f3\") "
Sep 11 14:50:43.591083 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:43.591057    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e94f7d-74c3-4404-a1ed-afefca49b0f3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "66e94f7d-74c3-4404-a1ed-afefca49b0f3" (UID: "66e94f7d-74c3-4404-a1ed-afefca49b0f3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:50:43.691972 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:43.691937    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/66e94f7d-74c3-4404-a1ed-afefca49b0f3-maas-api-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:44.410265 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:44.410227    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6"
Sep 11 14:50:44.410449 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:44.410270    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6" event={"ID":"66e94f7d-74c3-4404-a1ed-afefca49b0f3","Type":"ContainerDied","Data":"255dcbf179dfec26842cddfeeb08b005fd2f970060ececb1bea0bc610a140def"}
Sep 11 14:50:44.410449 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:44.410325    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="255dcbf179dfec26842cddfeeb08b005fd2f970060ececb1bea0bc610a140def"
Sep 11 14:50:51.012765 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.012730    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"]
Sep 11 14:50:51.013256 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.012998    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9" podUID="cf70b073-c021-4242-b792-66c59ae369bd" containerName="payload-pre-processing" containerID="cri-o://a4f3490e1b9e073722eaee095de19e1f08bb9f668fe7d31daa98b571fa5a07ae" gracePeriod=30
Sep 11 14:50:51.266689 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.266616    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"
Sep 11 14:50:51.342357 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.342326    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6"]
Sep 11 14:50:51.346411 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.346387    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-977c12-s2xs6"]
Sep 11 14:50:51.353018 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.353000    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xm4hw\" (UniqueName: \"kubernetes.io/projected/cf70b073-c021-4242-b792-66c59ae369bd-kube-api-access-xm4hw\") pod \"cf70b073-c021-4242-b792-66c59ae369bd\" (UID: \"cf70b073-c021-4242-b792-66c59ae369bd\") "
Sep 11 14:50:51.353104 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.353061    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf70b073-c021-4242-b792-66c59ae369bd-plugins-config-volume\") pod \"cf70b073-c021-4242-b792-66c59ae369bd\" (UID: \"cf70b073-c021-4242-b792-66c59ae369bd\") "
Sep 11 14:50:51.353419 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.353398    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf70b073-c021-4242-b792-66c59ae369bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf70b073-c021-4242-b792-66c59ae369bd" (UID: "cf70b073-c021-4242-b792-66c59ae369bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:50:51.355282 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.355259    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf70b073-c021-4242-b792-66c59ae369bd-kube-api-access-xm4hw" (OuterVolumeSpecName: "kube-api-access-xm4hw") pod "cf70b073-c021-4242-b792-66c59ae369bd" (UID: "cf70b073-c021-4242-b792-66c59ae369bd"). InnerVolumeSpecName "kube-api-access-xm4hw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:50:51.446862 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.446818    2569 generic.go:356] "Generic (PLEG): container finished" podID="cf70b073-c021-4242-b792-66c59ae369bd" containerID="a4f3490e1b9e073722eaee095de19e1f08bb9f668fe7d31daa98b571fa5a07ae" exitCode=0
Sep 11 14:50:51.447042 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.446863    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"
Sep 11 14:50:51.447042 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.446858    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9" event={"ID":"cf70b073-c021-4242-b792-66c59ae369bd","Type":"ContainerDied","Data":"a4f3490e1b9e073722eaee095de19e1f08bb9f668fe7d31daa98b571fa5a07ae"}
Sep 11 14:50:51.447042 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.447012    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9" event={"ID":"cf70b073-c021-4242-b792-66c59ae369bd","Type":"ContainerDied","Data":"1817948023f6e481d6d1d40387db8b75476c1ab6d0a325e433d645ac97075c84"}
Sep 11 14:50:51.447150 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.447042    2569 scope.go:117] "RemoveContainer" containerID="a4f3490e1b9e073722eaee095de19e1f08bb9f668fe7d31daa98b571fa5a07ae"
Sep 11 14:50:51.455465 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.455437    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xm4hw\" (UniqueName: \"kubernetes.io/projected/cf70b073-c021-4242-b792-66c59ae369bd-kube-api-access-xm4hw\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:51.455582 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.455479    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf70b073-c021-4242-b792-66c59ae369bd-plugins-config-volume\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:50:51.457819 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.457795    2569 scope.go:117] "RemoveContainer" containerID="a4f3490e1b9e073722eaee095de19e1f08bb9f668fe7d31daa98b571fa5a07ae"
Sep 11 14:50:51.458216 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:50:51.458169    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4f3490e1b9e073722eaee095de19e1f08bb9f668fe7d31daa98b571fa5a07ae\": container with ID starting with a4f3490e1b9e073722eaee095de19e1f08bb9f668fe7d31daa98b571fa5a07ae not found: ID does not exist" containerID="a4f3490e1b9e073722eaee095de19e1f08bb9f668fe7d31daa98b571fa5a07ae"
Sep 11 14:50:51.458386 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.458214    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4f3490e1b9e073722eaee095de19e1f08bb9f668fe7d31daa98b571fa5a07ae"} err="failed to get container status \"a4f3490e1b9e073722eaee095de19e1f08bb9f668fe7d31daa98b571fa5a07ae\": rpc error: code = NotFound desc = could not find container \"a4f3490e1b9e073722eaee095de19e1f08bb9f668fe7d31daa98b571fa5a07ae\": container with ID starting with a4f3490e1b9e073722eaee095de19e1f08bb9f668fe7d31daa98b571fa5a07ae not found: ID does not exist"
Sep 11 14:50:51.471992 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.471972    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"]
Sep 11 14:50:51.476140 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:51.476121    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-977c12-d7f8f9db6-sx5v9"]
Sep 11 14:50:52.270385 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:52.270349    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66e94f7d-74c3-4404-a1ed-afefca49b0f3" path="/var/lib/kubelet/pods/66e94f7d-74c3-4404-a1ed-afefca49b0f3/volumes"
Sep 11 14:50:52.270762 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:52.270697    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf70b073-c021-4242-b792-66c59ae369bd" path="/var/lib/kubelet/pods/cf70b073-c021-4242-b792-66c59ae369bd/volumes"
Sep 11 14:50:53.831708 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:53.831666    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:50:58.196372 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:58.196296    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"]
Sep 11 14:50:58.196764 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:50:58.196507    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd" podUID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerName="istio-proxy" containerID="cri-o://3ab4130dfe3d366f2c3b926bccf28106bc3563354aeabd4022ad9e2705fd5a64" gracePeriod=30
Sep 11 14:51:02.610433 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:02.610395    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:51:03.441799 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.441774    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:51:03.517414 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.517314    2569 generic.go:356] "Generic (PLEG): container finished" podID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerID="3ab4130dfe3d366f2c3b926bccf28106bc3563354aeabd4022ad9e2705fd5a64" exitCode=0
Sep 11 14:51:03.517414 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.517364    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"
Sep 11 14:51:03.517612 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.517413    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd" event={"ID":"6f91a165-ad35-41cb-966f-431d9d7157f3","Type":"ContainerDied","Data":"3ab4130dfe3d366f2c3b926bccf28106bc3563354aeabd4022ad9e2705fd5a64"}
Sep 11 14:51:03.517612 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.517479    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd" event={"ID":"6f91a165-ad35-41cb-966f-431d9d7157f3","Type":"ContainerDied","Data":"419bfc4d990c452532d397beca683775cf054300f62f47984b345ab01d088ac2"}
Sep 11 14:51:03.517612 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.517514    2569 scope.go:117] "RemoveContainer" containerID="3ab4130dfe3d366f2c3b926bccf28106bc3563354aeabd4022ad9e2705fd5a64"
Sep 11 14:51:03.526655 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.526640    2569 scope.go:117] "RemoveContainer" containerID="6283c58c89420edb9513659f3b5a57c722e795ab7edee86cbf506cb035a7df8b"
Sep 11 14:51:03.534780 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.534746    2569 scope.go:117] "RemoveContainer" containerID="3ab4130dfe3d366f2c3b926bccf28106bc3563354aeabd4022ad9e2705fd5a64"
Sep 11 14:51:03.535081 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:51:03.535060    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ab4130dfe3d366f2c3b926bccf28106bc3563354aeabd4022ad9e2705fd5a64\": container with ID starting with 3ab4130dfe3d366f2c3b926bccf28106bc3563354aeabd4022ad9e2705fd5a64 not found: ID does not exist" containerID="3ab4130dfe3d366f2c3b926bccf28106bc3563354aeabd4022ad9e2705fd5a64"
Sep 11 14:51:03.535175 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.535096    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ab4130dfe3d366f2c3b926bccf28106bc3563354aeabd4022ad9e2705fd5a64"} err="failed to get container status \"3ab4130dfe3d366f2c3b926bccf28106bc3563354aeabd4022ad9e2705fd5a64\": rpc error: code = NotFound desc = could not find container \"3ab4130dfe3d366f2c3b926bccf28106bc3563354aeabd4022ad9e2705fd5a64\": container with ID starting with 3ab4130dfe3d366f2c3b926bccf28106bc3563354aeabd4022ad9e2705fd5a64 not found: ID does not exist"
Sep 11 14:51:03.535175 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.535122    2569 scope.go:117] "RemoveContainer" containerID="6283c58c89420edb9513659f3b5a57c722e795ab7edee86cbf506cb035a7df8b"
Sep 11 14:51:03.535374 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:51:03.535356    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6283c58c89420edb9513659f3b5a57c722e795ab7edee86cbf506cb035a7df8b\": container with ID starting with 6283c58c89420edb9513659f3b5a57c722e795ab7edee86cbf506cb035a7df8b not found: ID does not exist" containerID="6283c58c89420edb9513659f3b5a57c722e795ab7edee86cbf506cb035a7df8b"
Sep 11 14:51:03.535440 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.535381    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6283c58c89420edb9513659f3b5a57c722e795ab7edee86cbf506cb035a7df8b"} err="failed to get container status \"6283c58c89420edb9513659f3b5a57c722e795ab7edee86cbf506cb035a7df8b\": rpc error: code = NotFound desc = could not find container \"6283c58c89420edb9513659f3b5a57c722e795ab7edee86cbf506cb035a7df8b\": container with ID starting with 6283c58c89420edb9513659f3b5a57c722e795ab7edee86cbf506cb035a7df8b not found: ID does not exist"
Sep 11 14:51:03.562936 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.562910    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-credential-socket\") pod \"6f91a165-ad35-41cb-966f-431d9d7157f3\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") "
Sep 11 14:51:03.563085 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.562962    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-envoy\") pod \"6f91a165-ad35-41cb-966f-431d9d7157f3\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") "
Sep 11 14:51:03.563085 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.562989    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f91a165-ad35-41cb-966f-431d9d7157f3-istiod-ca-cert\") pod \"6f91a165-ad35-41cb-966f-431d9d7157f3\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") "
Sep 11 14:51:03.563085 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563006    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-token\") pod \"6f91a165-ad35-41cb-966f-431d9d7157f3\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") "
Sep 11 14:51:03.563085 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563022    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-podinfo\") pod \"6f91a165-ad35-41cb-966f-431d9d7157f3\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") "
Sep 11 14:51:03.563085 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563075    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpbfx\" (UniqueName: \"kubernetes.io/projected/6f91a165-ad35-41cb-966f-431d9d7157f3-kube-api-access-hpbfx\") pod \"6f91a165-ad35-41cb-966f-431d9d7157f3\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") "
Sep 11 14:51:03.563345 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563120    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-data\") pod \"6f91a165-ad35-41cb-966f-431d9d7157f3\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") "
Sep 11 14:51:03.563345 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563154    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-workload-certs\") pod \"6f91a165-ad35-41cb-966f-431d9d7157f3\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") "
Sep 11 14:51:03.563345 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563200    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-workload-socket\") pod \"6f91a165-ad35-41cb-966f-431d9d7157f3\" (UID: \"6f91a165-ad35-41cb-966f-431d9d7157f3\") "
Sep 11 14:51:03.563345 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563269    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f91a165-ad35-41cb-966f-431d9d7157f3" (UID: "6f91a165-ad35-41cb-966f-431d9d7157f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:51:03.563552 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563396    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f91a165-ad35-41cb-966f-431d9d7157f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f91a165-ad35-41cb-966f-431d9d7157f3" (UID: "6f91a165-ad35-41cb-966f-431d9d7157f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:51:03.563552 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563487    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f91a165-ad35-41cb-966f-431d9d7157f3" (UID: "6f91a165-ad35-41cb-966f-431d9d7157f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:51:03.563659 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563547    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f91a165-ad35-41cb-966f-431d9d7157f3" (UID: "6f91a165-ad35-41cb-966f-431d9d7157f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:51:03.563727 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563687    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f91a165-ad35-41cb-966f-431d9d7157f3" (UID: "6f91a165-ad35-41cb-966f-431d9d7157f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:51:03.563727 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563692    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-data\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:51:03.563831 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563726    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-workload-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:51:03.563831 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563746    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-credential-socket\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:51:03.563831 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.563763    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f91a165-ad35-41cb-966f-431d9d7157f3-istiod-ca-cert\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:51:03.565555 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.565526    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f91a165-ad35-41cb-966f-431d9d7157f3" (UID: "6f91a165-ad35-41cb-966f-431d9d7157f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:51:03.565555 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.565546    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f91a165-ad35-41cb-966f-431d9d7157f3-kube-api-access-hpbfx" (OuterVolumeSpecName: "kube-api-access-hpbfx") pod "6f91a165-ad35-41cb-966f-431d9d7157f3" (UID: "6f91a165-ad35-41cb-966f-431d9d7157f3"). InnerVolumeSpecName "kube-api-access-hpbfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:51:03.565726 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.565574    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f91a165-ad35-41cb-966f-431d9d7157f3" (UID: "6f91a165-ad35-41cb-966f-431d9d7157f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:51:03.565785 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.565765    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f91a165-ad35-41cb-966f-431d9d7157f3" (UID: "6f91a165-ad35-41cb-966f-431d9d7157f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 14:51:03.664609 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.664561    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpbfx\" (UniqueName: \"kubernetes.io/projected/6f91a165-ad35-41cb-966f-431d9d7157f3-kube-api-access-hpbfx\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:51:03.664609 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.664610    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-workload-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:51:03.665050 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.664627    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-envoy\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:51:03.665050 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.664640    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-token\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:51:03.665050 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.664653    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f91a165-ad35-41cb-966f-431d9d7157f3-istio-podinfo\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:51:03.845315 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.845261    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"]
Sep 11 14:51:03.849472 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:03.849439    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-977c12-openshift-default-65ff6b6b8-8fvrd"]
Sep 11 14:51:04.274057 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:04.274014    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f91a165-ad35-41cb-966f-431d9d7157f3" path="/var/lib/kubelet/pods/6f91a165-ad35-41cb-966f-431d9d7157f3/volumes"
Sep 11 14:51:04.728141 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:04.728098    2569 scope.go:117] "RemoveContainer" containerID="2b7f50725778c2ad78e5d1d6274e9a0fd1afe5d5cbb81876cec52cadee54f0c9"
Sep 11 14:51:04.736529 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:04.736502    2569 scope.go:117] "RemoveContainer" containerID="4f5268dc4cebaef950eccb04c1866c8f9ff7c5064bc7f6f89adc85f77fa2da48"
Sep 11 14:51:04.744035 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:51:04.744007    2569 scope.go:117] "RemoveContainer" containerID="f43e567367c6fd6b5b23c19b18605509ab337a84b439eb3022379b9310bf1df9"
Sep 11 14:52:04.791622 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:52:04.791588    2569 scope.go:117] "RemoveContainer" containerID="6fd1786e423183b032bf07e2ff1934c22e84255b2f35960c68761d3fb47fd375"
Sep 11 14:52:04.800062 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:52:04.800040    2569 scope.go:117] "RemoveContainer" containerID="6f99b618afe9e43650e83321d222008feec939c96deae08dfe7b3a1e8b3d4e8d"
Sep 11 14:52:23.011760 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:52:23.011726    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:52:46.317246 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:52:46.316926    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:52:54.119343 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:52:54.119309    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:53:01.598105 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:53:01.598069    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:53:08.607031 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:53:08.606997    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:53:22.910864 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:53:22.910829    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:53:30.502454 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:53:30.502407    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:54:58.512357 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:54:58.512320    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:55:04.400856 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:04.400830    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:55:04.406066 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:04.406042    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:55:04.831728 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:04.831696    2569 scope.go:117] "RemoveContainer" containerID="0d1025bdd96d9d137cc4ad55590316d88f5562a5a663a942e8b4fefc569f4796"
Sep 11 14:55:06.404318 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:06.404289    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:55:12.209041 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:12.209000    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:55:36.172699 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.172663    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"]
Sep 11 14:55:36.173309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.173127    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66e94f7d-74c3-4404-a1ed-afefca49b0f3" containerName="revoke-keys"
Sep 11 14:55:36.173309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.173146    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e94f7d-74c3-4404-a1ed-afefca49b0f3" containerName="revoke-keys"
Sep 11 14:55:36.173309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.173160    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerName="istio-proxy"
Sep 11 14:55:36.173309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.173170    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerName="istio-proxy"
Sep 11 14:55:36.173309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.173184    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerName="istio-proxy"
Sep 11 14:55:36.173309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.173192    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerName="istio-proxy"
Sep 11 14:55:36.173309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.173218    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf70b073-c021-4242-b792-66c59ae369bd" containerName="payload-pre-processing"
Sep 11 14:55:36.173309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.173227    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf70b073-c021-4242-b792-66c59ae369bd" containerName="payload-pre-processing"
Sep 11 14:55:36.173309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.173310    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerName="istio-proxy"
Sep 11 14:55:36.173759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.173320    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="66e94f7d-74c3-4404-a1ed-afefca49b0f3" containerName="revoke-keys"
Sep 11 14:55:36.173759 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.173331    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf70b073-c021-4242-b792-66c59ae369bd" containerName="payload-pre-processing"
Sep 11 14:55:36.176341 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.176312    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.178950 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.178921    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-7350e86d-kserve-self-signed-certs\""
Sep 11 14:55:36.190510 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.190485    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"]
Sep 11 14:55:36.261169 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.261138    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-model-cache\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.261278 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.261177    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0878cfb5-2f64-439c-8547-e6448a592037-tls-certs\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.261278 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.261210    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-tmp-dir\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.261278 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.261225    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs49x\" (UniqueName: \"kubernetes.io/projected/0878cfb5-2f64-439c-8547-e6448a592037-kube-api-access-cs49x\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.261413 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.261281    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-home\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.261413 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.261329    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-dshm\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.362688 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.362657    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-home\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.362859 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.362701    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-dshm\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.362859 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.362724    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-model-cache\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.362859 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.362847    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0878cfb5-2f64-439c-8547-e6448a592037-tls-certs\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.363066 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.362924    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-tmp-dir\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.363066 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.362947    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs49x\" (UniqueName: \"kubernetes.io/projected/0878cfb5-2f64-439c-8547-e6448a592037-kube-api-access-cs49x\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.363176 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.363113    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-model-cache\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.363239 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.363185    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-home\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.363292 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.363271    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-tmp-dir\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.365160 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.365139    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-dshm\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.365555 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.365531    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0878cfb5-2f64-439c-8547-e6448a592037-tls-certs\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.371643 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.371620    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs49x\" (UniqueName: \"kubernetes.io/projected/0878cfb5-2f64-439c-8547-e6448a592037-kube-api-access-cs49x\") pod \"e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") " pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.485494 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.485467    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:36.757981 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.757956    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"]
Sep 11 14:55:36.760069 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:55:36.760042    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0878cfb5_2f64_439c_8547_e6448a592037.slice/crio-8f7387f2849942d6e11ae6ed5b1fe6f4c91954fadfb1c3b681c464cd5ed250d9 WatchSource:0}: Error finding container 8f7387f2849942d6e11ae6ed5b1fe6f4c91954fadfb1c3b681c464cd5ed250d9: Status 404 returned error can't find the container with id 8f7387f2849942d6e11ae6ed5b1fe6f4c91954fadfb1c3b681c464cd5ed250d9
Sep 11 14:55:36.781413 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:36.781381    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l" event={"ID":"0878cfb5-2f64-439c-8547-e6448a592037","Type":"ContainerStarted","Data":"8f7387f2849942d6e11ae6ed5b1fe6f4c91954fadfb1c3b681c464cd5ed250d9"}
Sep 11 14:55:37.788194 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:37.788161    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l" event={"ID":"0878cfb5-2f64-439c-8547-e6448a592037","Type":"ContainerStarted","Data":"d01fdd0a62bfcfaafc25be88d1bd46ecc501853fad2321dda5a11ee38a8074d3"}
Sep 11 14:55:37.805758 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:37.805712    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l" podStartSLOduration=1.80569758 podStartE2EDuration="1.80569758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:55:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:55:37.805389482 +0000 UTC m=+2434.019975144" watchObservedRunningTime="2026-09-11 14:55:37.80569758 +0000 UTC m=+2434.020283240"
Sep 11 14:55:38.515252 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:38.515218    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:55:46.486572 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:46.486537    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:46.487037 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:46.486593    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:46.499692 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:46.499664    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:46.842121 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:46.842037    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:55:49.410983 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:55:49.410949    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:56:04.850103 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:04.850068    2569 scope.go:117] "RemoveContainer" containerID="8b01165a0fc4645ce11e3b634e7629d123d652b2e4c0837d1dc2e1c0913cd717"
Sep 11 14:56:13.576838 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:13.576806    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"]
Sep 11 14:56:16.604654 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:16.604618    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:56:26.099096 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:26.099059    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:56:28.595929 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.595894    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l" podUID="0878cfb5-2f64-439c-8547-e6448a592037" containerName="main" containerID="cri-o://d01fdd0a62bfcfaafc25be88d1bd46ecc501853fad2321dda5a11ee38a8074d3" gracePeriod=45
Sep 11 14:56:28.844248 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.844225    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:56:28.870726 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.870652    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-dshm\") pod \"0878cfb5-2f64-439c-8547-e6448a592037\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") "
Sep 11 14:56:28.870726 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.870709    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-tmp-dir\") pod \"0878cfb5-2f64-439c-8547-e6448a592037\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") "
Sep 11 14:56:28.870931 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.870733    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-home\") pod \"0878cfb5-2f64-439c-8547-e6448a592037\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") "
Sep 11 14:56:28.870931 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.870787    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-model-cache\") pod \"0878cfb5-2f64-439c-8547-e6448a592037\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") "
Sep 11 14:56:28.870931 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.870813    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0878cfb5-2f64-439c-8547-e6448a592037-tls-certs\") pod \"0878cfb5-2f64-439c-8547-e6448a592037\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") "
Sep 11 14:56:28.870931 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.870840    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs49x\" (UniqueName: \"kubernetes.io/projected/0878cfb5-2f64-439c-8547-e6448a592037-kube-api-access-cs49x\") pod \"0878cfb5-2f64-439c-8547-e6448a592037\" (UID: \"0878cfb5-2f64-439c-8547-e6448a592037\") "
Sep 11 14:56:28.871158 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.870980    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0878cfb5-2f64-439c-8547-e6448a592037" (UID: "0878cfb5-2f64-439c-8547-e6448a592037"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:56:28.871158 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.871022    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-home" (OuterVolumeSpecName: "home") pod "0878cfb5-2f64-439c-8547-e6448a592037" (UID: "0878cfb5-2f64-439c-8547-e6448a592037"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:56:28.871158 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.871119    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-model-cache" (OuterVolumeSpecName: "model-cache") pod "0878cfb5-2f64-439c-8547-e6448a592037" (UID: "0878cfb5-2f64-439c-8547-e6448a592037"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:56:28.871309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.871238    2569 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-tmp-dir\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:56:28.871309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.871257    2569 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-home\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:56:28.871309 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.871272    2569 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-model-cache\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:56:28.872925 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.872900    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-dshm" (OuterVolumeSpecName: "dshm") pod "0878cfb5-2f64-439c-8547-e6448a592037" (UID: "0878cfb5-2f64-439c-8547-e6448a592037"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 14:56:28.873491 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.873469    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0878cfb5-2f64-439c-8547-e6448a592037-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0878cfb5-2f64-439c-8547-e6448a592037" (UID: "0878cfb5-2f64-439c-8547-e6448a592037"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:56:28.873491 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.873480    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0878cfb5-2f64-439c-8547-e6448a592037-kube-api-access-cs49x" (OuterVolumeSpecName: "kube-api-access-cs49x") pod "0878cfb5-2f64-439c-8547-e6448a592037" (UID: "0878cfb5-2f64-439c-8547-e6448a592037"). InnerVolumeSpecName "kube-api-access-cs49x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:56:28.971685 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.971662    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs49x\" (UniqueName: \"kubernetes.io/projected/0878cfb5-2f64-439c-8547-e6448a592037-kube-api-access-cs49x\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:56:28.971685 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.971683    2569 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0878cfb5-2f64-439c-8547-e6448a592037-dshm\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:56:28.971852 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:28.971694    2569 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0878cfb5-2f64-439c-8547-e6448a592037-tls-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:56:29.033682 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:29.033656    2569 generic.go:356] "Generic (PLEG): container finished" podID="0878cfb5-2f64-439c-8547-e6448a592037" containerID="d01fdd0a62bfcfaafc25be88d1bd46ecc501853fad2321dda5a11ee38a8074d3" exitCode=0
Sep 11 14:56:29.033796 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:29.033702    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"
Sep 11 14:56:29.033796 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:29.033752    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l" event={"ID":"0878cfb5-2f64-439c-8547-e6448a592037","Type":"ContainerDied","Data":"d01fdd0a62bfcfaafc25be88d1bd46ecc501853fad2321dda5a11ee38a8074d3"}
Sep 11 14:56:29.033949 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:29.033804    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l" event={"ID":"0878cfb5-2f64-439c-8547-e6448a592037","Type":"ContainerDied","Data":"8f7387f2849942d6e11ae6ed5b1fe6f4c91954fadfb1c3b681c464cd5ed250d9"}
Sep 11 14:56:29.033949 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:29.033829    2569 scope.go:117] "RemoveContainer" containerID="d01fdd0a62bfcfaafc25be88d1bd46ecc501853fad2321dda5a11ee38a8074d3"
Sep 11 14:56:29.042649 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:29.042631    2569 scope.go:117] "RemoveContainer" containerID="d01fdd0a62bfcfaafc25be88d1bd46ecc501853fad2321dda5a11ee38a8074d3"
Sep 11 14:56:29.043015 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:56:29.042995    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d01fdd0a62bfcfaafc25be88d1bd46ecc501853fad2321dda5a11ee38a8074d3\": container with ID starting with d01fdd0a62bfcfaafc25be88d1bd46ecc501853fad2321dda5a11ee38a8074d3 not found: ID does not exist" containerID="d01fdd0a62bfcfaafc25be88d1bd46ecc501853fad2321dda5a11ee38a8074d3"
Sep 11 14:56:29.043080 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:29.043025    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d01fdd0a62bfcfaafc25be88d1bd46ecc501853fad2321dda5a11ee38a8074d3"} err="failed to get container status \"d01fdd0a62bfcfaafc25be88d1bd46ecc501853fad2321dda5a11ee38a8074d3\": rpc error: code = NotFound desc = could not find container \"d01fdd0a62bfcfaafc25be88d1bd46ecc501853fad2321dda5a11ee38a8074d3\": container with ID starting with d01fdd0a62bfcfaafc25be88d1bd46ecc501853fad2321dda5a11ee38a8074d3 not found: ID does not exist"
Sep 11 14:56:29.054282 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:29.054262    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"]
Sep 11 14:56:29.058341 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:29.058316    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-7350e86d-kserve-fdb5fc6c5-48p5l"]
Sep 11 14:56:30.270318 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:30.270288    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0878cfb5-2f64-439c-8547-e6448a592037" path="/var/lib/kubelet/pods/0878cfb5-2f64-439c-8547-e6448a592037/volumes"
Sep 11 14:56:31.120822 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.120790    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:56:31.296216 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.296186    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"]
Sep 11 14:56:31.296579 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.296487    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0878cfb5-2f64-439c-8547-e6448a592037" containerName="main"
Sep 11 14:56:31.296579 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.296497    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0878cfb5-2f64-439c-8547-e6448a592037" containerName="main"
Sep 11 14:56:31.296579 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.296559    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0878cfb5-2f64-439c-8547-e6448a592037" containerName="main"
Sep 11 14:56:31.296579 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.296567    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f91a165-ad35-41cb-966f-431d9d7157f3" containerName="istio-proxy"
Sep 11 14:56:31.300683 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.300665    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.304240 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.304222    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 14:56:31.304366 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.304305    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 14:56:31.304366 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.304347    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 14:56:31.304482 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.304457    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-c5cfn\""
Sep 11 14:56:31.304537 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.304523    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 14:56:31.314911 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.314836    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"]
Sep 11 14:56:31.391095 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.391027    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-metrics-certs\") pod \"maas-api-7c5d78f8bc-nxqnv\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.391095 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.391071    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-maas-api-tls\") pod \"maas-api-7c5d78f8bc-nxqnv\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.391253 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.391096    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-openshift-service-ca\") pod \"maas-api-7c5d78f8bc-nxqnv\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.391253 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.391147    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v7h5\" (UniqueName: \"kubernetes.io/projected/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-kube-api-access-8v7h5\") pod \"maas-api-7c5d78f8bc-nxqnv\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.492352 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.492324    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-maas-api-tls\") pod \"maas-api-7c5d78f8bc-nxqnv\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.492482 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.492358    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-openshift-service-ca\") pod \"maas-api-7c5d78f8bc-nxqnv\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.492482 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.492383    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v7h5\" (UniqueName: \"kubernetes.io/projected/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-kube-api-access-8v7h5\") pod \"maas-api-7c5d78f8bc-nxqnv\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.492482 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.492429    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-metrics-certs\") pod \"maas-api-7c5d78f8bc-nxqnv\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.493091 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.493024    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-openshift-service-ca\") pod \"maas-api-7c5d78f8bc-nxqnv\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.494744 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.494723    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-maas-api-tls\") pod \"maas-api-7c5d78f8bc-nxqnv\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.494842 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.494778    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-metrics-certs\") pod \"maas-api-7c5d78f8bc-nxqnv\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.501028 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.501008    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v7h5\" (UniqueName: \"kubernetes.io/projected/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-kube-api-access-8v7h5\") pod \"maas-api-7c5d78f8bc-nxqnv\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") " pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.610468 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.610437    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:31.892220 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.892192    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"]
Sep 11 14:56:31.894333 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:56:31.894299    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93e7bbe_d89c_49fd_9bc8_6e755c03bdd5.slice/crio-fe1f5a6f05b328b16be2192cab00f56edd88b512d05dc1b8e0737354df74a3a7 WatchSource:0}: Error finding container fe1f5a6f05b328b16be2192cab00f56edd88b512d05dc1b8e0737354df74a3a7: Status 404 returned error can't find the container with id fe1f5a6f05b328b16be2192cab00f56edd88b512d05dc1b8e0737354df74a3a7
Sep 11 14:56:31.896070 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:31.896046    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 14:56:32.053173 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:32.053137    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv" event={"ID":"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5","Type":"ContainerStarted","Data":"fe1f5a6f05b328b16be2192cab00f56edd88b512d05dc1b8e0737354df74a3a7"}
Sep 11 14:56:35.070456 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:35.070422    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv" event={"ID":"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5","Type":"ContainerStarted","Data":"f3c811d48220c1fc8d8e36aafe85029388c63a1d0aa581ded278afbca5040e67"}
Sep 11 14:56:35.070990 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:35.070548    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:35.097326 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:35.097275    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv" podStartSLOduration=1.6794622700000001 podStartE2EDuration="4.097260393s" totalImagesPullingTime="2.417798123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:56:35.096563442 +0000 UTC m=+2491.311149105" watchObservedRunningTime="2026-09-11 14:56:35.097260393 +0000 UTC m=+2491.311846054"
Sep 11 14:56:38.998396 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:38.998362    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:56:39.017037 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.017012    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"]
Sep 11 14:56:39.017232 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.017210    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv" podUID="f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5" containerName="maas-api" containerID="cri-o://f3c811d48220c1fc8d8e36aafe85029388c63a1d0aa581ded278afbca5040e67" gracePeriod=30
Sep 11 14:56:39.022381 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.022355    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:39.048193 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.048170    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"]
Sep 11 14:56:39.051322 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.051307    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.062455 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.062432    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"]
Sep 11 14:56:39.159333 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.159294    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91970c8f-192e-48ea-9eb5-f7d5402b9436-metrics-certs\") pod \"maas-api-75779b999f-jl2t8\" (UID: \"91970c8f-192e-48ea-9eb5-f7d5402b9436\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.159494 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.159367    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91970c8f-192e-48ea-9eb5-f7d5402b9436-openshift-service-ca\") pod \"maas-api-75779b999f-jl2t8\" (UID: \"91970c8f-192e-48ea-9eb5-f7d5402b9436\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.159494 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.159417    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91970c8f-192e-48ea-9eb5-f7d5402b9436-maas-api-tls\") pod \"maas-api-75779b999f-jl2t8\" (UID: \"91970c8f-192e-48ea-9eb5-f7d5402b9436\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.159494 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.159444    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpqkd\" (UniqueName: \"kubernetes.io/projected/91970c8f-192e-48ea-9eb5-f7d5402b9436-kube-api-access-kpqkd\") pod \"maas-api-75779b999f-jl2t8\" (UID: \"91970c8f-192e-48ea-9eb5-f7d5402b9436\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.260261 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.260203    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91970c8f-192e-48ea-9eb5-f7d5402b9436-openshift-service-ca\") pod \"maas-api-75779b999f-jl2t8\" (UID: \"91970c8f-192e-48ea-9eb5-f7d5402b9436\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.260261 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.260251    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91970c8f-192e-48ea-9eb5-f7d5402b9436-maas-api-tls\") pod \"maas-api-75779b999f-jl2t8\" (UID: \"91970c8f-192e-48ea-9eb5-f7d5402b9436\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.260422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.260273    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpqkd\" (UniqueName: \"kubernetes.io/projected/91970c8f-192e-48ea-9eb5-f7d5402b9436-kube-api-access-kpqkd\") pod \"maas-api-75779b999f-jl2t8\" (UID: \"91970c8f-192e-48ea-9eb5-f7d5402b9436\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.260422 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.260322    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91970c8f-192e-48ea-9eb5-f7d5402b9436-metrics-certs\") pod \"maas-api-75779b999f-jl2t8\" (UID: \"91970c8f-192e-48ea-9eb5-f7d5402b9436\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.260964 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.260897    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/91970c8f-192e-48ea-9eb5-f7d5402b9436-openshift-service-ca\") pod \"maas-api-75779b999f-jl2t8\" (UID: \"91970c8f-192e-48ea-9eb5-f7d5402b9436\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.261181 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.261132    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:39.262708 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.262687    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/91970c8f-192e-48ea-9eb5-f7d5402b9436-maas-api-tls\") pod \"maas-api-75779b999f-jl2t8\" (UID: \"91970c8f-192e-48ea-9eb5-f7d5402b9436\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.262814 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.262721    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/91970c8f-192e-48ea-9eb5-f7d5402b9436-metrics-certs\") pod \"maas-api-75779b999f-jl2t8\" (UID: \"91970c8f-192e-48ea-9eb5-f7d5402b9436\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.268164 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.268146    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpqkd\" (UniqueName: \"kubernetes.io/projected/91970c8f-192e-48ea-9eb5-f7d5402b9436-kube-api-access-kpqkd\") pod \"maas-api-75779b999f-jl2t8\" (UID: \"91970c8f-192e-48ea-9eb5-f7d5402b9436\") " pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.361526 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.361502    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8v7h5\" (UniqueName: \"kubernetes.io/projected/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-kube-api-access-8v7h5\") pod \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") "
Sep 11 14:56:39.361673 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.361535    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-openshift-service-ca\") pod \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") "
Sep 11 14:56:39.361673 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.361582    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-maas-api-tls\") pod \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") "
Sep 11 14:56:39.361673 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.361602    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-metrics-certs\") pod \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\" (UID: \"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5\") "
Sep 11 14:56:39.361965 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.361939    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5" (UID: "f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 14:56:39.363831 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.363805    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5" (UID: "f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:56:39.363945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.363860    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-kube-api-access-8v7h5" (OuterVolumeSpecName: "kube-api-access-8v7h5") pod "f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5" (UID: "f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5"). InnerVolumeSpecName "kube-api-access-8v7h5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 14:56:39.363945 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.363864    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5" (UID: "f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 14:56:39.411699 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.411676    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:39.462486 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.462421    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-maas-api-tls\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:56:39.462486 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.462452    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-metrics-certs\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:56:39.462486 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.462466    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8v7h5\" (UniqueName: \"kubernetes.io/projected/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-kube-api-access-8v7h5\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:56:39.462486 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.462481    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5-openshift-service-ca\") on node \"ip-10-0-137-70.ec2.internal\" DevicePath \"\""
Sep 11 14:56:39.685314 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:39.685284    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"]
Sep 11 14:56:39.688792 ip-10-0-137-70 kubenswrapper[2569]: W0911 14:56:39.688759    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91970c8f_192e_48ea_9eb5_f7d5402b9436.slice/crio-6595d0f9928fdaed1a76bff93008ac875c59ae38f98c920072feaa0ea02e59dc WatchSource:0}: Error finding container 6595d0f9928fdaed1a76bff93008ac875c59ae38f98c920072feaa0ea02e59dc: Status 404 returned error can't find the container with id 6595d0f9928fdaed1a76bff93008ac875c59ae38f98c920072feaa0ea02e59dc
Sep 11 14:56:40.097944 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:40.097910    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8" event={"ID":"91970c8f-192e-48ea-9eb5-f7d5402b9436","Type":"ContainerStarted","Data":"6595d0f9928fdaed1a76bff93008ac875c59ae38f98c920072feaa0ea02e59dc"}
Sep 11 14:56:40.099277 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:40.099247    2569 generic.go:356] "Generic (PLEG): container finished" podID="f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5" containerID="f3c811d48220c1fc8d8e36aafe85029388c63a1d0aa581ded278afbca5040e67" exitCode=0
Sep 11 14:56:40.099412 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:40.099286    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv" event={"ID":"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5","Type":"ContainerDied","Data":"f3c811d48220c1fc8d8e36aafe85029388c63a1d0aa581ded278afbca5040e67"}
Sep 11 14:56:40.099412 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:40.099302    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"
Sep 11 14:56:40.099412 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:40.099340    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv" event={"ID":"f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5","Type":"ContainerDied","Data":"fe1f5a6f05b328b16be2192cab00f56edd88b512d05dc1b8e0737354df74a3a7"}
Sep 11 14:56:40.099412 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:40.099362    2569 scope.go:117] "RemoveContainer" containerID="f3c811d48220c1fc8d8e36aafe85029388c63a1d0aa581ded278afbca5040e67"
Sep 11 14:56:40.108155 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:40.108138    2569 scope.go:117] "RemoveContainer" containerID="f3c811d48220c1fc8d8e36aafe85029388c63a1d0aa581ded278afbca5040e67"
Sep 11 14:56:40.108407 ip-10-0-137-70 kubenswrapper[2569]: E0911 14:56:40.108388    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3c811d48220c1fc8d8e36aafe85029388c63a1d0aa581ded278afbca5040e67\": container with ID starting with f3c811d48220c1fc8d8e36aafe85029388c63a1d0aa581ded278afbca5040e67 not found: ID does not exist" containerID="f3c811d48220c1fc8d8e36aafe85029388c63a1d0aa581ded278afbca5040e67"
Sep 11 14:56:40.108475 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:40.108417    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3c811d48220c1fc8d8e36aafe85029388c63a1d0aa581ded278afbca5040e67"} err="failed to get container status \"f3c811d48220c1fc8d8e36aafe85029388c63a1d0aa581ded278afbca5040e67\": rpc error: code = NotFound desc = could not find container \"f3c811d48220c1fc8d8e36aafe85029388c63a1d0aa581ded278afbca5040e67\": container with ID starting with f3c811d48220c1fc8d8e36aafe85029388c63a1d0aa581ded278afbca5040e67 not found: ID does not exist"
Sep 11 14:56:40.120288 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:40.120267    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"]
Sep 11 14:56:40.124200 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:40.124169    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7c5d78f8bc-nxqnv"]
Sep 11 14:56:40.269860 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:40.269822    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5" path="/var/lib/kubelet/pods/f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5/volumes"
Sep 11 14:56:41.106787 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:41.106749    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8" event={"ID":"91970c8f-192e-48ea-9eb5-f7d5402b9436","Type":"ContainerStarted","Data":"8f6fbf06eebc4e0976d2f87d10bbb2ef51eb05c335b8f1660cfd5c11426c1a69"}
Sep 11 14:56:41.107189 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:41.106866    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:41.129994 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:41.129951    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8" podStartSLOduration=1.6102700049999998 podStartE2EDuration="2.129936981s" totalImagesPullingTime="519.666976ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 14:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:56:41.128160478 +0000 UTC m=+2497.342746139" watchObservedRunningTime="2026-09-11 14:56:41.129936981 +0000 UTC m=+2497.344522642"
Sep 11 14:56:46.089380 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:46.089342    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:56:47.116719 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:47.116677    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-75779b999f-jl2t8"
Sep 11 14:56:51.625411 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:51.625379    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:56:58.530989 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:56:58.530907    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-rwwjc"]
Sep 11 14:57:04.871152 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:04.871119    2569 scope.go:117] "RemoveContainer" containerID="1c9c65793182c2f67bd77baea6ef2344dba3ea0ac0d2c9eaff47fa3f27a46e90"
Sep 11 14:57:04.879437 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:04.879419    2569 scope.go:117] "RemoveContainer" containerID="059ff9eab89fe31a798ae804d863f09077034e7414a50c02b27362d98bfbd7a3"
Sep 11 14:57:06.913339 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:06.913305    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-74rct_8b6e945d-f7a1-4d1b-854d-638c1c869247/manager/0.log"
Sep 11 14:57:07.311696 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:07.311669    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-96hn4_a6076f68-36d5-4740-8080-1f960cd009f1/manager/0.log"
Sep 11 14:57:07.577730 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:07.577651    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7f488b8-dcs9x_f2965a64-11cf-48ce-8a2c-1bb8258dcfda/copy-manifests/0.log"
Sep 11 14:57:07.606362 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:07.606338    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7f488b8-dcs9x_f2965a64-11cf-48ce-8a2c-1bb8258dcfda/manager/0.log"
Sep 11 14:57:08.217183 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:08.217152    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-75779b999f-jl2t8_91970c8f-192e-48ea-9eb5-f7d5402b9436/maas-api/0.log"
Sep 11 14:57:08.333672 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:08.333650    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818965-l87wm_7ef16e15-61b9-4c49-becc-6dd37be091d9/cleanup/0.log"
Sep 11 14:57:09.492393 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:09.492356    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-4j5sc_0798736c-4466-4e22-8ae7-ae2b4a2cf168/manager/0.log"
Sep 11 14:57:09.598137 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:09.598110    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-b585l_44d6cade-a717-48fb-b297-de2a4ee0249b/kuadrant-console-plugin/0.log"
Sep 11 14:57:09.851108 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:09.851024    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-rwwjc_d90ffe1a-711b-46d6-88a9-60fff0ab4432/limitador/0.log"
Sep 11 14:57:09.982594 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:09.982560    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-w8svv_92a82021-ea31-41f5-b980-cb58edeaeaeb/manager/0.log"
Sep 11 14:57:10.340981 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:10.340929    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk_6163db2b-ebad-4477-bf64-5fd2e363f0ab/istio-proxy/0.log"
Sep 11 14:57:10.807128 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:10.807093    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4p9dz_e9b66d6c-5f70-4d95-83b4-dea81610cae9/istio-proxy/1.log"
Sep 11 14:57:12.104077 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:12.104048    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-cgsxf_1afef77b-c976-4a14-973d-2f8a9d2f02c2/main/0.log"
Sep 11 14:57:21.026327 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:21.026293    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r5927_e9b3cebd-137c-46da-927d-157e75ea0e2c/global-pull-secret-syncer/0.log"
Sep 11 14:57:21.189446 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:21.189403    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vl9mq_01118f14-e151-4c1b-b875-28625a864d8e/konnectivity-agent/0.log"
Sep 11 14:57:21.241584 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:21.241537    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-70.ec2.internal_e1cf52d6cbbac365bbe6daf585bcf65c/haproxy/0.log"
Sep 11 14:57:25.817679 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:25.817633    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-4j5sc_0798736c-4466-4e22-8ae7-ae2b4a2cf168/manager/0.log"
Sep 11 14:57:25.842801 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:25.842779    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-b585l_44d6cade-a717-48fb-b297-de2a4ee0249b/kuadrant-console-plugin/0.log"
Sep 11 14:57:25.937947 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:25.937925    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-rwwjc_d90ffe1a-711b-46d6-88a9-60fff0ab4432/limitador/0.log"
Sep 11 14:57:26.019544 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:26.019519    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-w8svv_92a82021-ea31-41f5-b980-cb58edeaeaeb/manager/0.log"
Sep 11 14:57:27.838197 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:27.838171    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-phwxt_4af6c1c4-a7dc-4cd7-b5ff-fde48c0b9990/cluster-monitoring-operator/0.log"
Sep 11 14:57:27.955985 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:27.955958    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d7974ff87-r4ds8_dbebf99e-97d6-47d1-acb1-af02e92b015b/metrics-server/0.log"
Sep 11 14:57:28.286221 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:28.286192    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m2d49_570b9b41-d435-45eb-b63f-a26da87357c4/node-exporter/0.log"
Sep 11 14:57:28.317562 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:28.317540    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m2d49_570b9b41-d435-45eb-b63f-a26da87357c4/kube-rbac-proxy/0.log"
Sep 11 14:57:28.346540 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:28.346518    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m2d49_570b9b41-d435-45eb-b63f-a26da87357c4/init-textfile/0.log"
Sep 11 14:57:31.032894 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.032854    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"]
Sep 11 14:57:31.033291 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.033176    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5" containerName="maas-api"
Sep 11 14:57:31.033291 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.033188    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5" containerName="maas-api"
Sep 11 14:57:31.033291 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.033256    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f93e7bbe-d89c-49fd-9bc8-6e755c03bdd5" containerName="maas-api"
Sep 11 14:57:31.036471 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.036444    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.038661 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.038640    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4bt5c\"/\"openshift-service-ca.crt\""
Sep 11 14:57:31.038807 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.038643    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4bt5c\"/\"default-dockercfg-2wjmk\""
Sep 11 14:57:31.039504 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.039487    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4bt5c\"/\"kube-root-ca.crt\""
Sep 11 14:57:31.043771 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.043752    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"]
Sep 11 14:57:31.168193 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.168168    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12cde9cc-2472-46c9-a61d-60dc1897edd0-sys\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.168193 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.168193    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12cde9cc-2472-46c9-a61d-60dc1897edd0-podres\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.168348 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.168225    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12cde9cc-2472-46c9-a61d-60dc1897edd0-proc\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.168348 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.168288    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12cde9cc-2472-46c9-a61d-60dc1897edd0-lib-modules\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.168348 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.168336    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7qz9\" (UniqueName: \"kubernetes.io/projected/12cde9cc-2472-46c9-a61d-60dc1897edd0-kube-api-access-t7qz9\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.170838 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.170817    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/1.log"
Sep 11 14:57:31.179771 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.179735    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-g2trc_4c8baef3-30b3-4df3-bb34-fc6a997308b6/console-operator/2.log"
Sep 11 14:57:31.269145 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.269119    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7qz9\" (UniqueName: \"kubernetes.io/projected/12cde9cc-2472-46c9-a61d-60dc1897edd0-kube-api-access-t7qz9\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.269258 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.269152    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12cde9cc-2472-46c9-a61d-60dc1897edd0-sys\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.269258 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.269168    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12cde9cc-2472-46c9-a61d-60dc1897edd0-podres\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.269258 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.269200    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12cde9cc-2472-46c9-a61d-60dc1897edd0-proc\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.269258 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.269228    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12cde9cc-2472-46c9-a61d-60dc1897edd0-lib-modules\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.269419 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.269262    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12cde9cc-2472-46c9-a61d-60dc1897edd0-sys\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.269419 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.269322    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/12cde9cc-2472-46c9-a61d-60dc1897edd0-podres\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.269419 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.269339    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/12cde9cc-2472-46c9-a61d-60dc1897edd0-proc\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.269419 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.269342    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12cde9cc-2472-46c9-a61d-60dc1897edd0-lib-modules\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.277943 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.277925    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7qz9\" (UniqueName: \"kubernetes.io/projected/12cde9cc-2472-46c9-a61d-60dc1897edd0-kube-api-access-t7qz9\") pod \"perf-node-gather-daemonset-jblhg\" (UID: \"12cde9cc-2472-46c9-a61d-60dc1897edd0\") " pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.346714 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.346653    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:31.623380 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:31.623352    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"]
Sep 11 14:57:32.342455 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:32.342423    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg" event={"ID":"12cde9cc-2472-46c9-a61d-60dc1897edd0","Type":"ContainerStarted","Data":"ff9d1cd6d07bdc4f2685466268be77e0dd2b01926dbea68d57e3c907c31b301d"}
Sep 11 14:57:32.342809 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:32.342471    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg" event={"ID":"12cde9cc-2472-46c9-a61d-60dc1897edd0","Type":"ContainerStarted","Data":"e39bcd86cef4145183ef72f88fece44d91c09a298e599821fb33b88c194293e3"}
Sep 11 14:57:32.342809 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:32.342553    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:32.364109 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:32.364065    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg" podStartSLOduration=1.364050838 podStartE2EDuration="1.364050838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 14:57:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 14:57:32.362064381 +0000 UTC m=+2548.576650042" watchObservedRunningTime="2026-09-11 14:57:32.364050838 +0000 UTC m=+2548.578636498"
Sep 11 14:57:33.598920 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:33.598868    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4kbd4_4e161a3f-4c64-4241-b8a7-455c2d3ca46f/dns/0.log"
Sep 11 14:57:33.623107 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:33.623084    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4kbd4_4e161a3f-4c64-4241-b8a7-455c2d3ca46f/kube-rbac-proxy/0.log"
Sep 11 14:57:33.770982 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:33.770953    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fxxs7_6caa6d55-9fb4-4249-af2b-3c08a3d7a220/dns-node-resolver/0.log"
Sep 11 14:57:34.486675 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:34.486649    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9xsgk_af819a26-a7ea-4678-a737-c6c983dab0ed/node-ca/0.log"
Sep 11 14:57:35.576944 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:35.576910    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk_6163db2b-ebad-4477-bf64-5fd2e363f0ab/istio-proxy/0.log"
Sep 11 14:57:36.370220 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:36.370194    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4p9dz_e9b66d6c-5f70-4d95-83b4-dea81610cae9/istio-proxy/0.log"
Sep 11 14:57:36.384806 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:36.384775    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4p9dz_e9b66d6c-5f70-4d95-83b4-dea81610cae9/istio-proxy/1.log"
Sep 11 14:57:37.573775 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:37.573740    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4xxzr_6ffb1bf5-08c6-4fa3-8379-ad8ba9ff74cb/serve-healthcheck-canary/0.log"
Sep 11 14:57:38.295213 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:38.295186    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dppg6_363387d2-5943-4a23-b2e1-b6fc3e298981/kube-rbac-proxy/0.log"
Sep 11 14:57:38.354646 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:38.354611    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dppg6_363387d2-5943-4a23-b2e1-b6fc3e298981/exporter/0.log"
Sep 11 14:57:38.357976 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:38.357957    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4bt5c/perf-node-gather-daemonset-jblhg"
Sep 11 14:57:38.398694 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:38.398671    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-dppg6_363387d2-5943-4a23-b2e1-b6fc3e298981/extractor/0.log"
Sep 11 14:57:41.757819 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:41.757789    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk_6163db2b-ebad-4477-bf64-5fd2e363f0ab/istio-proxy/0.log"
Sep 11 14:57:41.798398 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:41.798369    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-74rct_8b6e945d-f7a1-4d1b-854d-638c1c869247/manager/0.log"
Sep 11 14:57:42.632448 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:42.632420    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-96hn4_a6076f68-36d5-4740-8080-1f960cd009f1/manager/0.log"
Sep 11 14:57:42.659136 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:42.659104    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4p9dz_e9b66d6c-5f70-4d95-83b4-dea81610cae9/istio-proxy/0.log"
Sep 11 14:57:42.673114 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:42.673090    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4p9dz_e9b66d6c-5f70-4d95-83b4-dea81610cae9/istio-proxy/1.log"
Sep 11 14:57:42.915307 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:42.915220    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7f488b8-dcs9x_f2965a64-11cf-48ce-8a2c-1bb8258dcfda/manager/0.log"
Sep 11 14:57:42.946797 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:42.946772    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7f488b8-dcs9x_f2965a64-11cf-48ce-8a2c-1bb8258dcfda/copy-manifests/0.log"
Sep 11 14:57:44.242401 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:44.242371    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-55cb89464b-nqlbz_16cf3c62-8b69-42ea-8847-9903d912b908/manager/0.log"
Sep 11 14:57:44.265041 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:44.265019    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799c8zxbk_6163db2b-ebad-4477-bf64-5fd2e363f0ab/istio-proxy/0.log"
Sep 11 14:57:45.036378 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:45.036348    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4p9dz_e9b66d6c-5f70-4d95-83b4-dea81610cae9/istio-proxy/0.log"
Sep 11 14:57:45.051821 ip-10-0-137-70 kubenswrapper[2569]: I0911 14:57:45.051775    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-4p9dz_e9b66d6c-5f70-4d95-83b4-dea81610cae9/istio-proxy/1.log"