Sep 11 12:55:30.389040 ip-10-0-142-110 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 12:55:30.816355 ip-10-0-142-110 kubenswrapper[2547]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:55:30.816355 ip-10-0-142-110 kubenswrapper[2547]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 12:55:30.816355 ip-10-0-142-110 kubenswrapper[2547]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:55:30.816355 ip-10-0-142-110 kubenswrapper[2547]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 12:55:30.816355 ip-10-0-142-110 kubenswrapper[2547]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 12:55:30.817312 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.817228    2547 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 12:55:30.821471 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821454    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:55:30.821471 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821470    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821473    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821479    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821483    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821486    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821491    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821494    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821497    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821500    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821503    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821505    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821509    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821513    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821516    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821519    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821522    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821525    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821528    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821531    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:55:30.821537 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821533    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821536    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821539    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821542    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821545    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821549    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821554    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821557    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821560    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821563    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821566    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821568    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821571    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821574    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821577    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821579    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821582    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821584    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821593    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821596    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:55:30.822050 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821600    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821602    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821605    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821607    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821610    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821612    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821615    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821617    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821620    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821623    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821625    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821627    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821630    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821632    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821636    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821639    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821642    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821644    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821647    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821650    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:55:30.822545 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821652    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821655    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821658    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821661    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821663    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821666    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821668    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821671    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821673    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821676    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821678    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821686    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821689    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821691    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821694    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821697    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821699    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821701    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821704    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:55:30.823053 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821707    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821710    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821726    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821729    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821732    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821734    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821738    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821741    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821744    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821747    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821750    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821752    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821755    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821758    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821761    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821764    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821767    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821770    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821773    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:55:30.823529 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.821775    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:55:30.824284 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824272    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:55:30.824284 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824284    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824288    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824291    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824294    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824301    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824305    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824308    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824311    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824314    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824317    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824319    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824322    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824325    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824327    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824330    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824333    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824335    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824338    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824340    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824343    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:55:30.824342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824346    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824348    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824352    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824355    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824357    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824360    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824364    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824369    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824372    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824375    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824378    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824381    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824383    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824386    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824389    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824391    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824394    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824397    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824399    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:55:30.824898 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824402    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824404    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824407    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824409    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824412    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824414    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824417    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824419    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824422    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824424    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824426    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824429    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824431    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824434    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824436    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824441    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824444    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824446    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824449    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824452    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:55:30.825383 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824455    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824458    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824460    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824463    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824465    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824468    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824470    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824473    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824475    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824478    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824480    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824483    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824486    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824489    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824491    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824494    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824496    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824499    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824501    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:55:30.825900 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824504    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824506    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824509    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824511    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824513    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824516    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824518    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824521    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824524    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824527    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824529    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824532    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824535    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824539    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824542    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824544    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824547    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824549    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824552    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.824554    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:55:30.826367 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825658    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825666    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825669    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825673    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825677    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825680    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825683    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825686    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825689    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825693    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825696    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825699    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825702    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825705    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825707    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825710    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825725    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825728    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825730    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:55:30.826867 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825733    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825736    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825739    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825742    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825744    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825747    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825750    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825753    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825755    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825758    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825760    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825763    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825765    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825768    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825770    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825773    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825775    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825779    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825783    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825786    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:55:30.827412 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825788    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825791    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825794    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825797    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825800    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825802    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825805    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825807    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825810    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825812    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825815    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825817    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825820    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825823    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825825    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825828    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825830    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825833    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825835    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825838    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:55:30.827914 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825840    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825843    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825845    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825847    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825850    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825852    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825855    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825858    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825860    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825863    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825865    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825873    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825876    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825880    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825884    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825887    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825889    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825893    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825895    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825898    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:55:30.828402 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825900    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825903    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825906    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825908    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825911    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825914    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825917    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825919    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825922    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825925    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825927    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825930    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825932    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825935    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825938    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825940    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825942    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825945    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825948    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.825950    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:55:30.828920 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826010    2547 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826047    2547 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826055    2547 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826060    2547 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826071    2547 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826074    2547 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826079    2547 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826083    2547 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826086    2547 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826089    2547 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826093    2547 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826096    2547 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826099    2547 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826102    2547 flags.go:64] FLAG: --cgroup-root=""
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826105    2547 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826108    2547 flags.go:64] FLAG: --client-ca-file=""
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826110    2547 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826114    2547 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826121    2547 flags.go:64] FLAG: --cluster-domain=""
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826123    2547 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826127    2547 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826130    2547 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826133    2547 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826137    2547 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 12:55:30.829416 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826140    2547 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826144    2547 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826147    2547 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826150    2547 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826153    2547 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826155    2547 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826159    2547 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826162    2547 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826166    2547 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826169    2547 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826172    2547 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826175    2547 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826178    2547 flags.go:64] FLAG: --enable-server="true"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826186    2547 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826193    2547 flags.go:64] FLAG: --event-burst="100"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826196    2547 flags.go:64] FLAG: --event-qps="50"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826199    2547 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826202    2547 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826205    2547 flags.go:64] FLAG: --eviction-hard=""
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826208    2547 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826211    2547 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826214    2547 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826217    2547 flags.go:64] FLAG: --eviction-soft=""
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826220    2547 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826223    2547 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 12:55:30.830027 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826226    2547 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826229    2547 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826232    2547 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826235    2547 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826238    2547 flags.go:64] FLAG: --feature-gates=""
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826245    2547 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826248    2547 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826251    2547 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826254    2547 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826257    2547 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826260    2547 flags.go:64] FLAG: --help="false"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826263    2547 flags.go:64] FLAG: --hostname-override="ip-10-0-142-110.ec2.internal"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826266    2547 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826269    2547 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826272    2547 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826275    2547 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826278    2547 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826281    2547 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826284    2547 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826287    2547 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826290    2547 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826294    2547 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826297    2547 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826300    2547 flags.go:64] FLAG: --kube-reserved=""
Sep 11 12:55:30.830682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826303    2547 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826305    2547 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826308    2547 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826311    2547 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826314    2547 flags.go:64] FLAG: --lock-file=""
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826317    2547 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826319    2547 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826322    2547 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826327    2547 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826330    2547 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826334    2547 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826337    2547 flags.go:64] FLAG: --logging-format="text"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826340    2547 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826343    2547 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826346    2547 flags.go:64] FLAG: --manifest-url=""
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826349    2547 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826353    2547 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826356    2547 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826361    2547 flags.go:64] FLAG: --max-pods="110"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826364    2547 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826367    2547 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826369    2547 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826373    2547 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826376    2547 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826379    2547 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 12:55:30.831303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826382    2547 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826389    2547 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826392    2547 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826395    2547 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826398    2547 flags.go:64] FLAG: --pod-cidr=""
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826401    2547 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826407    2547 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826409    2547 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826412    2547 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826415    2547 flags.go:64] FLAG: --port="10250"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826420    2547 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826423    2547 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0de688a6d1ae23537"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826426    2547 flags.go:64] FLAG: --qos-reserved=""
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826429    2547 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826432    2547 flags.go:64] FLAG: --register-node="true"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826435    2547 flags.go:64] FLAG: --register-with-taints=""
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826440    2547 flags.go:64] FLAG: --registry-burst="10"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826443    2547 flags.go:64] FLAG: --registry-qps="5"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826446    2547 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826449    2547 flags.go:64] FLAG: --reserved-memory=""
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826453    2547 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826456    2547 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826459    2547 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826462    2547 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826465    2547 flags.go:64] FLAG: --runonce="false"
Sep 11 12:55:30.831944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826468    2547 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826471    2547 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826474    2547 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826477    2547 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826480    2547 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826483    2547 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826486    2547 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826489    2547 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826492    2547 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826495    2547 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826498    2547 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826501    2547 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826504    2547 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826508    2547 flags.go:64] FLAG: --system-cgroups=""
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826510    2547 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826516    2547 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826519    2547 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826523    2547 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826536    2547 flags.go:64] FLAG: --tls-min-version=""
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826539    2547 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826541    2547 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826544    2547 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826549    2547 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826552    2547 flags.go:64] FLAG: --v="2"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826560    2547 flags.go:64] FLAG: --version="false"
Sep 11 12:55:30.832557 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826564    2547 flags.go:64] FLAG: --vmodule=""
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826568    2547 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.826571    2547 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826689    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826693    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826696    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826699    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826702    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826704    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826707    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826710    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826726    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826729    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826732    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826735    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826738    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826740    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826743    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826746    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:55:30.833199 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826748    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826751    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826754    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826759    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826762    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826767    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826770    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826772    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826775    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826778    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826782    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826785    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826788    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826790    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826793    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826796    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826798    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826801    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826804    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826806    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:55:30.833672 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826809    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826812    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826814    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826818    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826822    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826825    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826828    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826831    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826833    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826836    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826839    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826842    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826845    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826847    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826850    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826853    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826856    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826861    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826865    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:55:30.834258 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826867    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826871    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826874    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826878    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826881    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826884    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826886    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826889    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826892    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826895    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826897    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826900    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826903    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826906    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826908    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826911    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826914    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826916    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826919    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826922    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:55:30.834748 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826924    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826927    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826929    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826932    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826935    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826937    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826940    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826942    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826945    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826948    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826952    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826961    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826964    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826967    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826969    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826974    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826977    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826979    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826982    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826985    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:55:30.835461 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826987    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:55:30.836156 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826990    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:55:30.836156 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826993    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:55:30.836156 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.826996    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:55:30.836156 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.827657    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:55:30.836854 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.836836    2547 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 12:55:30.836888 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.836854    2547 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 12:55:30.836888 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.836869    2547 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 12:55:30.836888 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.836875    2547 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 12:55:30.836972 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836938    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:55:30.836972 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836943    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:55:30.836972 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836947    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:55:30.836972 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836951    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:55:30.836972 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836954    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:55:30.836972 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836956    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:55:30.836972 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836960    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:55:30.836972 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836963    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:55:30.836972 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836966    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:55:30.836972 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836969    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:55:30.836972 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836972    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:55:30.836972 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836975    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836978    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836982    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836989    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836992    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.836996    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837001    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837003    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837006    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837009    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837012    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837016    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837019    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837023    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837026    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837029    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837032    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837035    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837038    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:55:30.837269 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837040    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837043    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837046    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837048    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837051    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837054    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837057    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837059    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837062    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837065    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837067    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837070    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837072    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837075    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837077    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837080    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837084    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837087    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837089    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837092    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:55:30.837819 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837095    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837097    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837100    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837102    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837105    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837107    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837110    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837113    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837116    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837118    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837121    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837125    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837129    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837132    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837135    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837138    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837141    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837144    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837146    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837150    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:55:30.838342 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837152    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837155    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837157    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837160    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837163    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837165    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837168    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837171    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837174    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837177    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837180    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837183    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837185    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837188    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837190    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837193    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837196    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837198    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837201    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837203    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:55:30.838851 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837206    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837208    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837211    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837213    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837216    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837218    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837221    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837224    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837227    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.837232    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837354    2547 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837359    2547 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837363    2547 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837366    2547 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 12:55:30.839348 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837368    2547 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837371    2547 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837374    2547 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837376    2547 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837379    2547 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837382    2547 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837386    2547 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837391    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837394    2547 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837397    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837400    2547 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837403    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837406    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837409    2547 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837412    2547 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837415    2547 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837418    2547 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837421    2547 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837424    2547 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 12:55:30.839732 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837427    2547 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837430    2547 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837433    2547 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837436    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837439    2547 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837441    2547 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837444    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837446    2547 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837449    2547 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837452    2547 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837455    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837458    2547 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837460    2547 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837463    2547 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837465    2547 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837468    2547 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837470    2547 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837473    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837476    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837478    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 12:55:30.840214 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837481    2547 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837483    2547 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837487    2547 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837489    2547 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837492    2547 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837494    2547 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837497    2547 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837500    2547 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837502    2547 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837505    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837508    2547 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837510    2547 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837513    2547 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837515    2547 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837519    2547 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837523    2547 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837525    2547 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837528    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837530    2547 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 12:55:30.840771 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837533    2547 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837536    2547 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837539    2547 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837542    2547 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837544    2547 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837547    2547 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837551    2547 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837554    2547 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837557    2547 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837560    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837563    2547 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837566    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837568    2547 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837571    2547 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837574    2547 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837577    2547 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837580    2547 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837582    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837585    2547 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837587    2547 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 12:55:30.841253 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837590    2547 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837593    2547 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837596    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837598    2547 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837601    2547 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837603    2547 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837606    2547 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837608    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837611    2547 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837613    2547 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837616    2547 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837618    2547 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837621    2547 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837624    2547 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837627    2547 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837629    2547 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 12:55:30.841911 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:30.837632    2547 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 12:55:30.842307 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.837637    2547 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 12:55:30.842307 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.837764    2547 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 12:55:30.842307 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.840245    2547 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 12:55:30.842307 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.841389    2547 server.go:1019] "Starting client certificate rotation"
Sep 11 12:55:30.842307 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.841504    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 12:55:30.842307 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.841556    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 12:55:30.844409 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.844393    2547 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 12:55:30.845569 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.845551    2547 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 12:55:30.854746 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.854728    2547 log.go:25] "Validated CRI v1 runtime API"
Sep 11 12:55:30.857969 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.857955    2547 log.go:25] "Validated CRI v1 image API"
Sep 11 12:55:30.859148 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.859128    2547 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 12:55:30.864793 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.864773    2547 fs.go:135] Filesystem UUIDs: map[1377b324-031d-4109-a10f-295df4c745e1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ea00fa5f-e5f3-49b9-800f-a204ad385114:/dev/nvme0n1p3]
Sep 11 12:55:30.864857 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.864790    2547 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 12:55:30.871246 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.871133    2547 manager.go:216] Machine: {Timestamp:2026-09-11 12:55:30.869670193 +0000 UTC m=+0.373534580 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098559 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27fe07b364f5167b072dfb0658fd11 SystemUUID:ec27fe07-b364-f516-7b07-2dfb0658fd11 BootID:6b964e7b-805a-4b06-8ed5-1837d62ac23d Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:77:0f:6e:6e:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:77:0f:6e:6e:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:46:24:2b:a5:15 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 12:55:30.871246 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.871244    2547 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 12:55:30.871356 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.871325    2547 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 12:55:30.874885 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.874860    2547 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 12:55:30.875031 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.874888    2547 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 12:55:30.875741 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.875731    2547 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 12:55:30.875781 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.875744    2547 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 12:55:30.875781 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.875752    2547 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 12:55:30.876288 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.876273    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 12:55:30.876491 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.876478    2547 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 12:55:30.877803 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.877794    2547 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 12:55:30.882382 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.882371    2547 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 12:55:30.882496 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.882487    2547 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 12:55:30.882526 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.882515    2547 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 12:55:30.882553 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.882530    2547 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 12:55:30.882553 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.882547    2547 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 12:55:30.882603 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.882567    2547 kubelet.go:398] "Adding apiserver pod source"
Sep 11 12:55:30.882603 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.882576    2547 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 12:55:30.883067 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.883046    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 12:55:30.883067 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.883071    2547 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 12:55:30.886983 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.886962    2547 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 12:55:30.889271 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.889254    2547 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 12:55:30.889355 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.889292    2547 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 12:55:30.891452 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.891438    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 12:55:30.891519 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.891458    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 12:55:30.891519 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.891466    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 12:55:30.891519 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.891474    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 12:55:30.891519 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.891486    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 12:55:30.891519 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.891494    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 12:55:30.891519 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.891513    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 12:55:30.891519 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.891521    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 12:55:30.891763 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.891531    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 12:55:30.891763 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.891540    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 12:55:30.891763 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.891552    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 12:55:30.891763 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.891560    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 12:55:30.892531 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.892520    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 12:55:30.892587 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.892534    2547 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 12:55:30.895052 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.895026    2547 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-110.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 12:55:30.895239 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:30.895214    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 12:55:30.895326 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:30.895242    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 12:55:30.896357 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.896346    2547 server.go:1268] "Started kubelet"
Sep 11 12:55:30.896467 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.896416    2547 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 12:55:30.896521 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.896434    2547 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 12:55:30.896521 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.896505    2547 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 12:55:30.897330 ip-10-0-142-110 systemd[1]: Started Kubernetes Kubelet.
Sep 11 12:55:30.899206 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.897419    2547 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 12:55:30.900282 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.900254    2547 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 12:55:30.902420 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:30.902398    2547 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 12:55:30.905785 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.905769    2547 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 12:55:30.905870 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.905823    2547 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 12:55:30.905996 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:30.905980    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found"
Sep 11 12:55:30.906623 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.906607    2547 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 12:55:30.906738 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.906639    2547 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 12:55:30.906738 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.906653    2547 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 12:55:30.906838 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.906739    2547 factory.go:55] Registering systemd factory
Sep 11 12:55:30.906838 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.906749    2547 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 12:55:30.906838 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.906754    2547 factory.go:223] Registration of the systemd container factory successfully
Sep 11 12:55:30.906838 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.906758    2547 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 12:55:30.907015 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:30.905821    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-110.ec2.internal.18d445775a98d58f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-110.ec2.internal,UID:ip-10-0-142-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-110.ec2.internal,},FirstTimestamp:2026-09-11 12:55:30.896319887 +0000 UTC m=+0.400184271,LastTimestamp:2026-09-11 12:55:30.896319887 +0000 UTC m=+0.400184271,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-110.ec2.internal,}"
Sep 11 12:55:30.907179 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.907163    2547 factory.go:153] Registering CRI-O factory
Sep 11 12:55:30.907179 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.907178    2547 factory.go:223] Registration of the crio container factory successfully
Sep 11 12:55:30.907305 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.907256    2547 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 12:55:30.907305 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.907271    2547 factory.go:103] Registering Raw factory
Sep 11 12:55:30.907305 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.907281    2547 manager.go:1196] Started watching for new ooms in manager
Sep 11 12:55:30.907664 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.907650    2547 manager.go:349] Starting recovery of all containers
Sep 11 12:55:30.910175 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:30.910146    2547 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 12:55:30.910261 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:30.910172    2547 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 12:55:30.916754 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.916591    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 12:55:30.920652 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.920633    2547 manager.go:354] Recovery completed
Sep 11 12:55:30.925022 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.925009    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:30.926956 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.926933    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:30.927032 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.926975    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:30.927032 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.926990    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:30.927510 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.927493    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fntbv"
Sep 11 12:55:30.927646 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.927628    2547 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 12:55:30.927646 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.927642    2547 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 12:55:30.927801 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.927650    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:30.927801 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.927656    2547 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 12:55:30.928483 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.928467    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:30.928537 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.928494    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:30.928537 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.928504    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:30.928960 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:30.928883    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-110.ec2.internal.18d445775c6c50c6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-110.ec2.internal,UID:ip-10-0-142-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-110.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-110.ec2.internal,},FirstTimestamp:2026-09-11 12:55:30.926956742 +0000 UTC m=+0.430821129,LastTimestamp:2026-09-11 12:55:30.926956742 +0000 UTC m=+0.430821129,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-110.ec2.internal,}"
Sep 11 12:55:30.936922 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:30.936858    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-110.ec2.internal.18d445775c6cb153  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-110.ec2.internal,UID:ip-10-0-142-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-110.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-110.ec2.internal,},FirstTimestamp:2026-09-11 12:55:30.926981459 +0000 UTC m=+0.430845844,LastTimestamp:2026-09-11 12:55:30.926981459 +0000 UTC m=+0.430845844,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-110.ec2.internal,}"
Sep 11 12:55:30.938904 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:30.938887    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fntbv"
Sep 11 12:55:30.941566 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:30.941473    2547 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-110.ec2.internal.18d445775c6ce714  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-110.ec2.internal,UID:ip-10-0-142-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-110.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-110.ec2.internal,},FirstTimestamp:2026-09-11 12:55:30.92699522 +0000 UTC m=+0.430859605,LastTimestamp:2026-09-11 12:55:30.92699522 +0000 UTC m=+0.430859605,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-110.ec2.internal,}"
Sep 11 12:55:31.000185 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.000157    2547 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 12:55:31.075505 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.000211    2547 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 12:55:31.075505 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.000237    2547 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 12:55:31.075505 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.000328    2547 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 11 12:55:31.075505 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.002968    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:55:31.075505 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.006956    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found"
Sep 11 12:55:31.075505 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.074401    2547 policy_none.go:49] "None policy: Start"
Sep 11 12:55:31.075505 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.074423    2547 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 12:55:31.075505 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.074435    2547 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 12:55:31.076560 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.076547    2547 policy_none.go:47] "Start"
Sep 11 12:55:31.100656 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.100633    2547 kubelet.go:2472] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Sep 11 12:55:31.107379 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.107361    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found"
Sep 11 12:55:31.108702 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.108690    2547 manager.go:337] "Starting Device Plugin manager"
Sep 11 12:55:31.108784 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.108737    2547 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 12:55:31.108784 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.108748    2547 server.go:87] "Starting device plugin registration server"
Sep 11 12:55:31.109077 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.109064    2547 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 12:55:31.109130 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.109076    2547 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 12:55:31.109201 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.109184    2547 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 12:55:31.109278 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.109262    2547 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 12:55:31.109278 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.109276    2547 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 12:55:31.109858 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.109839    2547 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 12:55:31.109939 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.109881    2547 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-110.ec2.internal\" not found"
Sep 11 12:55:31.116777 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.116761    2547 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-110.ec2.internal\" not found" node="ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.209829 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.209807    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:31.210886 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.210865    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:31.210970 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.210905    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:31.210970 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.210916    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:31.210970 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.210937    2547 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.220225 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.220211    2547 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.220285 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.220231    2547 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-110.ec2.internal\": node \"ip-10-0-142-110.ec2.internal\" not found"
Sep 11 12:55:31.262374 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.262352    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found"
Sep 11 12:55:31.301431 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.301395    2547 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal"]
Sep 11 12:55:31.301505 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.301494    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:31.302481 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.302463    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:31.302563 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.302494    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:31.302563 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.302508    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:31.304964 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.304951    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:31.305085 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.305073    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.305126 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.305101    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:31.305690 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.305675    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:31.305690 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.305687    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:31.305804 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.305701    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:31.305804 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.305711    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:31.305804 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.305755    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:31.305804 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.305768    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:31.307996 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.307980    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88e07f51325ea5b2154d9d71b21b94e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"88e07f51325ea5b2154d9d71b21b94e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.308042 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.307996    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.308042 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.308009    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88e07f51325ea5b2154d9d71b21b94e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"88e07f51325ea5b2154d9d71b21b94e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.308042 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.308027    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2c1a40351559e9ec3453a089b9e818c-config\") pod \"kube-apiserver-proxy-ip-10-0-142-110.ec2.internal\" (UID: \"b2c1a40351559e9ec3453a089b9e818c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.308042 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.308033    2547 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 12:55:31.308778 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.308759    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 12:55:31.308859 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.308788    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 12:55:31.308859 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.308799    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeHasSufficientPID"
Sep 11 12:55:31.321230 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.321208    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-110.ec2.internal\" not found" node="ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.324898 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.324884    2547 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-110.ec2.internal\" not found" node="ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.363155 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.363086    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found"
Sep 11 12:55:31.408816 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.408785    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2c1a40351559e9ec3453a089b9e818c-config\") pod \"kube-apiserver-proxy-ip-10-0-142-110.ec2.internal\" (UID: \"b2c1a40351559e9ec3453a089b9e818c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.408993 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.408843    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88e07f51325ea5b2154d9d71b21b94e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"88e07f51325ea5b2154d9d71b21b94e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.408993 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.408896    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2c1a40351559e9ec3453a089b9e818c-config\") pod \"kube-apiserver-proxy-ip-10-0-142-110.ec2.internal\" (UID: \"b2c1a40351559e9ec3453a089b9e818c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.408993 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.408948    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88e07f51325ea5b2154d9d71b21b94e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"88e07f51325ea5b2154d9d71b21b94e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.408993 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.408980    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88e07f51325ea5b2154d9d71b21b94e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"88e07f51325ea5b2154d9d71b21b94e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.409136 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.409000    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88e07f51325ea5b2154d9d71b21b94e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal\" (UID: \"88e07f51325ea5b2154d9d71b21b94e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.464032 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.464002    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found"
Sep 11 12:55:31.568306 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.568258    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found"
Sep 11 12:55:31.623810 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.623752    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.627441 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.627418    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:31.669424 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.669398    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found"
Sep 11 12:55:31.774074 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.774037    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found"
Sep 11 12:55:31.841678 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.841641    2547 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 12:55:31.842211 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.841871    2547 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 12:55:31.875848 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:31.875761    2547 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-110.ec2.internal\" not found"
Sep 11 12:55:31.945910 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.945858    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 12:50:31 +0000 UTC" deadline="2028-04-25 10:49:42.692041999 +0000 UTC"
Sep 11 12:55:31.945910 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.945905    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14205h54m10.746142944s"
Sep 11 12:55:31.948930 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:31.948912    2547 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:55:32.006238 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.006208    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:32.019045 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.019027    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 12:55:32.020660 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.020646    2547 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal"
Sep 11 12:55:32.034049 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.034028    2547 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 12:55:32.155303 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.155212    2547 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:55:32.208917 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.208883    2547 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:55:32.394609 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:32.394578    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c1a40351559e9ec3453a089b9e818c.slice/crio-cd353a6bdeebf5d34ccb550fc1733c03a934a79fee7dd261db4b9506cfdd9836 WatchSource:0}: Error finding container cd353a6bdeebf5d34ccb550fc1733c03a934a79fee7dd261db4b9506cfdd9836: Status 404 returned error can't find the container with id cd353a6bdeebf5d34ccb550fc1733c03a934a79fee7dd261db4b9506cfdd9836
Sep 11 12:55:32.395072 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:32.395054    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e07f51325ea5b2154d9d71b21b94e4.slice/crio-7c59756d5e2d234522b6b273c0c2092974533dd8e15db2b2073d2dfdfead139c WatchSource:0}: Error finding container 7c59756d5e2d234522b6b273c0c2092974533dd8e15db2b2073d2dfdfead139c: Status 404 returned error can't find the container with id 7c59756d5e2d234522b6b273c0c2092974533dd8e15db2b2073d2dfdfead139c
Sep 11 12:55:32.399983 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.399965    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 12:55:32.887257 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.887223    2547 apiserver.go:52] "Watching apiserver"
Sep 11 12:55:32.893545 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.893526    2547 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 12:55:32.893964 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.893937    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7v7x7","openshift-image-registry/node-ca-cb8qd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal","openshift-multus/multus-additional-cni-plugins-9kmqq","openshift-multus/network-metrics-daemon-9z5fc","openshift-network-diagnostics/network-check-target-nptkm","openshift-ovn-kubernetes/ovnkube-node-cpcqk","kube-system/global-pull-secret-syncer-m2zq6","kube-system/konnectivity-agent-8m4bg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f","openshift-dns/node-resolver-bvm24","openshift-multus/multus-z2gjm","openshift-network-operator/iptables-alerter-xwqlc"]
Sep 11 12:55:32.898045 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.898020    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.900271 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.900247    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cb8qd"
Sep 11 12:55:32.900709 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.900691    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:55:32.901359 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.901343    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 12:55:32.902591 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.902570    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6zb8g\""
Sep 11 12:55:32.902591 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.902582    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:32.903008 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.902788    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 12:55:32.903008 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.902842    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 12:55:32.903008 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.902881    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vv7hk\""
Sep 11 12:55:32.903148 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.903061    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 12:55:32.905187 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.905167    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:32.905274 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:32.905239    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:32.905805 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.905766    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 12:55:32.905904 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.905820    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 12:55:32.906145 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.906126    2547 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 12:55:32.907570 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.907553    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:32.907648 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:32.907611    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:32.910024 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.910009    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:32.911845 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.911825    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 12:55:32.911974 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.911956    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-twpsl\""
Sep 11 12:55:32.912230 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.912217    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 12:55:32.912361 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.912344    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:32.912434 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:32.912413    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:32.913459 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.913439    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 12:55:32.913563 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.913472    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 12:55:32.913563 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.913523    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 12:55:32.914690 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.914675    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8m4bg"
Sep 11 12:55:32.916776 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.916757    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gft5r\""
Sep 11 12:55:32.917045 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.917018    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 12:55:32.917130 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.917096    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 12:55:32.917191 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.917101    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 12:55:32.918030 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.917567    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:32.918780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.918740    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 12:55:32.919010 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.918983    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d629522-32b6-4843-860f-cda119288ed7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:32.919114 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919027    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d629522-32b6-4843-860f-cda119288ed7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:32.919114 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919062    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:32.919114 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919104    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-sysconfig\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.919268 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919136    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-sysctl-conf\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.919268 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919165    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-systemd\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.919268 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919195    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-var-lib-kubelet\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.919268 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919222    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-host\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.919508 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919356    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k688\" (UniqueName: \"kubernetes.io/projected/aa895fcf-9308-497b-bdb7-4d6fbd413a97-kube-api-access-5k688\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.919508 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919406    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-run\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.919508 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919458    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-lib-modules\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.919658 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919533    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa895fcf-9308-497b-bdb7-4d6fbd413a97-tmp\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.919658 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919588    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrthd\" (UniqueName: \"kubernetes.io/projected/5d629522-32b6-4843-860f-cda119288ed7-kube-api-access-hrthd\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:32.919770 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919648    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqmzg\" (UniqueName: \"kubernetes.io/projected/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-kube-api-access-fqmzg\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:32.919770 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919698    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/125564ba-2933-414e-843b-5e36e5a55ebe-host\") pod \"node-ca-cb8qd\" (UID: \"125564ba-2933-414e-843b-5e36e5a55ebe\") " pod="openshift-image-registry/node-ca-cb8qd"
Sep 11 12:55:32.919770 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919746    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/125564ba-2933-414e-843b-5e36e5a55ebe-serviceca\") pod \"node-ca-cb8qd\" (UID: \"125564ba-2933-414e-843b-5e36e5a55ebe\") " pod="openshift-image-registry/node-ca-cb8qd"
Sep 11 12:55:32.919943 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919785    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vs47\" (UniqueName: \"kubernetes.io/projected/125564ba-2933-414e-843b-5e36e5a55ebe-kube-api-access-2vs47\") pod \"node-ca-cb8qd\" (UID: \"125564ba-2933-414e-843b-5e36e5a55ebe\") " pod="openshift-image-registry/node-ca-cb8qd"
Sep 11 12:55:32.919943 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919835    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-modprobe-d\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.919943 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919869    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-tuned\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.919943 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919903    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d629522-32b6-4843-860f-cda119288ed7-system-cni-dir\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:32.919943 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919937    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d629522-32b6-4843-860f-cda119288ed7-cnibin\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:32.920180 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.919968    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq65l\" (UniqueName: \"kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l\") pod \"network-check-target-nptkm\" (UID: \"3231ae02-4b42-43a9-b965-ccb5d9ec2a5a\") " pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:32.920180 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.920001    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-kubernetes\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.920180 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.920034    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-sys\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.920180 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.920071    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d629522-32b6-4843-860f-cda119288ed7-cni-binary-copy\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:32.920180 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.920103    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-sysctl-d\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:32.920180 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.920139    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d629522-32b6-4843-860f-cda119288ed7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:32.920461 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.920253    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-s76r9\""
Sep 11 12:55:32.920461 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.920394    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 12:55:32.920555 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.920523    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 12:55:32.920728 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.920677    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 12:55:32.920814 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.920768    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l9r7w\""
Sep 11 12:55:32.921149 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.921130    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bvm24"
Sep 11 12:55:32.921439 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.921419    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 12:55:32.922943 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.922921    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 12:55:32.923797 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.923776    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zg92r\""
Sep 11 12:55:32.923893 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.923833    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 12:55:32.923972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.923905    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:32.924338 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.924314    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 12:55:32.927156 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.927136    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 12:55:32.927259 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.927232    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k7hcf\""
Sep 11 12:55:32.927853 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.927833    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xwqlc"
Sep 11 12:55:32.930314 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.930255    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 12:55:32.930507 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.930485    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 12:55:32.930788 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.930723    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h88d9\""
Sep 11 12:55:32.931285 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.931271    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 12:55:32.934225 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.934205    2547 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 12:55:32.957278 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.957255    2547 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-6nx2f"
Sep 11 12:55:32.966464 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:32.966438    2547 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6nx2f"
Sep 11 12:55:33.004812 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.004751    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" event={"ID":"b2c1a40351559e9ec3453a089b9e818c","Type":"ContainerStarted","Data":"cd353a6bdeebf5d34ccb550fc1733c03a934a79fee7dd261db4b9506cfdd9836"}
Sep 11 12:55:33.006344 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.006317    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" event={"ID":"88e07f51325ea5b2154d9d71b21b94e4","Type":"ContainerStarted","Data":"7c59756d5e2d234522b6b273c0c2092974533dd8e15db2b2073d2dfdfead139c"}
Sep 11 12:55:33.008352 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.008332    2547 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 12:55:33.020805 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.020781    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-slash\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.020915 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.020819    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq65l\" (UniqueName: \"kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l\") pod \"network-check-target-nptkm\" (UID: \"3231ae02-4b42-43a9-b965-ccb5d9ec2a5a\") " pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:33.020915 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.020841    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-kubernetes\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.020915 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.020861    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.020915 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.020887    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72410b07-acd7-4753-8fee-61e094f12b5f-hosts-file\") pod \"node-resolver-bvm24\" (UID: \"72410b07-acd7-4753-8fee-61e094f12b5f\") " pod="openshift-dns/node-resolver-bvm24"
Sep 11 12:55:33.020915 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.020911    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-cni-netd\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.021168 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.020930    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3526dad-649b-49f1-b3bd-6854077fd978-ovnkube-script-lib\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.021168 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.020947    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-hostroot\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.021168 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.020983    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d629522-32b6-4843-860f-cda119288ed7-cni-binary-copy\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.021168 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021007    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-device-dir\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.021168 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021025    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69hxd\" (UniqueName: \"kubernetes.io/projected/489642b7-c9f4-41c1-8b0d-0303470e6c18-kube-api-access-69hxd\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.021168 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021029    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-kubernetes\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.021168 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021041    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcmqc\" (UniqueName: \"kubernetes.io/projected/72410b07-acd7-4753-8fee-61e094f12b5f-kube-api-access-hcmqc\") pod \"node-resolver-bvm24\" (UID: \"72410b07-acd7-4753-8fee-61e094f12b5f\") " pod="openshift-dns/node-resolver-bvm24"
Sep 11 12:55:33.021168 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021056    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l6jj\" (UniqueName: \"kubernetes.io/projected/e3526dad-649b-49f1-b3bd-6854077fd978-kube-api-access-4l6jj\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.021168 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021080    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d629522-32b6-4843-860f-cda119288ed7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.021168 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021101    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d629522-32b6-4843-860f-cda119288ed7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.021168 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021135    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d629522-32b6-4843-860f-cda119288ed7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021175    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-var-lib-cni-bin\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021223    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-run-netns\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021253    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30fc30a3-9498-4c65-8826-d75f0d71c495-multus-daemon-config\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021306    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-sysconfig\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021348    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-sysctl-conf\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021377    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-host\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021391    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-sysconfig\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021406    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k688\" (UniqueName: \"kubernetes.io/projected/aa895fcf-9308-497b-bdb7-4d6fbd413a97-kube-api-access-5k688\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021434    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-socket-dir\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021458    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d629522-32b6-4843-860f-cda119288ed7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021462    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-run-k8s-cni-cncf-io\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021500    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-host\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021538    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-sysctl-conf\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021573    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-lib-modules\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021617    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa895fcf-9308-497b-bdb7-4d6fbd413a97-tmp\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021646    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrthd\" (UniqueName: \"kubernetes.io/projected/5d629522-32b6-4843-860f-cda119288ed7-kube-api-access-hrthd\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.021712 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021664    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5d629522-32b6-4843-860f-cda119288ed7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021702    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-multus-socket-dir-parent\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021713    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5d629522-32b6-4843-860f-cda119288ed7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021759    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-multus-conf-dir\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021764    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d629522-32b6-4843-860f-cda119288ed7-cni-binary-copy\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021787    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-etc-kubernetes\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021832    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-run-ovn\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021866    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/125564ba-2933-414e-843b-5e36e5a55ebe-serviceca\") pod \"node-ca-cb8qd\" (UID: \"125564ba-2933-414e-843b-5e36e5a55ebe\") " pod="openshift-image-registry/node-ca-cb8qd"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021869    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-lib-modules\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021891    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-kubelet\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021919    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-run-ovn-kubernetes\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021943    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12361050-54a2-4987-83d0-263ddf62cd5a-kubelet-config\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021966    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-modprobe-d\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.021991    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d629522-32b6-4843-860f-cda119288ed7-system-cni-dir\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022030    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-multus-cni-dir\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022038    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d629522-32b6-4843-860f-cda119288ed7-system-cni-dir\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022061    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjfms\" (UniqueName: \"kubernetes.io/projected/30fc30a3-9498-4c65-8826-d75f0d71c495-kube-api-access-rjfms\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.022514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022119    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12361050-54a2-4987-83d0-263ddf62cd5a-dbus\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022186    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c28a5600-c2c4-489a-b372-ee3d2e46f324-agent-certs\") pod \"konnectivity-agent-8m4bg\" (UID: \"c28a5600-c2c4-489a-b372-ee3d2e46f324\") " pod="kube-system/konnectivity-agent-8m4bg"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022190    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-modprobe-d\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022245    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-etc-selinux\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022279    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022315    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-sys\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022316    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/125564ba-2933-414e-843b-5e36e5a55ebe-serviceca\") pod \"node-ca-cb8qd\" (UID: \"125564ba-2933-414e-843b-5e36e5a55ebe\") " pod="openshift-image-registry/node-ca-cb8qd"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022367    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-sys\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022406    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c28a5600-c2c4-489a-b372-ee3d2e46f324-konnectivity-ca\") pod \"konnectivity-agent-8m4bg\" (UID: \"c28a5600-c2c4-489a-b372-ee3d2e46f324\") " pod="kube-system/konnectivity-agent-8m4bg"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022454    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-system-cni-dir\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022458    2547 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022483    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-var-lib-cni-multus\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022546    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e602312a-67be-4088-864b-811263304cae-iptables-alerter-script\") pod \"iptables-alerter-xwqlc\" (UID: \"e602312a-67be-4088-864b-811263304cae\") " pod="openshift-network-operator/iptables-alerter-xwqlc"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022582    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3526dad-649b-49f1-b3bd-6854077fd978-ovnkube-config\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022608    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3526dad-649b-49f1-b3bd-6854077fd978-env-overrides\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022635    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-sysctl-d\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022659    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-run-multus-certs\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.023324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022683    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e602312a-67be-4088-864b-811263304cae-host-slash\") pod \"iptables-alerter-xwqlc\" (UID: \"e602312a-67be-4088-864b-811263304cae\") " pod="openshift-network-operator/iptables-alerter-xwqlc"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022708    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-var-lib-openvswitch\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022763    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-var-lib-kubelet\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022766    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-sysctl-d\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022790    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-etc-openvswitch\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022815    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3526dad-649b-49f1-b3bd-6854077fd978-ovn-node-metrics-cert\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022841    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022876    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-systemd\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022916    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-var-lib-kubelet\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.022928    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022940    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-cnibin\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.022961    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-run-netns\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.022994    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs podName:9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:33.522969216 +0000 UTC m=+3.026833593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs") pod "network-metrics-daemon-9z5fc" (UID: "9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023027    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-var-lib-kubelet\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023025    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-systemd\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023074    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-systemd-units\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023102    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-run\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.024113 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023131    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-sys-fs\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023159    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30fc30a3-9498-4c65-8826-d75f0d71c495-cni-binary-copy\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023169    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/aa895fcf-9308-497b-bdb7-4d6fbd413a97-run\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023186    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx6cd\" (UniqueName: \"kubernetes.io/projected/e602312a-67be-4088-864b-811263304cae-kube-api-access-nx6cd\") pod \"iptables-alerter-xwqlc\" (UID: \"e602312a-67be-4088-864b-811263304cae\") " pod="openshift-network-operator/iptables-alerter-xwqlc"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023216    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-run-systemd\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023240    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-run-openvswitch\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023266    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-node-log\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023290    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-log-socket\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023317    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqmzg\" (UniqueName: \"kubernetes.io/projected/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-kube-api-access-fqmzg\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023342    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/125564ba-2933-414e-843b-5e36e5a55ebe-host\") pod \"node-ca-cb8qd\" (UID: \"125564ba-2933-414e-843b-5e36e5a55ebe\") " pod="openshift-image-registry/node-ca-cb8qd"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023369    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vs47\" (UniqueName: \"kubernetes.io/projected/125564ba-2933-414e-843b-5e36e5a55ebe-kube-api-access-2vs47\") pod \"node-ca-cb8qd\" (UID: \"125564ba-2933-414e-843b-5e36e5a55ebe\") " pod="openshift-image-registry/node-ca-cb8qd"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023379    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/125564ba-2933-414e-843b-5e36e5a55ebe-host\") pod \"node-ca-cb8qd\" (UID: \"125564ba-2933-414e-843b-5e36e5a55ebe\") " pod="openshift-image-registry/node-ca-cb8qd"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023394    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-registration-dir\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023418    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-cni-bin\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023443    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023470    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-tuned\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023494    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d629522-32b6-4843-860f-cda119288ed7-cnibin\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.024975 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023518    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72410b07-acd7-4753-8fee-61e094f12b5f-tmp-dir\") pod \"node-resolver-bvm24\" (UID: \"72410b07-acd7-4753-8fee-61e094f12b5f\") " pod="openshift-dns/node-resolver-bvm24"
Sep 11 12:55:33.025711 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.023624    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d629522-32b6-4843-860f-cda119288ed7-cnibin\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.026764 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.026725    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/aa895fcf-9308-497b-bdb7-4d6fbd413a97-etc-tuned\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.026872 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.026770    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa895fcf-9308-497b-bdb7-4d6fbd413a97-tmp\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.031243 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.031216    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k688\" (UniqueName: \"kubernetes.io/projected/aa895fcf-9308-497b-bdb7-4d6fbd413a97-kube-api-access-5k688\") pod \"tuned-7v7x7\" (UID: \"aa895fcf-9308-497b-bdb7-4d6fbd413a97\") " pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.031355 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.031309    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:55:33.031355 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.031333    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:55:33.031355 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.031346    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fq65l for pod openshift-network-diagnostics/network-check-target-nptkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:33.031487 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.031409    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l podName:3231ae02-4b42-43a9-b965-ccb5d9ec2a5a nodeName:}" failed. No retries permitted until 2026-09-11 12:55:33.531383971 +0000 UTC m=+3.035248362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fq65l" (UniqueName: "kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l") pod "network-check-target-nptkm" (UID: "3231ae02-4b42-43a9-b965-ccb5d9ec2a5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:33.033666 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.033638    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrthd\" (UniqueName: \"kubernetes.io/projected/5d629522-32b6-4843-860f-cda119288ed7-kube-api-access-hrthd\") pod \"multus-additional-cni-plugins-9kmqq\" (UID: \"5d629522-32b6-4843-860f-cda119288ed7\") " pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.034727 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.034702    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqmzg\" (UniqueName: \"kubernetes.io/projected/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-kube-api-access-fqmzg\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:33.035052 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.035034    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vs47\" (UniqueName: \"kubernetes.io/projected/125564ba-2933-414e-843b-5e36e5a55ebe-kube-api-access-2vs47\") pod \"node-ca-cb8qd\" (UID: \"125564ba-2933-414e-843b-5e36e5a55ebe\") " pod="openshift-image-registry/node-ca-cb8qd"
Sep 11 12:55:33.124450 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124408    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-cni-bin\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.124623 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124458    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:33.124623 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124490    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72410b07-acd7-4753-8fee-61e094f12b5f-tmp-dir\") pod \"node-resolver-bvm24\" (UID: \"72410b07-acd7-4753-8fee-61e094f12b5f\") " pod="openshift-dns/node-resolver-bvm24"
Sep 11 12:55:33.124623 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124517    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-slash\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.124623 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124532    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-cni-bin\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.124623 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124556    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.124623 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124581    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72410b07-acd7-4753-8fee-61e094f12b5f-hosts-file\") pod \"node-resolver-bvm24\" (UID: \"72410b07-acd7-4753-8fee-61e094f12b5f\") " pod="openshift-dns/node-resolver-bvm24"
Sep 11 12:55:33.124623 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124605    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-cni-netd\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.124623 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124608    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-slash\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124646    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3526dad-649b-49f1-b3bd-6854077fd978-ovnkube-script-lib\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124656    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-cni-netd\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.124665    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124676    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-hostroot\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124705    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-device-dir\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124713    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.124773    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret podName:12361050-54a2-4987-83d0-263ddf62cd5a nodeName:}" failed. No retries permitted until 2026-09-11 12:55:33.624723966 +0000 UTC m=+3.128588366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret") pod "global-pull-secret-syncer-m2zq6" (UID: "12361050-54a2-4987-83d0-263ddf62cd5a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124800    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69hxd\" (UniqueName: \"kubernetes.io/projected/489642b7-c9f4-41c1-8b0d-0303470e6c18-kube-api-access-69hxd\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124837    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcmqc\" (UniqueName: \"kubernetes.io/projected/72410b07-acd7-4753-8fee-61e094f12b5f-kube-api-access-hcmqc\") pod \"node-resolver-bvm24\" (UID: \"72410b07-acd7-4753-8fee-61e094f12b5f\") " pod="openshift-dns/node-resolver-bvm24"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124865    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l6jj\" (UniqueName: \"kubernetes.io/projected/e3526dad-649b-49f1-b3bd-6854077fd978-kube-api-access-4l6jj\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124894    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-var-lib-cni-bin\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124920    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-run-netns\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124944    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30fc30a3-9498-4c65-8826-d75f0d71c495-multus-daemon-config\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.124977    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-socket-dir\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125001    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-run-k8s-cni-cncf-io\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125031    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-multus-socket-dir-parent\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.125084 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125058    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-multus-conf-dir\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125082    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-etc-kubernetes\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125100    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72410b07-acd7-4753-8fee-61e094f12b5f-tmp-dir\") pod \"node-resolver-bvm24\" (UID: \"72410b07-acd7-4753-8fee-61e094f12b5f\") " pod="openshift-dns/node-resolver-bvm24"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125108    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-run-ovn\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125135    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-kubelet\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125161    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-run-ovn-kubernetes\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125171    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72410b07-acd7-4753-8fee-61e094f12b5f-hosts-file\") pod \"node-resolver-bvm24\" (UID: \"72410b07-acd7-4753-8fee-61e094f12b5f\") " pod="openshift-dns/node-resolver-bvm24"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125187    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12361050-54a2-4987-83d0-263ddf62cd5a-kubelet-config\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125223    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-multus-cni-dir\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125257    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjfms\" (UniqueName: \"kubernetes.io/projected/30fc30a3-9498-4c65-8826-d75f0d71c495-kube-api-access-rjfms\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125286    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12361050-54a2-4987-83d0-263ddf62cd5a-dbus\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125311    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c28a5600-c2c4-489a-b372-ee3d2e46f324-agent-certs\") pod \"konnectivity-agent-8m4bg\" (UID: \"c28a5600-c2c4-489a-b372-ee3d2e46f324\") " pod="kube-system/konnectivity-agent-8m4bg"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125346    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-etc-selinux\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125373    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125403    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c28a5600-c2c4-489a-b372-ee3d2e46f324-konnectivity-ca\") pod \"konnectivity-agent-8m4bg\" (UID: \"c28a5600-c2c4-489a-b372-ee3d2e46f324\") " pod="kube-system/konnectivity-agent-8m4bg"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125406    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e3526dad-649b-49f1-b3bd-6854077fd978-ovnkube-script-lib\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125428    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-system-cni-dir\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.126026 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125456    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-var-lib-cni-multus\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125477    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-device-dir\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125483    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e602312a-67be-4088-864b-811263304cae-iptables-alerter-script\") pod \"iptables-alerter-xwqlc\" (UID: \"e602312a-67be-4088-864b-811263304cae\") " pod="openshift-network-operator/iptables-alerter-xwqlc"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125515    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3526dad-649b-49f1-b3bd-6854077fd978-ovnkube-config\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125523    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-hostroot\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125541    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3526dad-649b-49f1-b3bd-6854077fd978-env-overrides\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125569    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-run-multus-certs\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125594    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e602312a-67be-4088-864b-811263304cae-host-slash\") pod \"iptables-alerter-xwqlc\" (UID: \"e602312a-67be-4088-864b-811263304cae\") " pod="openshift-network-operator/iptables-alerter-xwqlc"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125625    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-var-lib-openvswitch\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125657    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-var-lib-kubelet\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125683    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-etc-openvswitch\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125710    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3526dad-649b-49f1-b3bd-6854077fd978-ovn-node-metrics-cert\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125753    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-cnibin\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125767    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30fc30a3-9498-4c65-8826-d75f0d71c495-multus-daemon-config\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125780    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-run-netns\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125852    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-systemd-units\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125882    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-sys-fs\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.126972 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125910    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30fc30a3-9498-4c65-8826-d75f0d71c495-cni-binary-copy\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125941    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx6cd\" (UniqueName: \"kubernetes.io/projected/e602312a-67be-4088-864b-811263304cae-kube-api-access-nx6cd\") pod \"iptables-alerter-xwqlc\" (UID: \"e602312a-67be-4088-864b-811263304cae\") " pod="openshift-network-operator/iptables-alerter-xwqlc"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125967    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-run-systemd\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.125993    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-run-openvswitch\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126019    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-node-log\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126044    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-log-socket\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126045    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-var-lib-cni-bin\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126079    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-registration-dir\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126094    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-run-netns\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126157    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-etc-kubernetes\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126170    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-multus-conf-dir\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126199    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-run-ovn\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126243    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-kubelet\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126286    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-run-ovn-kubernetes\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126344    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-sys-fs\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126609    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e602312a-67be-4088-864b-811263304cae-iptables-alerter-script\") pod \"iptables-alerter-xwqlc\" (UID: \"e602312a-67be-4088-864b-811263304cae\") " pod="openshift-network-operator/iptables-alerter-xwqlc"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126690    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-multus-cni-dir\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126696    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e3526dad-649b-49f1-b3bd-6854077fd978-env-overrides\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.128544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126707    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e3526dad-649b-49f1-b3bd-6854077fd978-ovnkube-config\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126909    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-run-multus-certs\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126960    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e602312a-67be-4088-864b-811263304cae-host-slash\") pod \"iptables-alerter-xwqlc\" (UID: \"e602312a-67be-4088-864b-811263304cae\") " pod="openshift-network-operator/iptables-alerter-xwqlc"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.126982    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-registration-dir\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127009    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12361050-54a2-4987-83d0-263ddf62cd5a-kubelet-config\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127027    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-var-lib-openvswitch\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127112    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-socket-dir\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127153    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-run-k8s-cni-cncf-io\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127188    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-systemd-units\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127235    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-multus-socket-dir-parent\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127273    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127495    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30fc30a3-9498-4c65-8826-d75f0d71c495-cni-binary-copy\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127547    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-var-lib-kubelet\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127713    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-run-systemd\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127734    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-cnibin\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127760    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-etc-openvswitch\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127789    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-log-socket\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127773    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-node-log\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.129515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127833    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-system-cni-dir\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.130471 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127849    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e3526dad-649b-49f1-b3bd-6854077fd978-run-openvswitch\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.130471 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127867    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-run-netns\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.130471 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127894    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30fc30a3-9498-4c65-8826-d75f0d71c495-host-var-lib-cni-multus\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.130471 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127922    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12361050-54a2-4987-83d0-263ddf62cd5a-dbus\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:33.130471 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.127939    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/489642b7-c9f4-41c1-8b0d-0303470e6c18-etc-selinux\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.130471 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.128414    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c28a5600-c2c4-489a-b372-ee3d2e46f324-konnectivity-ca\") pod \"konnectivity-agent-8m4bg\" (UID: \"c28a5600-c2c4-489a-b372-ee3d2e46f324\") " pod="kube-system/konnectivity-agent-8m4bg"
Sep 11 12:55:33.131722 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.131696    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c28a5600-c2c4-489a-b372-ee3d2e46f324-agent-certs\") pod \"konnectivity-agent-8m4bg\" (UID: \"c28a5600-c2c4-489a-b372-ee3d2e46f324\") " pod="kube-system/konnectivity-agent-8m4bg"
Sep 11 12:55:33.131860 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.131835    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e3526dad-649b-49f1-b3bd-6854077fd978-ovn-node-metrics-cert\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.134768 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.134739    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l6jj\" (UniqueName: \"kubernetes.io/projected/e3526dad-649b-49f1-b3bd-6854077fd978-kube-api-access-4l6jj\") pod \"ovnkube-node-cpcqk\" (UID: \"e3526dad-649b-49f1-b3bd-6854077fd978\") " pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.136717 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.136297    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69hxd\" (UniqueName: \"kubernetes.io/projected/489642b7-c9f4-41c1-8b0d-0303470e6c18-kube-api-access-69hxd\") pod \"aws-ebs-csi-driver-node-gq75f\" (UID: \"489642b7-c9f4-41c1-8b0d-0303470e6c18\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.136717 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.136671    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcmqc\" (UniqueName: \"kubernetes.io/projected/72410b07-acd7-4753-8fee-61e094f12b5f-kube-api-access-hcmqc\") pod \"node-resolver-bvm24\" (UID: \"72410b07-acd7-4753-8fee-61e094f12b5f\") " pod="openshift-dns/node-resolver-bvm24"
Sep 11 12:55:33.140121 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.140043    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjfms\" (UniqueName: \"kubernetes.io/projected/30fc30a3-9498-4c65-8826-d75f0d71c495-kube-api-access-rjfms\") pod \"multus-z2gjm\" (UID: \"30fc30a3-9498-4c65-8826-d75f0d71c495\") " pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.140375 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.140334    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx6cd\" (UniqueName: \"kubernetes.io/projected/e602312a-67be-4088-864b-811263304cae-kube-api-access-nx6cd\") pod \"iptables-alerter-xwqlc\" (UID: \"e602312a-67be-4088-864b-811263304cae\") " pod="openshift-network-operator/iptables-alerter-xwqlc"
Sep 11 12:55:33.209051 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.208810    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7v7x7"
Sep 11 12:55:33.215006 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.214973    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-cb8qd"
Sep 11 12:55:33.222649 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:33.222429    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa895fcf_9308_497b_bdb7_4d6fbd413a97.slice/crio-3375281ce3e5564c545e3df3efaaede5699021aebb81d2ec6d11eb5e26f03e0e WatchSource:0}: Error finding container 3375281ce3e5564c545e3df3efaaede5699021aebb81d2ec6d11eb5e26f03e0e: Status 404 returned error can't find the container with id 3375281ce3e5564c545e3df3efaaede5699021aebb81d2ec6d11eb5e26f03e0e
Sep 11 12:55:33.224187 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.224168    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9kmqq"
Sep 11 12:55:33.229922 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.229901    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:33.237145 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.237124    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8m4bg"
Sep 11 12:55:33.243034 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:33.243007    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d629522_32b6_4843_860f_cda119288ed7.slice/crio-06832906de1e57f687ed5794036f9c3b5a4e2a88cac058cd30796a21131f7b66 WatchSource:0}: Error finding container 06832906de1e57f687ed5794036f9c3b5a4e2a88cac058cd30796a21131f7b66: Status 404 returned error can't find the container with id 06832906de1e57f687ed5794036f9c3b5a4e2a88cac058cd30796a21131f7b66
Sep 11 12:55:33.244518 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:33.244486    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125564ba_2933_414e_843b_5e36e5a55ebe.slice/crio-2e5c7aea709d8833ae07f5ed1ca48ec1e0b9779a0a75d1d87d4e571802bd5924 WatchSource:0}: Error finding container 2e5c7aea709d8833ae07f5ed1ca48ec1e0b9779a0a75d1d87d4e571802bd5924: Status 404 returned error can't find the container with id 2e5c7aea709d8833ae07f5ed1ca48ec1e0b9779a0a75d1d87d4e571802bd5924
Sep 11 12:55:33.244799 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.244752    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f"
Sep 11 12:55:33.251979 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.251952    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bvm24"
Sep 11 12:55:33.254220 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:33.254193    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3526dad_649b_49f1_b3bd_6854077fd978.slice/crio-7b3942637b2df12aa317d0cf8532862e34194821ba0f00eb4ade2fc75c8b6f32 WatchSource:0}: Error finding container 7b3942637b2df12aa317d0cf8532862e34194821ba0f00eb4ade2fc75c8b6f32: Status 404 returned error can't find the container with id 7b3942637b2df12aa317d0cf8532862e34194821ba0f00eb4ade2fc75c8b6f32
Sep 11 12:55:33.260861 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.260516    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-z2gjm"
Sep 11 12:55:33.267092 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.267070    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xwqlc"
Sep 11 12:55:33.267501 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:33.267474    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod489642b7_c9f4_41c1_8b0d_0303470e6c18.slice/crio-444f0b9124238f6cd3682e57816bc43020013493edfa08112a1c2feadf031dc9 WatchSource:0}: Error finding container 444f0b9124238f6cd3682e57816bc43020013493edfa08112a1c2feadf031dc9: Status 404 returned error can't find the container with id 444f0b9124238f6cd3682e57816bc43020013493edfa08112a1c2feadf031dc9
Sep 11 12:55:33.272194 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:33.272167    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc28a5600_c2c4_489a_b372_ee3d2e46f324.slice/crio-cb5f025ab1b385767ff90516bdbd06a57c96f6742786326a32e6e945bf394610 WatchSource:0}: Error finding container cb5f025ab1b385767ff90516bdbd06a57c96f6742786326a32e6e945bf394610: Status 404 returned error can't find the container with id cb5f025ab1b385767ff90516bdbd06a57c96f6742786326a32e6e945bf394610
Sep 11 12:55:33.274201 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:33.274169    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72410b07_acd7_4753_8fee_61e094f12b5f.slice/crio-11798a0a8c1c5f37b2d22741a239f36f770716efa18df4e7ed1cfc5fca52e53c WatchSource:0}: Error finding container 11798a0a8c1c5f37b2d22741a239f36f770716efa18df4e7ed1cfc5fca52e53c: Status 404 returned error can't find the container with id 11798a0a8c1c5f37b2d22741a239f36f770716efa18df4e7ed1cfc5fca52e53c
Sep 11 12:55:33.279197 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:33.279153    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30fc30a3_9498_4c65_8826_d75f0d71c495.slice/crio-0351e2ebe0af8155694014a34ce91666aa07a1d8b408f482ed3052cb064c4507 WatchSource:0}: Error finding container 0351e2ebe0af8155694014a34ce91666aa07a1d8b408f482ed3052cb064c4507: Status 404 returned error can't find the container with id 0351e2ebe0af8155694014a34ce91666aa07a1d8b408f482ed3052cb064c4507
Sep 11 12:55:33.285870 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:55:33.284848    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode602312a_67be_4088_864b_811263304cae.slice/crio-7fc7719e9f24e698fa55f77f089e9eca3aafb04f561a0aeef2dad30bd357bdfc WatchSource:0}: Error finding container 7fc7719e9f24e698fa55f77f089e9eca3aafb04f561a0aeef2dad30bd357bdfc: Status 404 returned error can't find the container with id 7fc7719e9f24e698fa55f77f089e9eca3aafb04f561a0aeef2dad30bd357bdfc
Sep 11 12:55:33.399014 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.398881    2547 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 12:55:33.529464 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.529428    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:33.529653 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.529626    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:33.529731 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.529709    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs podName:9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:34.529690153 +0000 UTC m=+4.033554530 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs") pod "network-metrics-daemon-9z5fc" (UID: "9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:33.630152 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.630118    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:33.630324 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.630167    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq65l\" (UniqueName: \"kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l\") pod \"network-check-target-nptkm\" (UID: \"3231ae02-4b42-43a9-b965-ccb5d9ec2a5a\") " pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:33.630324 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.630305    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:33.630424 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.630381    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret podName:12361050-54a2-4987-83d0-263ddf62cd5a nodeName:}" failed. No retries permitted until 2026-09-11 12:55:34.630358745 +0000 UTC m=+4.134223141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret") pod "global-pull-secret-syncer-m2zq6" (UID: "12361050-54a2-4987-83d0-263ddf62cd5a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:33.630480 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.630421    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:55:33.630480 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.630443    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:55:33.630480 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.630454    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fq65l for pod openshift-network-diagnostics/network-check-target-nptkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:33.630614 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:33.630501    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l podName:3231ae02-4b42-43a9-b965-ccb5d9ec2a5a nodeName:}" failed. No retries permitted until 2026-09-11 12:55:34.630488287 +0000 UTC m=+4.134352659 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq65l" (UniqueName: "kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l") pod "network-check-target-nptkm" (UID: "3231ae02-4b42-43a9-b965-ccb5d9ec2a5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:33.970169 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.970128    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 12:50:33 +0000 UTC" deadline="2028-03-11 08:28:03.732602275 +0000 UTC"
Sep 11 12:55:33.970169 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:33.970164    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13123h32m29.762443058s"
Sep 11 12:55:34.009710 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.009674    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bvm24" event={"ID":"72410b07-acd7-4753-8fee-61e094f12b5f","Type":"ContainerStarted","Data":"11798a0a8c1c5f37b2d22741a239f36f770716efa18df4e7ed1cfc5fca52e53c"}
Sep 11 12:55:34.013914 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.013873    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kmqq" event={"ID":"5d629522-32b6-4843-860f-cda119288ed7","Type":"ContainerStarted","Data":"06832906de1e57f687ed5794036f9c3b5a4e2a88cac058cd30796a21131f7b66"}
Sep 11 12:55:34.015187 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.015162    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xwqlc" event={"ID":"e602312a-67be-4088-864b-811263304cae","Type":"ContainerStarted","Data":"7fc7719e9f24e698fa55f77f089e9eca3aafb04f561a0aeef2dad30bd357bdfc"}
Sep 11 12:55:34.016484 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.016458    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z2gjm" event={"ID":"30fc30a3-9498-4c65-8826-d75f0d71c495","Type":"ContainerStarted","Data":"0351e2ebe0af8155694014a34ce91666aa07a1d8b408f482ed3052cb064c4507"}
Sep 11 12:55:34.017707 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.017684    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f" event={"ID":"489642b7-c9f4-41c1-8b0d-0303470e6c18","Type":"ContainerStarted","Data":"444f0b9124238f6cd3682e57816bc43020013493edfa08112a1c2feadf031dc9"}
Sep 11 12:55:34.019017 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.018995    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8m4bg" event={"ID":"c28a5600-c2c4-489a-b372-ee3d2e46f324","Type":"ContainerStarted","Data":"cb5f025ab1b385767ff90516bdbd06a57c96f6742786326a32e6e945bf394610"}
Sep 11 12:55:34.020348 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.020326    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk" event={"ID":"e3526dad-649b-49f1-b3bd-6854077fd978","Type":"ContainerStarted","Data":"7b3942637b2df12aa317d0cf8532862e34194821ba0f00eb4ade2fc75c8b6f32"}
Sep 11 12:55:34.021699 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.021659    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cb8qd" event={"ID":"125564ba-2933-414e-843b-5e36e5a55ebe","Type":"ContainerStarted","Data":"2e5c7aea709d8833ae07f5ed1ca48ec1e0b9779a0a75d1d87d4e571802bd5924"}
Sep 11 12:55:34.022903 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.022882    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7v7x7" event={"ID":"aa895fcf-9308-497b-bdb7-4d6fbd413a97","Type":"ContainerStarted","Data":"3375281ce3e5564c545e3df3efaaede5699021aebb81d2ec6d11eb5e26f03e0e"}
Sep 11 12:55:34.538316 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.537688    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:34.538316 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:34.537854    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:34.538316 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:34.537941    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs podName:9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:36.537917503 +0000 UTC m=+6.041781897 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs") pod "network-metrics-daemon-9z5fc" (UID: "9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:34.641040 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.640127    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:34.641040 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.640187    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq65l\" (UniqueName: \"kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l\") pod \"network-check-target-nptkm\" (UID: \"3231ae02-4b42-43a9-b965-ccb5d9ec2a5a\") " pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:34.641040 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:34.640377    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:55:34.641040 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:34.640397    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:55:34.641040 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:34.640411    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fq65l for pod openshift-network-diagnostics/network-check-target-nptkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:34.641040 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:34.640475    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l podName:3231ae02-4b42-43a9-b965-ccb5d9ec2a5a nodeName:}" failed. No retries permitted until 2026-09-11 12:55:36.64045411 +0000 UTC m=+6.144318485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq65l" (UniqueName: "kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l") pod "network-check-target-nptkm" (UID: "3231ae02-4b42-43a9-b965-ccb5d9ec2a5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:34.641040 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:34.640561    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:34.641040 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:34.640602    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret podName:12361050-54a2-4987-83d0-263ddf62cd5a nodeName:}" failed. No retries permitted until 2026-09-11 12:55:36.640589105 +0000 UTC m=+6.144453499 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret") pod "global-pull-secret-syncer-m2zq6" (UID: "12361050-54a2-4987-83d0-263ddf62cd5a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:34.971008 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.970911    2547 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 12:50:33 +0000 UTC" deadline="2028-06-24 10:45:05.162773172 +0000 UTC"
Sep 11 12:55:34.971008 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:34.970972    2547 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15645h49m30.191805127s"
Sep 11 12:55:35.004092 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:35.003248    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:35.004092 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:35.003391    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:35.004092 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:35.003826    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:35.004092 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:35.003925    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:35.004092 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:35.003987    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:35.004092 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:35.004059    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:36.557197 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:36.557154    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:36.557677 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:36.557397    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:36.557677 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:36.557466    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs podName:9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:40.557445744 +0000 UTC m=+10.061310134 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs") pod "network-metrics-daemon-9z5fc" (UID: "9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:36.658594 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:36.658553    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq65l\" (UniqueName: \"kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l\") pod \"network-check-target-nptkm\" (UID: \"3231ae02-4b42-43a9-b965-ccb5d9ec2a5a\") " pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:36.658771 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:36.658681    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:36.658930 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:36.658826    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:36.658930 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:36.658901    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret podName:12361050-54a2-4987-83d0-263ddf62cd5a nodeName:}" failed. No retries permitted until 2026-09-11 12:55:40.658880649 +0000 UTC m=+10.162745026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret") pod "global-pull-secret-syncer-m2zq6" (UID: "12361050-54a2-4987-83d0-263ddf62cd5a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:36.659369 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:36.659345    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:55:36.659468 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:36.659374    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:55:36.659468 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:36.659388    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fq65l for pod openshift-network-diagnostics/network-check-target-nptkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:36.659468 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:36.659434    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l podName:3231ae02-4b42-43a9-b965-ccb5d9ec2a5a nodeName:}" failed. No retries permitted until 2026-09-11 12:55:40.659419705 +0000 UTC m=+10.163284104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq65l" (UniqueName: "kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l") pod "network-check-target-nptkm" (UID: "3231ae02-4b42-43a9-b965-ccb5d9ec2a5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:37.004130 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:37.003214    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:37.004130 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:37.003364    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:37.004130 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:37.003752    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:37.004130 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:37.003861    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:37.004130 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:37.003915    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:37.004130 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:37.004009    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:39.000991 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:39.000894    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:39.001511 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:39.001038    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:39.001511 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:39.001176    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:39.001511 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:39.001319    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:39.001511 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:39.000895    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:39.001511 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:39.001457    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:40.592700 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:40.592047    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:40.592700 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:40.592276    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:40.592700 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:40.592343    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs podName:9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072 nodeName:}" failed. No retries permitted until 2026-09-11 12:55:48.592323211 +0000 UTC m=+18.096187589 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs") pod "network-metrics-daemon-9z5fc" (UID: "9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:40.693101 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:40.693050    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:40.693101 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:40.693102    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq65l\" (UniqueName: \"kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l\") pod \"network-check-target-nptkm\" (UID: \"3231ae02-4b42-43a9-b965-ccb5d9ec2a5a\") " pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:40.693344 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:40.693226    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:40.693344 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:40.693243    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:55:40.693344 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:40.693262    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:55:40.693344 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:40.693274    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fq65l for pod openshift-network-diagnostics/network-check-target-nptkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:40.693344 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:40.693306    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret podName:12361050-54a2-4987-83d0-263ddf62cd5a nodeName:}" failed. No retries permitted until 2026-09-11 12:55:48.693284015 +0000 UTC m=+18.197148393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret") pod "global-pull-secret-syncer-m2zq6" (UID: "12361050-54a2-4987-83d0-263ddf62cd5a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:40.693344 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:40.693327    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l podName:3231ae02-4b42-43a9-b965-ccb5d9ec2a5a nodeName:}" failed. No retries permitted until 2026-09-11 12:55:48.69331736 +0000 UTC m=+18.197181740 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq65l" (UniqueName: "kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l") pod "network-check-target-nptkm" (UID: "3231ae02-4b42-43a9-b965-ccb5d9ec2a5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:41.002080 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:41.002049    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:41.002283 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:41.002167    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:41.002591 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:41.002408    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:41.002591 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:41.002545    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:41.002591 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:41.002572    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:41.002845 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:41.002696    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:43.001175 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:43.000835    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:43.001175 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:43.000968    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:43.001175 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:43.000835    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:43.001175 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:43.001003    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:43.001175 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:43.001065    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:43.001175 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:43.001140    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:45.000696 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:45.000666    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:45.001140 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:45.000699    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:45.001140 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:45.000671    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:45.001140 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:45.000812    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:45.001140 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:45.000948    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:45.001140 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:45.001039    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:47.001414 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:47.001374    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:47.001874 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:47.001392    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:47.001874 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:47.001374    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:47.001874 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:47.001583    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:47.001874 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:47.001667    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:47.001874 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:47.001792    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:48.655294 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:48.655261    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:48.655960 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:48.655429    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:48.655960 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:48.655502    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs podName:9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:04.65548045 +0000 UTC m=+34.159344828 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs") pod "network-metrics-daemon-9z5fc" (UID: "9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:55:48.755644 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:48.755611    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:48.755848 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:48.755654    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq65l\" (UniqueName: \"kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l\") pod \"network-check-target-nptkm\" (UID: \"3231ae02-4b42-43a9-b965-ccb5d9ec2a5a\") " pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:48.755848 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:48.755789    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:48.755848 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:48.755807    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:55:48.755848 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:48.755825    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:55:48.755848 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:48.755837    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fq65l for pod openshift-network-diagnostics/network-check-target-nptkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:48.756092 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:48.755867    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret podName:12361050-54a2-4987-83d0-263ddf62cd5a nodeName:}" failed. No retries permitted until 2026-09-11 12:56:04.755845787 +0000 UTC m=+34.259710173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret") pod "global-pull-secret-syncer-m2zq6" (UID: "12361050-54a2-4987-83d0-263ddf62cd5a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:55:48.756092 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:48.755891    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l podName:3231ae02-4b42-43a9-b965-ccb5d9ec2a5a nodeName:}" failed. No retries permitted until 2026-09-11 12:56:04.755880322 +0000 UTC m=+34.259744698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq65l" (UniqueName: "kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l") pod "network-check-target-nptkm" (UID: "3231ae02-4b42-43a9-b965-ccb5d9ec2a5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:55:49.000869 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:49.000785    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:49.000869 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:49.000826    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:49.001081 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:49.000788    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:49.001081 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:49.000919    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:49.001081 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:49.001004    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:49.001224 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:49.001079    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:51.001988 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:51.001944    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:51.002459 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:51.002058    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:51.002459 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:51.002081    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:51.002459 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:51.002062    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:51.002459 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:51.002174    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:51.002459 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:51.002237    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:53.001757 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.001452    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:53.002300 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.001453    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:53.002300 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:53.001836    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:53.002300 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:53.001943    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:53.002300 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.001473    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:53.002300 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:53.002027    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:53.067787 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.067753    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bvm24" event={"ID":"72410b07-acd7-4753-8fee-61e094f12b5f","Type":"ContainerStarted","Data":"8141c7b8f5b980f8bf8b1c7ae1093fa347b72bc9a10eecb80b34b4f7eb6ef88a"}
Sep 11 12:55:53.069356 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.069330    2547 generic.go:356] "Generic (PLEG): container finished" podID="5d629522-32b6-4843-860f-cda119288ed7" containerID="e6179e00fe23279895ea721beaa3eaac5af21a71deb3d9d573080e3b4d8766b7" exitCode=0
Sep 11 12:55:53.069482 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.069412    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kmqq" event={"ID":"5d629522-32b6-4843-860f-cda119288ed7","Type":"ContainerDied","Data":"e6179e00fe23279895ea721beaa3eaac5af21a71deb3d9d573080e3b4d8766b7"}
Sep 11 12:55:53.071279 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.071256    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-z2gjm" event={"ID":"30fc30a3-9498-4c65-8826-d75f0d71c495","Type":"ContainerStarted","Data":"02aa1e2004be8fe60869dab0231ce33a59bb7474aad450899e12d12afb559675"}
Sep 11 12:55:53.072993 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.072973    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f" event={"ID":"489642b7-c9f4-41c1-8b0d-0303470e6c18","Type":"ContainerStarted","Data":"51feba5298b4512ed2517ad4bed9de36f9917aaa6ff1a1d494b3cab6a5139fa3"}
Sep 11 12:55:53.074420 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.074389    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8m4bg" event={"ID":"c28a5600-c2c4-489a-b372-ee3d2e46f324","Type":"ContainerStarted","Data":"fa30e4ff2203a5cec339ddf0fdf705963f6c34e591d7003443a66bbbdfb8f052"}
Sep 11 12:55:53.078011 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.077989    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk" event={"ID":"e3526dad-649b-49f1-b3bd-6854077fd978","Type":"ContainerStarted","Data":"a62b61d26c243bed30daea56e19e163898f435513f54881a23db0b4a32ed3c2c"}
Sep 11 12:55:53.078094 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.078047    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk" event={"ID":"e3526dad-649b-49f1-b3bd-6854077fd978","Type":"ContainerStarted","Data":"44d2844a49555d201d04e26b6969a0ad877d9ffe135847101665c25e2b9dbe4d"}
Sep 11 12:55:53.078094 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.078088    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk" event={"ID":"e3526dad-649b-49f1-b3bd-6854077fd978","Type":"ContainerStarted","Data":"f6c8b79b28316a0550c33d1497253ae0513e06da0567767f659246ee228e7385"}
Sep 11 12:55:53.078190 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.078126    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk" event={"ID":"e3526dad-649b-49f1-b3bd-6854077fd978","Type":"ContainerStarted","Data":"f86fc87a2ea3526b3d673ef355c74c9c7ae392b13beaa40d594d2d8154691912"}
Sep 11 12:55:53.078190 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.078160    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk" event={"ID":"e3526dad-649b-49f1-b3bd-6854077fd978","Type":"ContainerStarted","Data":"a889e20135267f3deb0ce379a1ad0ac2fe41abd9fb95db5b7808ebea69573394"}
Sep 11 12:55:53.078190 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.078188    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk" event={"ID":"e3526dad-649b-49f1-b3bd-6854077fd978","Type":"ContainerStarted","Data":"88e8978ac84e05e49e7e3b859263018ce26cfe9c189ea7e60ae6e4f5faf0d2d4"}
Sep 11 12:55:53.079484 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.079451    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-cb8qd" event={"ID":"125564ba-2933-414e-843b-5e36e5a55ebe","Type":"ContainerStarted","Data":"feabdeeaa5c840ad1f995d81576fe144f4a41098144c6690e67c5b32681affd9"}
Sep 11 12:55:53.080830 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.080808    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7v7x7" event={"ID":"aa895fcf-9308-497b-bdb7-4d6fbd413a97","Type":"ContainerStarted","Data":"83a0beba9edfe13ab4d313178c3add63fb54bb85449707ebd83be12ffa530d48"}
Sep 11 12:55:53.082365 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.082345    2547 generic.go:356] "Generic (PLEG): container finished" podID="88e07f51325ea5b2154d9d71b21b94e4" containerID="1bd783f36a53e22ddad392fac5c7a7bcca28783733db4d5006e8551346c32fa9" exitCode=0
Sep 11 12:55:53.082464 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.082410    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" event={"ID":"88e07f51325ea5b2154d9d71b21b94e4","Type":"ContainerDied","Data":"1bd783f36a53e22ddad392fac5c7a7bcca28783733db4d5006e8551346c32fa9"}
Sep 11 12:55:53.084001 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.083979    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" event={"ID":"b2c1a40351559e9ec3453a089b9e818c","Type":"ContainerStarted","Data":"ba5ccecb35c76f7c2f92c67b872bc2e161167f6adabae08a0b30d0fcb3fb54c5"}
Sep 11 12:55:53.084552 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.084506    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bvm24" podStartSLOduration=2.373331247 podStartE2EDuration="21.084489991s" totalImagesPullingTime="18.711158744s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:53.083983233 +0000 UTC m=+22.587847627" watchObservedRunningTime="2026-09-11 12:55:53.084489991 +0000 UTC m=+22.588354385"
Sep 11 12:55:53.103748 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.103695    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-z2gjm" podStartSLOduration=2.152201462 podStartE2EDuration="21.103682781s" totalImagesPullingTime="18.951481319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:53.103386334 +0000 UTC m=+22.607250727" watchObservedRunningTime="2026-09-11 12:55:53.103682781 +0000 UTC m=+22.607547174"
Sep 11 12:55:53.138207 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.138034    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7v7x7" podStartSLOduration=2.369979172 podStartE2EDuration="21.138014461s" totalImagesPullingTime="18.768035289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:53.137494327 +0000 UTC m=+22.641358721" watchObservedRunningTime="2026-09-11 12:55:53.138014461 +0000 UTC m=+22.641878855"
Sep 11 12:55:53.180894 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.180826    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8m4bg" podStartSLOduration=2.5614670950000002 podStartE2EDuration="21.180773438s" totalImagesPullingTime="18.619306343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:53.176977999 +0000 UTC m=+22.680842383" watchObservedRunningTime="2026-09-11 12:55:53.180773438 +0000 UTC m=+22.684637811"
Sep 11 12:55:53.181757 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.181700    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-cb8qd" podStartSLOduration=2.437724233 podStartE2EDuration="21.181681251s" totalImagesPullingTime="18.743957018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:53.153610245 +0000 UTC m=+22.657474638" watchObservedRunningTime="2026-09-11 12:55:53.181681251 +0000 UTC m=+22.685545653"
Sep 11 12:55:53.234428 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.234380    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-110.ec2.internal" podStartSLOduration=21.234363746 podStartE2EDuration="21.234363746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:53.233659226 +0000 UTC m=+22.737523619" watchObservedRunningTime="2026-09-11 12:55:53.234363746 +0000 UTC m=+22.738228138"
Sep 11 12:55:53.995003 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:53.994975    2547 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 12:55:54.088566 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:54.088511    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xwqlc" event={"ID":"e602312a-67be-4088-864b-811263304cae","Type":"ContainerStarted","Data":"6a7c0a678b5b385f7099cee57bbc54eb9fde3bdf3e3146548bd5b6c7f1ee38ef"}
Sep 11 12:55:54.090645 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:54.090590    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f" event={"ID":"489642b7-c9f4-41c1-8b0d-0303470e6c18","Type":"ContainerStarted","Data":"7926253a929ad81b94f6de1eb434c5963a9b85c3943a3a2b17362043bbc56738"}
Sep 11 12:55:54.092601 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:54.092573    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" event={"ID":"88e07f51325ea5b2154d9d71b21b94e4","Type":"ContainerStarted","Data":"0562e603cb8dfcb1f208adcdaf99ec1ebb15d6508da726498333631da9e91212"}
Sep 11 12:55:54.102751 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:54.102674    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xwqlc" podStartSLOduration=3.393117933 podStartE2EDuration="22.102661232s" totalImagesPullingTime="18.709543299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:54.102480852 +0000 UTC m=+23.606345244" watchObservedRunningTime="2026-09-11 12:55:54.102661232 +0000 UTC m=+23.606525623"
Sep 11 12:55:54.116929 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:54.116893    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-110.ec2.internal" podStartSLOduration=22.11688117 podStartE2EDuration="22.11688117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:54.116379252 +0000 UTC m=+23.620243646" watchObservedRunningTime="2026-09-11 12:55:54.11688117 +0000 UTC m=+23.620745563"
Sep 11 12:55:54.126504 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:54.126426    2547 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T12:55:53.994998483Z","UUID":"bec5c7fc-c04d-4c1e-8c86-c413456a631b","Handler":null,"Name":"","Endpoint":""}
Sep 11 12:55:54.127700 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:54.127682    2547 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 12:55:54.127811 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:54.127731    2547 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 12:55:55.001578 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:55.001388    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:55.001854 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:55.001435    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:55.001854 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:55.001646    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:55.001854 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:55.001760    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:55.001854 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:55.001466    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:55.002012 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:55.001869    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:55.108101 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:55.108081    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8m4bg"
Sep 11 12:55:55.108665 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:55.108647    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8m4bg"
Sep 11 12:55:56.098907 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:56.098871    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f" event={"ID":"489642b7-c9f4-41c1-8b0d-0303470e6c18","Type":"ContainerStarted","Data":"e0e7dbc0ccefb28c41418ad9debbe133f06a5367948cd5b7111451337c24105d"}
Sep 11 12:55:56.102402 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:56.102377    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk" event={"ID":"e3526dad-649b-49f1-b3bd-6854077fd978","Type":"ContainerStarted","Data":"4d196b404762ff3af62d8ee56afef11a56aed23c98fd01975f9753cdcf1b1a25"}
Sep 11 12:55:56.102505 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:56.102443    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8m4bg"
Sep 11 12:55:56.102960 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:56.102946    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8m4bg"
Sep 11 12:55:56.116290 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:56.116255    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gq75f" podStartSLOduration=2.995960283 podStartE2EDuration="24.116242425s" totalImagesPullingTime="21.120282142s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:56.115557923 +0000 UTC m=+25.619422316" watchObservedRunningTime="2026-09-11 12:55:56.116242425 +0000 UTC m=+25.620106796"
Sep 11 12:55:57.000937 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:57.000632    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:57.000937 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:57.000635    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:57.000937 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:57.000778    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:57.000937 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:57.000635    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:57.000937 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:57.000824    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:57.000937 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:57.000941    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:59.000903 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:59.000867    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:55:59.001291 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:59.000901    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:55:59.001291 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:59.000867    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:55:59.001291 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:59.000989    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:55:59.001291 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:59.001045    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:55:59.001291 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:55:59.001128    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:55:59.110725 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:59.110678    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk" event={"ID":"e3526dad-649b-49f1-b3bd-6854077fd978","Type":"ContainerStarted","Data":"c3ae37c5788f9c5aae6537ceef2e0c0c93cc135ab89a69520f3b4918c65d04d1"}
Sep 11 12:55:59.110930 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:59.110902    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:59.111017 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:59.110985    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:59.112643 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:59.112622    2547 generic.go:356] "Generic (PLEG): container finished" podID="5d629522-32b6-4843-860f-cda119288ed7" containerID="c85885ee0f6a2078a007476c725cea85cfb4739d6e5ed027021598b63cff7175" exitCode=0
Sep 11 12:55:59.112732 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:59.112650    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kmqq" event={"ID":"5d629522-32b6-4843-860f-cda119288ed7","Type":"ContainerDied","Data":"c85885ee0f6a2078a007476c725cea85cfb4739d6e5ed027021598b63cff7175"}
Sep 11 12:55:59.125870 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:59.125851    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:55:59.158360 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:55:59.158294    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk" podStartSLOduration=8.002752488 podStartE2EDuration="27.15828255s" totalImagesPullingTime="19.155530062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:55:59.158121145 +0000 UTC m=+28.661985541" watchObservedRunningTime="2026-09-11 12:55:59.15828255 +0000 UTC m=+28.662146958"
Sep 11 12:56:00.115384 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:00.115343    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:56:00.129304 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:00.129276    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:56:00.533877 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:00.533841    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m2zq6"]
Sep 11 12:56:00.534036 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:00.533986    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:56:00.534077 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:00.534066    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:56:00.536123 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:00.536096    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nptkm"]
Sep 11 12:56:00.536230 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:00.536204    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:56:00.536330 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:00.536312    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:56:00.540647 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:00.540629    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9z5fc"]
Sep 11 12:56:00.540816 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:00.540710    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:56:00.540816 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:00.540804    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:56:01.118534 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:01.118503    2547 generic.go:356] "Generic (PLEG): container finished" podID="5d629522-32b6-4843-860f-cda119288ed7" containerID="20c2a9d2871c63fa032cf1cd7eeb703d19954d6a6a23b4dadfc56b6817bc1083" exitCode=0
Sep 11 12:56:01.118937 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:01.118580    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kmqq" event={"ID":"5d629522-32b6-4843-860f-cda119288ed7","Type":"ContainerDied","Data":"20c2a9d2871c63fa032cf1cd7eeb703d19954d6a6a23b4dadfc56b6817bc1083"}
Sep 11 12:56:02.001257 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:02.001081    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:56:02.001432 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:02.001127    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:56:02.001491 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:02.001154    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:56:02.001658 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:02.001328    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:56:02.001831 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:02.001780    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:56:02.001831 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:02.001792    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:56:03.124852 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:03.124821    2547 generic.go:356] "Generic (PLEG): container finished" podID="5d629522-32b6-4843-860f-cda119288ed7" containerID="e426beef9cad26abbc81542813194ec84e2a9826d91f8fd4b01b5814a98a784c" exitCode=0
Sep 11 12:56:03.125207 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:03.124877    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kmqq" event={"ID":"5d629522-32b6-4843-860f-cda119288ed7","Type":"ContainerDied","Data":"e426beef9cad26abbc81542813194ec84e2a9826d91f8fd4b01b5814a98a784c"}
Sep 11 12:56:04.000593 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:04.000536    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:56:04.000593 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:04.000571    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:56:04.000834 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:04.000655    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:56:04.000834 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:04.000742    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:56:04.000941 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:04.000848    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:56:04.000941 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:04.000930    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:56:04.683372 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:04.683320    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:56:04.683869 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:04.683440    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:56:04.683869 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:04.683513    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs podName:9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:36.683494202 +0000 UTC m=+66.187358573 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs") pod "network-metrics-daemon-9z5fc" (UID: "9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 12:56:04.783985 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:04.783952    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq65l\" (UniqueName: \"kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l\") pod \"network-check-target-nptkm\" (UID: \"3231ae02-4b42-43a9-b965-ccb5d9ec2a5a\") " pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:56:04.784197 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:04.784049    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:56:04.784197 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:04.784140    2547 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 12:56:04.784197 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:04.784193    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret podName:12361050-54a2-4987-83d0-263ddf62cd5a nodeName:}" failed. No retries permitted until 2026-09-11 12:56:36.784179921 +0000 UTC m=+66.288044292 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret") pod "global-pull-secret-syncer-m2zq6" (UID: "12361050-54a2-4987-83d0-263ddf62cd5a") : object "kube-system"/"original-pull-secret" not registered
Sep 11 12:56:04.784359 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:04.784142    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 12:56:04.784359 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:04.784243    2547 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 12:56:04.784359 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:04.784257    2547 projected.go:196] Error preparing data for projected volume kube-api-access-fq65l for pod openshift-network-diagnostics/network-check-target-nptkm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:56:04.784359 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:04.784320    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l podName:3231ae02-4b42-43a9-b965-ccb5d9ec2a5a nodeName:}" failed. No retries permitted until 2026-09-11 12:56:36.784284311 +0000 UTC m=+66.288148698 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fq65l" (UniqueName: "kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l") pod "network-check-target-nptkm" (UID: "3231ae02-4b42-43a9-b965-ccb5d9ec2a5a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 12:56:06.000593 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.000559    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:56:06.001085 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.000559    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:56:06.001085 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:06.000688    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nptkm" podUID="3231ae02-4b42-43a9-b965-ccb5d9ec2a5a"
Sep 11 12:56:06.001085 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:06.000780    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9z5fc" podUID="9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072"
Sep 11 12:56:06.001085 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.000559    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:56:06.001085 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:06.000875    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m2zq6" podUID="12361050-54a2-4987-83d0-263ddf62cd5a"
Sep 11 12:56:06.334935 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.334902    2547 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-110.ec2.internal" event="NodeReady"
Sep 11 12:56:06.335120 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.335067    2547 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 12:56:06.369801 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.369761    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-865f5f9d77-twb4l"]
Sep 11 12:56:06.402634 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.402570    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf"]
Sep 11 12:56:06.402828 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.402708    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.405706 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.405450    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 12:56:06.405706 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.405602    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 12:56:06.405706 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.405610    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 12:56:06.405965 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.405892    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g4h6z\""
Sep 11 12:56:06.411304 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.411270    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 12:56:06.415996 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.415974    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"]
Sep 11 12:56:06.416118 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.416101    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf"
Sep 11 12:56:06.418371 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.418354    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-55fzn\""
Sep 11 12:56:06.418770 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.418753    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 12:56:06.418876 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.418795    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 11 12:56:06.419076 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.419048    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 12:56:06.419277 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.419259    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 12:56:06.427982 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.427962    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"]
Sep 11 12:56:06.428089 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.428079    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"
Sep 11 12:56:06.430691 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.430668    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 11 12:56:06.450062 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.450037    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf"]
Sep 11 12:56:06.450202 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.450069    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-68ddt"]
Sep 11 12:56:06.450202 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.450180    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.453053 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.453030    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 11 12:56:06.453227 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.453203    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 11 12:56:06.453334 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.453263    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 11 12:56:06.453334 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.453203    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 11 12:56:06.474313 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.474286    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-865f5f9d77-twb4l"]
Sep 11 12:56:06.474313 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.474318    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"]
Sep 11 12:56:06.474490 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.474341    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-f59v4"]
Sep 11 12:56:06.474490 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.474369    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:06.477734 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.477687    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 12:56:06.477734 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.477710    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 12:56:06.477734 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.477692    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l85nk\""
Sep 11 12:56:06.490280 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.490247    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-68ddt"]
Sep 11 12:56:06.490394 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.490293    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f59v4"]
Sep 11 12:56:06.490394 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.490318    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"]
Sep 11 12:56:06.490493 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.490417    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f59v4"
Sep 11 12:56:06.493137 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.493108    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 12:56:06.493137 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.493125    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pwbps\""
Sep 11 12:56:06.493306 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.493148    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 12:56:06.493433 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.493411    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 12:56:06.495959 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.495932    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13d37dae-b611-4d61-a247-1761a5553a5c-installation-pull-secrets\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.496070 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.495992    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6vb7\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-kube-api-access-s6vb7\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.496070 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.496019    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13d37dae-b611-4d61-a247-1761a5553a5c-image-registry-private-configuration\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.496070 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.496045    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13d37dae-b611-4d61-a247-1761a5553a5c-trusted-ca\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.496214 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.496083    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-bound-sa-token\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.496214 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.496147    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.496299 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.496222    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13d37dae-b611-4d61-a247-1761a5553a5c-ca-trust-extracted\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.496299 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.496248    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13d37dae-b611-4d61-a247-1761a5553a5c-registry-certificates\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.597536 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.597443    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14644362-0ebc-486e-b75d-127b491737de-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.597536 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.597483    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13d37dae-b611-4d61-a247-1761a5553a5c-image-registry-private-configuration\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.597536 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.597507    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13d37dae-b611-4d61-a247-1761a5553a5c-trusted-ca\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.597843 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.597564    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/14644362-0ebc-486e-b75d-127b491737de-additional-service-ca\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.597843 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.597604    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcbcg\" (UniqueName: \"kubernetes.io/projected/049cc9ba-127f-4cde-9961-856217c1a61a-kube-api-access-bcbcg\") pod \"ingress-canary-f59v4\" (UID: \"049cc9ba-127f-4cde-9961-856217c1a61a\") " pod="openshift-ingress-canary/ingress-canary-f59v4"
Sep 11 12:56:06.597843 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.597646    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05866b42-18a5-4beb-8cf6-9a7ea50083e6-config-volume\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:06.597843 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.597668    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05866b42-18a5-4beb-8cf6-9a7ea50083e6-tmp-dir\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:06.597843 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.597700    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/14644362-0ebc-486e-b75d-127b491737de-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.597843 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.597769    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-bound-sa-token\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.597843 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.597789    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:06.597843 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.597809    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzl7n\" (UniqueName: \"kubernetes.io/projected/14644362-0ebc-486e-b75d-127b491737de-kube-api-access-jzl7n\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.597843 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.597832    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/049cc9ba-127f-4cde-9961-856217c1a61a-cert\") pod \"ingress-canary-f59v4\" (UID: \"049cc9ba-127f-4cde-9961-856217c1a61a\") " pod="openshift-ingress-canary/ingress-canary-f59v4"
Sep 11 12:56:06.598274 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.597888    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.598274 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:06.597989    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:56:06.598274 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:06.598005    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f5f9d77-twb4l: secret "image-registry-tls" not found
Sep 11 12:56:06.598274 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:06.598072    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls podName:13d37dae-b611-4d61-a247-1761a5553a5c nodeName:}" failed. No retries permitted until 2026-09-11 12:56:07.098051158 +0000 UTC m=+36.601915528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls") pod "image-registry-865f5f9d77-twb4l" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c") : secret "image-registry-tls" not found
Sep 11 12:56:06.598274 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598003    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e0f925b-609f-4a2e-9f99-c717291f67f8-tmp\") pod \"klusterlet-addon-workmgr-5555b4db4d-blkbt\" (UID: \"1e0f925b-609f-4a2e-9f99-c717291f67f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"
Sep 11 12:56:06.598274 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598109    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/14644362-0ebc-486e-b75d-127b491737de-ca\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.598274 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598142    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1e0f925b-609f-4a2e-9f99-c717291f67f8-klusterlet-config\") pod \"klusterlet-addon-workmgr-5555b4db4d-blkbt\" (UID: \"1e0f925b-609f-4a2e-9f99-c717291f67f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"
Sep 11 12:56:06.598274 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598171    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2djtn\" (UniqueName: \"kubernetes.io/projected/1e0f925b-609f-4a2e-9f99-c717291f67f8-kube-api-access-2djtn\") pod \"klusterlet-addon-workmgr-5555b4db4d-blkbt\" (UID: \"1e0f925b-609f-4a2e-9f99-c717291f67f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"
Sep 11 12:56:06.598274 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598204    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4xdt\" (UniqueName: \"kubernetes.io/projected/05866b42-18a5-4beb-8cf6-9a7ea50083e6-kube-api-access-g4xdt\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:06.598274 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598251    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/14644362-0ebc-486e-b75d-127b491737de-hub\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.598780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598335    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13d37dae-b611-4d61-a247-1761a5553a5c-ca-trust-extracted\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.598780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598355    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13d37dae-b611-4d61-a247-1761a5553a5c-registry-certificates\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.598780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598380    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13d37dae-b611-4d61-a247-1761a5553a5c-installation-pull-secrets\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.598780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598415    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92s74\" (UniqueName: \"kubernetes.io/projected/3cf45fc5-fcea-444a-bb8e-b02dabec1751-kube-api-access-92s74\") pod \"managed-serviceaccount-addon-agent-6d4647cb68-2jztf\" (UID: \"3cf45fc5-fcea-444a-bb8e-b02dabec1751\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf"
Sep 11 12:56:06.598780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598457    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6vb7\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-kube-api-access-s6vb7\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.598780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598480    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3cf45fc5-fcea-444a-bb8e-b02dabec1751-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d4647cb68-2jztf\" (UID: \"3cf45fc5-fcea-444a-bb8e-b02dabec1751\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf"
Sep 11 12:56:06.598780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598527    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13d37dae-b611-4d61-a247-1761a5553a5c-trusted-ca\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.598780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598692    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13d37dae-b611-4d61-a247-1761a5553a5c-ca-trust-extracted\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.599176 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.598859    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13d37dae-b611-4d61-a247-1761a5553a5c-registry-certificates\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.602390 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.602368    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13d37dae-b611-4d61-a247-1761a5553a5c-installation-pull-secrets\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.602390 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.602386    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13d37dae-b611-4d61-a247-1761a5553a5c-image-registry-private-configuration\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.607470 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.607432    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-bound-sa-token\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.607835 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.607813    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6vb7\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-kube-api-access-s6vb7\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:06.698847 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.698806    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzl7n\" (UniqueName: \"kubernetes.io/projected/14644362-0ebc-486e-b75d-127b491737de-kube-api-access-jzl7n\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.699032 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.698859    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/049cc9ba-127f-4cde-9961-856217c1a61a-cert\") pod \"ingress-canary-f59v4\" (UID: \"049cc9ba-127f-4cde-9961-856217c1a61a\") " pod="openshift-ingress-canary/ingress-canary-f59v4"
Sep 11 12:56:06.699032 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.698901    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e0f925b-609f-4a2e-9f99-c717291f67f8-tmp\") pod \"klusterlet-addon-workmgr-5555b4db4d-blkbt\" (UID: \"1e0f925b-609f-4a2e-9f99-c717291f67f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"
Sep 11 12:56:06.699032 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.698928    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/14644362-0ebc-486e-b75d-127b491737de-ca\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.699032 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.698956    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1e0f925b-609f-4a2e-9f99-c717291f67f8-klusterlet-config\") pod \"klusterlet-addon-workmgr-5555b4db4d-blkbt\" (UID: \"1e0f925b-609f-4a2e-9f99-c717291f67f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"
Sep 11 12:56:06.699032 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.698982    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2djtn\" (UniqueName: \"kubernetes.io/projected/1e0f925b-609f-4a2e-9f99-c717291f67f8-kube-api-access-2djtn\") pod \"klusterlet-addon-workmgr-5555b4db4d-blkbt\" (UID: \"1e0f925b-609f-4a2e-9f99-c717291f67f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"
Sep 11 12:56:06.699032 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.699009    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4xdt\" (UniqueName: \"kubernetes.io/projected/05866b42-18a5-4beb-8cf6-9a7ea50083e6-kube-api-access-g4xdt\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:06.699350 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.699048    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/14644362-0ebc-486e-b75d-127b491737de-hub\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.699350 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.699104    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92s74\" (UniqueName: \"kubernetes.io/projected/3cf45fc5-fcea-444a-bb8e-b02dabec1751-kube-api-access-92s74\") pod \"managed-serviceaccount-addon-agent-6d4647cb68-2jztf\" (UID: \"3cf45fc5-fcea-444a-bb8e-b02dabec1751\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf"
Sep 11 12:56:06.699350 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.699183    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3cf45fc5-fcea-444a-bb8e-b02dabec1751-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d4647cb68-2jztf\" (UID: \"3cf45fc5-fcea-444a-bb8e-b02dabec1751\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf"
Sep 11 12:56:06.699350 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.699214    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14644362-0ebc-486e-b75d-127b491737de-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.699350 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.699246    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/14644362-0ebc-486e-b75d-127b491737de-additional-service-ca\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.699350 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.699274    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcbcg\" (UniqueName: \"kubernetes.io/projected/049cc9ba-127f-4cde-9961-856217c1a61a-kube-api-access-bcbcg\") pod \"ingress-canary-f59v4\" (UID: \"049cc9ba-127f-4cde-9961-856217c1a61a\") " pod="openshift-ingress-canary/ingress-canary-f59v4"
Sep 11 12:56:06.699350 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.699299    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05866b42-18a5-4beb-8cf6-9a7ea50083e6-config-volume\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:06.699350 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.699322    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05866b42-18a5-4beb-8cf6-9a7ea50083e6-tmp-dir\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:06.699350 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.699349    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/14644362-0ebc-486e-b75d-127b491737de-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.699817 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.699378    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e0f925b-609f-4a2e-9f99-c717291f67f8-tmp\") pod \"klusterlet-addon-workmgr-5555b4db4d-blkbt\" (UID: \"1e0f925b-609f-4a2e-9f99-c717291f67f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"
Sep 11 12:56:06.699817 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.699405    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:06.699817 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:06.699509    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:56:06.699817 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:06.699564    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls podName:05866b42-18a5-4beb-8cf6-9a7ea50083e6 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:07.199546268 +0000 UTC m=+36.703410653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls") pod "dns-default-68ddt" (UID: "05866b42-18a5-4beb-8cf6-9a7ea50083e6") : secret "dns-default-metrics-tls" not found
Sep 11 12:56:06.699817 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.699665    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05866b42-18a5-4beb-8cf6-9a7ea50083e6-tmp-dir\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:06.700318 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.700248    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05866b42-18a5-4beb-8cf6-9a7ea50083e6-config-volume\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:06.700454 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.700423    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/14644362-0ebc-486e-b75d-127b491737de-additional-service-ca\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.702478 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.702434    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/14644362-0ebc-486e-b75d-127b491737de-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.702639 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.702616    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/14644362-0ebc-486e-b75d-127b491737de-hub\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.702701 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.702621    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/14644362-0ebc-486e-b75d-127b491737de-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.702819 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.702799    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/14644362-0ebc-486e-b75d-127b491737de-ca\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.702954 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.702929    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1e0f925b-609f-4a2e-9f99-c717291f67f8-klusterlet-config\") pod \"klusterlet-addon-workmgr-5555b4db4d-blkbt\" (UID: \"1e0f925b-609f-4a2e-9f99-c717291f67f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"
Sep 11 12:56:06.703233 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.703215    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/049cc9ba-127f-4cde-9961-856217c1a61a-cert\") pod \"ingress-canary-f59v4\" (UID: \"049cc9ba-127f-4cde-9961-856217c1a61a\") " pod="openshift-ingress-canary/ingress-canary-f59v4"
Sep 11 12:56:06.704318 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.704287    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3cf45fc5-fcea-444a-bb8e-b02dabec1751-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6d4647cb68-2jztf\" (UID: \"3cf45fc5-fcea-444a-bb8e-b02dabec1751\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf"
Sep 11 12:56:06.708962 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.708859    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2djtn\" (UniqueName: \"kubernetes.io/projected/1e0f925b-609f-4a2e-9f99-c717291f67f8-kube-api-access-2djtn\") pod \"klusterlet-addon-workmgr-5555b4db4d-blkbt\" (UID: \"1e0f925b-609f-4a2e-9f99-c717291f67f8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"
Sep 11 12:56:06.709165 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.709138    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzl7n\" (UniqueName: \"kubernetes.io/projected/14644362-0ebc-486e-b75d-127b491737de-kube-api-access-jzl7n\") pod \"cluster-proxy-proxy-agent-db4895496-s9wfx\" (UID: \"14644362-0ebc-486e-b75d-127b491737de\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.709695 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.709674    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcbcg\" (UniqueName: \"kubernetes.io/projected/049cc9ba-127f-4cde-9961-856217c1a61a-kube-api-access-bcbcg\") pod \"ingress-canary-f59v4\" (UID: \"049cc9ba-127f-4cde-9961-856217c1a61a\") " pod="openshift-ingress-canary/ingress-canary-f59v4"
Sep 11 12:56:06.710105 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.710083    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92s74\" (UniqueName: \"kubernetes.io/projected/3cf45fc5-fcea-444a-bb8e-b02dabec1751-kube-api-access-92s74\") pod \"managed-serviceaccount-addon-agent-6d4647cb68-2jztf\" (UID: \"3cf45fc5-fcea-444a-bb8e-b02dabec1751\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf"
Sep 11 12:56:06.710333 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.710317    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4xdt\" (UniqueName: \"kubernetes.io/projected/05866b42-18a5-4beb-8cf6-9a7ea50083e6-kube-api-access-g4xdt\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:06.737568 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.737530    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf"
Sep 11 12:56:06.747700 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.747670    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"
Sep 11 12:56:06.759859 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.759832    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:56:06.800949 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:06.800925    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-f59v4"
Sep 11 12:56:07.104163 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:07.103983    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:07.104163 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:07.104162    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:56:07.104635 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:07.104184    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f5f9d77-twb4l: secret "image-registry-tls" not found
Sep 11 12:56:07.104635 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:07.104251    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls podName:13d37dae-b611-4d61-a247-1761a5553a5c nodeName:}" failed. No retries permitted until 2026-09-11 12:56:08.104231378 +0000 UTC m=+37.608095769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls") pod "image-registry-865f5f9d77-twb4l" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c") : secret "image-registry-tls" not found
Sep 11 12:56:07.205523 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:07.205494    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:07.205687 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:07.205607    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:56:07.205687 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:07.205670    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls podName:05866b42-18a5-4beb-8cf6-9a7ea50083e6 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:08.205654669 +0000 UTC m=+37.709519057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls") pod "dns-default-68ddt" (UID: "05866b42-18a5-4beb-8cf6-9a7ea50083e6") : secret "dns-default-metrics-tls" not found
Sep 11 12:56:07.391127 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:07.391027    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf"]
Sep 11 12:56:07.392101 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:07.392080    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"]
Sep 11 12:56:07.392741 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:07.392709    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-f59v4"]
Sep 11 12:56:07.393385 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:07.393366    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"]
Sep 11 12:56:07.403239 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:56:07.403215    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod049cc9ba_127f_4cde_9961_856217c1a61a.slice/crio-600cb1fb062b408e5b50bd32216f7353de42819c8c3ed62096d697b15b5fdb6f WatchSource:0}: Error finding container 600cb1fb062b408e5b50bd32216f7353de42819c8c3ed62096d697b15b5fdb6f: Status 404 returned error can't find the container with id 600cb1fb062b408e5b50bd32216f7353de42819c8c3ed62096d697b15b5fdb6f
Sep 11 12:56:07.403597 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:56:07.403575    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e0f925b_609f_4a2e_9f99_c717291f67f8.slice/crio-09e81546646bbadedd36efce46e7467be01ed4b6e761bd55bfb4c63587517640 WatchSource:0}: Error finding container 09e81546646bbadedd36efce46e7467be01ed4b6e761bd55bfb4c63587517640: Status 404 returned error can't find the container with id 09e81546646bbadedd36efce46e7467be01ed4b6e761bd55bfb4c63587517640
Sep 11 12:56:07.404417 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:56:07.404388    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14644362_0ebc_486e_b75d_127b491737de.slice/crio-06396f30f7d16ea97e7a42b74c063fb71c8f450a80b23d7817726fc4887b4143 WatchSource:0}: Error finding container 06396f30f7d16ea97e7a42b74c063fb71c8f450a80b23d7817726fc4887b4143: Status 404 returned error can't find the container with id 06396f30f7d16ea97e7a42b74c063fb71c8f450a80b23d7817726fc4887b4143
Sep 11 12:56:07.404953 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:56:07.404933    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cf45fc5_fcea_444a_bb8e_b02dabec1751.slice/crio-c3786650f3495958ee16657dd789e5e3cfe09d7b8da82dbf11b360f68499f093 WatchSource:0}: Error finding container c3786650f3495958ee16657dd789e5e3cfe09d7b8da82dbf11b360f68499f093: Status 404 returned error can't find the container with id c3786650f3495958ee16657dd789e5e3cfe09d7b8da82dbf11b360f68499f093
Sep 11 12:56:08.001539 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.001473    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:56:08.002398 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.001850    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:56:08.002398 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.002087    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:56:08.004231 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.004181    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 12:56:08.004943 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.004893    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 12:56:08.005039 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.004961    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 12:56:08.005344 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.005144    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7r4pp\""
Sep 11 12:56:08.005344 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.005209    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 12:56:08.005344 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.005303    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w7fbx\""
Sep 11 12:56:08.115158 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.115115    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:08.115890 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:08.115317    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:56:08.115890 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:08.115342    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f5f9d77-twb4l: secret "image-registry-tls" not found
Sep 11 12:56:08.115890 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:08.115467    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls podName:13d37dae-b611-4d61-a247-1761a5553a5c nodeName:}" failed. No retries permitted until 2026-09-11 12:56:10.115443602 +0000 UTC m=+39.619307989 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls") pod "image-registry-865f5f9d77-twb4l" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c") : secret "image-registry-tls" not found
Sep 11 12:56:08.141451 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.141375    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf" event={"ID":"3cf45fc5-fcea-444a-bb8e-b02dabec1751","Type":"ContainerStarted","Data":"c3786650f3495958ee16657dd789e5e3cfe09d7b8da82dbf11b360f68499f093"}
Sep 11 12:56:08.143006 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.142976    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f59v4" event={"ID":"049cc9ba-127f-4cde-9961-856217c1a61a","Type":"ContainerStarted","Data":"600cb1fb062b408e5b50bd32216f7353de42819c8c3ed62096d697b15b5fdb6f"}
Sep 11 12:56:08.146964 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.146934    2547 generic.go:356] "Generic (PLEG): container finished" podID="5d629522-32b6-4843-860f-cda119288ed7" containerID="12eed40052de02a08702b70f4df75b5af4d87536caf3641673dd48a41f612fb5" exitCode=0
Sep 11 12:56:08.147096 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.147016    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kmqq" event={"ID":"5d629522-32b6-4843-860f-cda119288ed7","Type":"ContainerDied","Data":"12eed40052de02a08702b70f4df75b5af4d87536caf3641673dd48a41f612fb5"}
Sep 11 12:56:08.149885 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.149848    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt" event={"ID":"1e0f925b-609f-4a2e-9f99-c717291f67f8","Type":"ContainerStarted","Data":"09e81546646bbadedd36efce46e7467be01ed4b6e761bd55bfb4c63587517640"}
Sep 11 12:56:08.152029 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.152000    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx" event={"ID":"14644362-0ebc-486e-b75d-127b491737de","Type":"ContainerStarted","Data":"06396f30f7d16ea97e7a42b74c063fb71c8f450a80b23d7817726fc4887b4143"}
Sep 11 12:56:08.217239 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:08.216554    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:08.217239 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:08.216693    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:56:08.217239 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:08.216818    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls podName:05866b42-18a5-4beb-8cf6-9a7ea50083e6 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:10.216798029 +0000 UTC m=+39.720662416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls") pod "dns-default-68ddt" (UID: "05866b42-18a5-4beb-8cf6-9a7ea50083e6") : secret "dns-default-metrics-tls" not found
Sep 11 12:56:09.167036 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:09.166999    2547 generic.go:356] "Generic (PLEG): container finished" podID="5d629522-32b6-4843-860f-cda119288ed7" containerID="0f33ada1f205b256ba1fb4a9cd3a647b4366dafdf66e983c66af62ab60e43fc5" exitCode=0
Sep 11 12:56:09.167550 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:09.167071    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kmqq" event={"ID":"5d629522-32b6-4843-860f-cda119288ed7","Type":"ContainerDied","Data":"0f33ada1f205b256ba1fb4a9cd3a647b4366dafdf66e983c66af62ab60e43fc5"}
Sep 11 12:56:10.134667 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:10.133873    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:10.134667 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:10.134149    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:56:10.134667 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:10.134166    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f5f9d77-twb4l: secret "image-registry-tls" not found
Sep 11 12:56:10.134667 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:10.134225    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls podName:13d37dae-b611-4d61-a247-1761a5553a5c nodeName:}" failed. No retries permitted until 2026-09-11 12:56:14.134205832 +0000 UTC m=+43.638070221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls") pod "image-registry-865f5f9d77-twb4l" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c") : secret "image-registry-tls" not found
Sep 11 12:56:10.177431 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:10.177358    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9kmqq" event={"ID":"5d629522-32b6-4843-860f-cda119288ed7","Type":"ContainerStarted","Data":"0ec6fa4f701969f1c01ea76c8dded8017f9258e3692a307cd0474e56f56e6abf"}
Sep 11 12:56:10.201093 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:10.201039    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9kmqq" podStartSLOduration=7.541090293 podStartE2EDuration="38.201015213s" totalImagesPullingTime="30.65992492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:10.200503966 +0000 UTC m=+39.704368390" watchObservedRunningTime="2026-09-11 12:56:10.201015213 +0000 UTC m=+39.704879609"
Sep 11 12:56:10.234891 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:10.234857    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:10.235321 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:10.235299    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:56:10.235426 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:10.235369    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls podName:05866b42-18a5-4beb-8cf6-9a7ea50083e6 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:14.235349733 +0000 UTC m=+43.739214117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls") pod "dns-default-68ddt" (UID: "05866b42-18a5-4beb-8cf6-9a7ea50083e6") : secret "dns-default-metrics-tls" not found
Sep 11 12:56:14.163460 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:14.163376    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:14.163827 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:14.163516    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:56:14.163827 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:14.163537    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f5f9d77-twb4l: secret "image-registry-tls" not found
Sep 11 12:56:14.163827 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:14.163591    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls podName:13d37dae-b611-4d61-a247-1761a5553a5c nodeName:}" failed. No retries permitted until 2026-09-11 12:56:22.163576528 +0000 UTC m=+51.667440914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls") pod "image-registry-865f5f9d77-twb4l" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c") : secret "image-registry-tls" not found
Sep 11 12:56:14.264136 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:14.264105    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:14.264290 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:14.264237    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:56:14.264327 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:14.264296    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls podName:05866b42-18a5-4beb-8cf6-9a7ea50083e6 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:22.264281087 +0000 UTC m=+51.768145458 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls") pod "dns-default-68ddt" (UID: "05866b42-18a5-4beb-8cf6-9a7ea50083e6") : secret "dns-default-metrics-tls" not found
Sep 11 12:56:17.197816 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:17.197779    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt" event={"ID":"1e0f925b-609f-4a2e-9f99-c717291f67f8","Type":"ContainerStarted","Data":"6f9ca238ef884dcfe08d418802f47c630c2d2e19605b53d19c80582d8c233f48"}
Sep 11 12:56:17.198385 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:17.197978    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"
Sep 11 12:56:17.199940 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:17.199920    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt"
Sep 11 12:56:17.200288 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:17.200266    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx" event={"ID":"14644362-0ebc-486e-b75d-127b491737de","Type":"ContainerStarted","Data":"f63cc6caea9f25e7fed33a86b8c1c81ad2b6ecc317a1e9cac24ceba9b44e07a1"}
Sep 11 12:56:17.200347 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:17.200298    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx" event={"ID":"14644362-0ebc-486e-b75d-127b491737de","Type":"ContainerStarted","Data":"54a8c483c64dea9ee41401abe25ee0b9bd52e4fc066740f4e44e0d2001233588"}
Sep 11 12:56:17.200347 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:17.200310    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx" event={"ID":"14644362-0ebc-486e-b75d-127b491737de","Type":"ContainerStarted","Data":"f8e87acd5e9185ff8ced60c597cbd7ffae77921c808b22332b99db67d582df4a"}
Sep 11 12:56:17.201665 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:17.201639    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf" event={"ID":"3cf45fc5-fcea-444a-bb8e-b02dabec1751","Type":"ContainerStarted","Data":"a32afa5eedbe27db47ab2d125249c90bc52516163800e91261991e38229ad266"}
Sep 11 12:56:17.202929 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:17.202910    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-f59v4" event={"ID":"049cc9ba-127f-4cde-9961-856217c1a61a","Type":"ContainerStarted","Data":"6714fabbc15d4685cfff9384d1029abaa3abff1f17ddb6b39aaf3b39abe5a2ec"}
Sep 11 12:56:17.221729 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:17.221682    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5555b4db4d-blkbt" podStartSLOduration=23.342581894 podStartE2EDuration="32.221671943s" totalImagesPullingTime="8.879090049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:17.221639302 +0000 UTC m=+46.725503697" watchObservedRunningTime="2026-09-11 12:56:17.221671943 +0000 UTC m=+46.725536337"
Sep 11 12:56:17.246225 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:17.246176    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx" podStartSLOduration=23.380826376 podStartE2EDuration="32.24616707s" totalImagesPullingTime="8.865340694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:17.245275864 +0000 UTC m=+46.749140256" watchObservedRunningTime="2026-09-11 12:56:17.24616707 +0000 UTC m=+46.750031499"
Sep 11 12:56:17.264339 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:17.264301    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-f59v4" podStartSLOduration=2.398509609 podStartE2EDuration="11.264289081s" totalImagesPullingTime="8.865779472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:17.263991987 +0000 UTC m=+46.767856381" watchObservedRunningTime="2026-09-11 12:56:17.264289081 +0000 UTC m=+46.768153474"
Sep 11 12:56:17.328631 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:17.328583    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6d4647cb68-2jztf" podStartSLOduration=23.463916125 podStartE2EDuration="32.328565629s" totalImagesPullingTime="8.864649504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:17.328392323 +0000 UTC m=+46.832256708" watchObservedRunningTime="2026-09-11 12:56:17.328565629 +0000 UTC m=+46.832430017"
Sep 11 12:56:22.218877 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.218844    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:22.219283 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:22.218951    2547 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 12:56:22.219283 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:22.218963    2547 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-865f5f9d77-twb4l: secret "image-registry-tls" not found
Sep 11 12:56:22.219283 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:22.219020    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls podName:13d37dae-b611-4d61-a247-1761a5553a5c nodeName:}" failed. No retries permitted until 2026-09-11 12:56:38.219002036 +0000 UTC m=+67.722866408 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls") pod "image-registry-865f5f9d77-twb4l" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c") : secret "image-registry-tls" not found
Sep 11 12:56:22.319331 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.319296    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:22.319474 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:22.319430    2547 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 12:56:22.319513 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:22.319497    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls podName:05866b42-18a5-4beb-8cf6-9a7ea50083e6 nodeName:}" failed. No retries permitted until 2026-09-11 12:56:38.319484106 +0000 UTC m=+67.823348481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls") pod "dns-default-68ddt" (UID: "05866b42-18a5-4beb-8cf6-9a7ea50083e6") : secret "dns-default-metrics-tls" not found
Sep 11 12:56:22.888257 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.888225    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-74tx7"]
Sep 11 12:56:22.891255 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.891238    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:22.893584 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.893561    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 12:56:22.893753 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.893738    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 12:56:22.894510 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.894492    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-22vc9\""
Sep 11 12:56:22.894588 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.894516    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 12:56:22.894588 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.894574    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 12:56:22.906381 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.906360    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-74tx7"]
Sep 11 12:56:22.923056 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.923025    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:22.923160 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.923071    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57btn\" (UniqueName: \"kubernetes.io/projected/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-api-access-57btn\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:22.923160 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.923107    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6441d0e-9963-4fc5-96ed-639510ad48cc-crio-socket\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:22.923160 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.923132    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:22.923316 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:22.923167    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6441d0e-9963-4fc5-96ed-639510ad48cc-data-volume\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:23.024422 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:23.024396    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:23.024575 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:23.024429    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57btn\" (UniqueName: \"kubernetes.io/projected/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-api-access-57btn\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:23.024575 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:23.024452    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6441d0e-9963-4fc5-96ed-639510ad48cc-crio-socket\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:23.024575 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:23.024515    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6441d0e-9963-4fc5-96ed-639510ad48cc-crio-socket\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:23.024575 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:23.024543    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:23.024575 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:23.024564    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:23.024782 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:23.024606    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls podName:c6441d0e-9963-4fc5-96ed-639510ad48cc nodeName:}" failed. No retries permitted until 2026-09-11 12:56:23.524591233 +0000 UTC m=+53.028455604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74tx7" (UID: "c6441d0e-9963-4fc5-96ed-639510ad48cc") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:23.024782 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:23.024625    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6441d0e-9963-4fc5-96ed-639510ad48cc-data-volume\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:23.024782 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:23.024635    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:56:23.024782 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:23.024694    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm podName:c6441d0e-9963-4fc5-96ed-639510ad48cc nodeName:}" failed. No retries permitted until 2026-09-11 12:56:23.524680037 +0000 UTC m=+53.028544411 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74tx7" (UID: "c6441d0e-9963-4fc5-96ed-639510ad48cc") : configmap "kube-rbac-proxy" not found
Sep 11 12:56:23.024979 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:23.024962    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6441d0e-9963-4fc5-96ed-639510ad48cc-data-volume\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:23.033865 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:23.033847    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57btn\" (UniqueName: \"kubernetes.io/projected/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-api-access-57btn\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:23.528778 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:23.528747    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:23.529187 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:23.528788    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:23.529187 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:23.528890    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:56:23.529187 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:23.528907    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:23.529187 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:23.528941    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm podName:c6441d0e-9963-4fc5-96ed-639510ad48cc nodeName:}" failed. No retries permitted until 2026-09-11 12:56:24.528927646 +0000 UTC m=+54.032792017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74tx7" (UID: "c6441d0e-9963-4fc5-96ed-639510ad48cc") : configmap "kube-rbac-proxy" not found
Sep 11 12:56:23.529187 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:23.528970    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls podName:c6441d0e-9963-4fc5-96ed-639510ad48cc nodeName:}" failed. No retries permitted until 2026-09-11 12:56:24.528956851 +0000 UTC m=+54.032821221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74tx7" (UID: "c6441d0e-9963-4fc5-96ed-639510ad48cc") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:24.535807 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:24.535775    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:24.535807 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:24.535817    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:24.536277 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:24.535969    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:24.536277 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:24.536039    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls podName:c6441d0e-9963-4fc5-96ed-639510ad48cc nodeName:}" failed. No retries permitted until 2026-09-11 12:56:26.536021473 +0000 UTC m=+56.039885867 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74tx7" (UID: "c6441d0e-9963-4fc5-96ed-639510ad48cc") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:24.536277 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:24.536045    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:56:24.536277 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:24.536108    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm podName:c6441d0e-9963-4fc5-96ed-639510ad48cc nodeName:}" failed. No retries permitted until 2026-09-11 12:56:26.5360927 +0000 UTC m=+56.039957071 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74tx7" (UID: "c6441d0e-9963-4fc5-96ed-639510ad48cc") : configmap "kube-rbac-proxy" not found
Sep 11 12:56:25.851658 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:25.851631    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bvm24_72410b07-acd7-4753-8fee-61e094f12b5f/dns-node-resolver/0.log"
Sep 11 12:56:26.454003 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:26.453974    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cb8qd_125564ba-2933-414e-843b-5e36e5a55ebe/node-ca/0.log"
Sep 11 12:56:26.550399 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:26.550367    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:26.550544 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:26.550416    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:26.550544 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:26.550521    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:26.550609 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:26.550553    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:56:26.550609 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:26.550579    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls podName:c6441d0e-9963-4fc5-96ed-639510ad48cc nodeName:}" failed. No retries permitted until 2026-09-11 12:56:30.55056266 +0000 UTC m=+60.054427034 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74tx7" (UID: "c6441d0e-9963-4fc5-96ed-639510ad48cc") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:26.550609 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:26.550604    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm podName:c6441d0e-9963-4fc5-96ed-639510ad48cc nodeName:}" failed. No retries permitted until 2026-09-11 12:56:30.550590126 +0000 UTC m=+60.054454496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74tx7" (UID: "c6441d0e-9963-4fc5-96ed-639510ad48cc") : configmap "kube-rbac-proxy" not found
Sep 11 12:56:27.455150 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:27.455122    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f59v4_049cc9ba-127f-4cde-9961-856217c1a61a/serve-healthcheck-canary/0.log"
Sep 11 12:56:30.582287 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:30.582246    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:30.582287 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:30.582294    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:30.582784 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:30.582367    2547 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 12:56:30.582784 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:30.582412    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm podName:c6441d0e-9963-4fc5-96ed-639510ad48cc nodeName:}" failed. No retries permitted until 2026-09-11 12:56:38.582398624 +0000 UTC m=+68.086262995 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74tx7" (UID: "c6441d0e-9963-4fc5-96ed-639510ad48cc") : configmap "kube-rbac-proxy" not found
Sep 11 12:56:30.582784 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:30.582415    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:30.582784 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:30.582485    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls podName:c6441d0e-9963-4fc5-96ed-639510ad48cc nodeName:}" failed. No retries permitted until 2026-09-11 12:56:38.582467281 +0000 UTC m=+68.086331669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74tx7" (UID: "c6441d0e-9963-4fc5-96ed-639510ad48cc") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:32.135795 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:32.135760    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cpcqk"
Sep 11 12:56:36.729982 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:36.729948    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:56:36.732333 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:36.732313    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 12:56:36.740181 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:36.740166    2547 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 12:56:36.740249 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:36.740229    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs podName:9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072 nodeName:}" failed. No retries permitted until 2026-09-11 12:57:40.740214117 +0000 UTC m=+130.244078501 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs") pod "network-metrics-daemon-9z5fc" (UID: "9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072") : secret "metrics-daemon-secret" not found
Sep 11 12:56:36.830257 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:36.830224    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:56:36.830425 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:36.830297    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq65l\" (UniqueName: \"kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l\") pod \"network-check-target-nptkm\" (UID: \"3231ae02-4b42-43a9-b965-ccb5d9ec2a5a\") " pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:56:36.833002 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:36.832976    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 12:56:36.833123 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:36.832999    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 12:56:36.843209 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:36.843189    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12361050-54a2-4987-83d0-263ddf62cd5a-original-pull-secret\") pod \"global-pull-secret-syncer-m2zq6\" (UID: \"12361050-54a2-4987-83d0-263ddf62cd5a\") " pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:56:36.844367 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:36.844353    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 12:56:36.853591 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:36.853571    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq65l\" (UniqueName: \"kubernetes.io/projected/3231ae02-4b42-43a9-b965-ccb5d9ec2a5a-kube-api-access-fq65l\") pod \"network-check-target-nptkm\" (UID: \"3231ae02-4b42-43a9-b965-ccb5d9ec2a5a\") " pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:56:37.126290 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:37.126246    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m2zq6"
Sep 11 12:56:37.142859 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:37.142839    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7r4pp\""
Sep 11 12:56:37.150668 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:37.150643    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:56:37.407548 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:37.407478    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m2zq6"]
Sep 11 12:56:37.410404 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:56:37.410375    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12361050_54a2_4987_83d0_263ddf62cd5a.slice/crio-bc31c0a83bc2ef3d1ce3198acd2618a9645d3b913d8304f3afd13ad8a8fafc45 WatchSource:0}: Error finding container bc31c0a83bc2ef3d1ce3198acd2618a9645d3b913d8304f3afd13ad8a8fafc45: Status 404 returned error can't find the container with id bc31c0a83bc2ef3d1ce3198acd2618a9645d3b913d8304f3afd13ad8a8fafc45
Sep 11 12:56:37.439443 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:37.439422    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nptkm"]
Sep 11 12:56:37.442224 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:56:37.442188    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3231ae02_4b42_43a9_b965_ccb5d9ec2a5a.slice/crio-080acf1960c25bf42a7f370dc9c50d78fc936c89f80764cc5e431a583374c90e WatchSource:0}: Error finding container 080acf1960c25bf42a7f370dc9c50d78fc936c89f80764cc5e431a583374c90e: Status 404 returned error can't find the container with id 080acf1960c25bf42a7f370dc9c50d78fc936c89f80764cc5e431a583374c90e
Sep 11 12:56:38.240512 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.240466    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:38.243918 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.243891    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls\") pod \"image-registry-865f5f9d77-twb4l\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") " pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:38.267255 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.267172    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m2zq6" event={"ID":"12361050-54a2-4987-83d0-263ddf62cd5a","Type":"ContainerStarted","Data":"bc31c0a83bc2ef3d1ce3198acd2618a9645d3b913d8304f3afd13ad8a8fafc45"}
Sep 11 12:56:38.268789 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.268756    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nptkm" event={"ID":"3231ae02-4b42-43a9-b965-ccb5d9ec2a5a","Type":"ContainerStarted","Data":"080acf1960c25bf42a7f370dc9c50d78fc936c89f80764cc5e431a583374c90e"}
Sep 11 12:56:38.341802 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.341765    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:38.344730 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.344692    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05866b42-18a5-4beb-8cf6-9a7ea50083e6-metrics-tls\") pod \"dns-default-68ddt\" (UID: \"05866b42-18a5-4beb-8cf6-9a7ea50083e6\") " pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:38.520112 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.520023    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-g4h6z\""
Sep 11 12:56:38.527819 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.527790    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:38.596313 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.596243    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-l85nk\""
Sep 11 12:56:38.604290 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.603874    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:38.645752 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.645700    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:38.645867 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.645771    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:38.645867 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:38.645849    2547 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:38.645955 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:56:38.645934    2547 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls podName:c6441d0e-9963-4fc5-96ed-639510ad48cc nodeName:}" failed. No retries permitted until 2026-09-11 12:56:54.645912223 +0000 UTC m=+84.149776609 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74tx7" (UID: "c6441d0e-9963-4fc5-96ed-639510ad48cc") : secret "insights-runtime-extractor-tls" not found
Sep 11 12:56:38.646237 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.646190    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6441d0e-9963-4fc5-96ed-639510ad48cc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:38.845282 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.845206    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-865f5f9d77-twb4l"]
Sep 11 12:56:38.850089 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:56:38.850057    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13d37dae_b611_4d61_a247_1761a5553a5c.slice/crio-306c84b8f75fdd7be2ee5e4518d2eaecc7063f910f1f3502d3b27c8248df4d1c WatchSource:0}: Error finding container 306c84b8f75fdd7be2ee5e4518d2eaecc7063f910f1f3502d3b27c8248df4d1c: Status 404 returned error can't find the container with id 306c84b8f75fdd7be2ee5e4518d2eaecc7063f910f1f3502d3b27c8248df4d1c
Sep 11 12:56:38.915738 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:38.915629    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-68ddt"]
Sep 11 12:56:38.923281 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:56:38.923246    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05866b42_18a5_4beb_8cf6_9a7ea50083e6.slice/crio-f53aad5eb8ebe53acd068164f278efea1578d7d7aa301467a03f18257db17d5e WatchSource:0}: Error finding container f53aad5eb8ebe53acd068164f278efea1578d7d7aa301467a03f18257db17d5e: Status 404 returned error can't find the container with id f53aad5eb8ebe53acd068164f278efea1578d7d7aa301467a03f18257db17d5e
Sep 11 12:56:39.273542 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:39.273506    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-68ddt" event={"ID":"05866b42-18a5-4beb-8cf6-9a7ea50083e6","Type":"ContainerStarted","Data":"f53aad5eb8ebe53acd068164f278efea1578d7d7aa301467a03f18257db17d5e"}
Sep 11 12:56:39.275514 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:39.275482    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865f5f9d77-twb4l" event={"ID":"13d37dae-b611-4d61-a247-1761a5553a5c","Type":"ContainerStarted","Data":"3d484818101feb444d952c6b1e7b26f699b858c663229bd43459602cd32df9ff"}
Sep 11 12:56:39.275642 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:39.275537    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865f5f9d77-twb4l" event={"ID":"13d37dae-b611-4d61-a247-1761a5553a5c","Type":"ContainerStarted","Data":"306c84b8f75fdd7be2ee5e4518d2eaecc7063f910f1f3502d3b27c8248df4d1c"}
Sep 11 12:56:39.275702 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:39.275653    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:56:43.291020 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:43.290981    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nptkm" event={"ID":"3231ae02-4b42-43a9-b965-ccb5d9ec2a5a","Type":"ContainerStarted","Data":"08cd2a9573ca67be49619653d862e1fa0615d7f7b6f204f9fffc85cd0552bc6d"}
Sep 11 12:56:43.291469 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:43.291045    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:56:43.292746 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:43.292703    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-68ddt" event={"ID":"05866b42-18a5-4beb-8cf6-9a7ea50083e6","Type":"ContainerStarted","Data":"86c3d830d7836a68b4300fe820cdf2d4614ebf8274367b1b34b4ed739a298f6d"}
Sep 11 12:56:43.292875 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:43.292764    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-68ddt" event={"ID":"05866b42-18a5-4beb-8cf6-9a7ea50083e6","Type":"ContainerStarted","Data":"92ec63f654720cb41c98d2bfc1c947fe7340652d23167a7db6b369dcdd997d5c"}
Sep 11 12:56:43.292875 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:43.292790    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:43.294033 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:43.294013    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m2zq6" event={"ID":"12361050-54a2-4987-83d0-263ddf62cd5a","Type":"ContainerStarted","Data":"afe6ab7a88be1eeb9dc0177ddb3b036932fb78634b6b4d7fc98bfac848748496"}
Sep 11 12:56:43.315427 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:43.315381    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-865f5f9d77-twb4l" podStartSLOduration=50.315365169 podStartE2EDuration="50.315365169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:39.312543015 +0000 UTC m=+68.816407408" watchObservedRunningTime="2026-09-11 12:56:43.315365169 +0000 UTC m=+72.819229563"
Sep 11 12:56:43.315836 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:43.315810    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nptkm" podStartSLOduration=66.441420288 podStartE2EDuration="1m11.315804574s" totalImagesPullingTime="4.874384286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:43.315024743 +0000 UTC m=+72.818889135" watchObservedRunningTime="2026-09-11 12:56:43.315804574 +0000 UTC m=+72.819668966"
Sep 11 12:56:43.336516 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:43.336474    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m2zq6" podStartSLOduration=66.418842509 podStartE2EDuration="1m11.336461769s" totalImagesPullingTime="4.91761926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:43.33524551 +0000 UTC m=+72.839109903" watchObservedRunningTime="2026-09-11 12:56:43.336461769 +0000 UTC m=+72.840326188"
Sep 11 12:56:43.371638 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:43.371590    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-68ddt" podStartSLOduration=33.931844154 podStartE2EDuration="37.37157408s" totalImagesPullingTime="3.439729926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:56:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:43.371317148 +0000 UTC m=+72.875181540" watchObservedRunningTime="2026-09-11 12:56:43.37157408 +0000 UTC m=+72.875438473"
Sep 11 12:56:53.299612 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:53.299503    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-68ddt"
Sep 11 12:56:54.665286 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:54.665227    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:54.667503 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:54.667479    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6441d0e-9963-4fc5-96ed-639510ad48cc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74tx7\" (UID: \"c6441d0e-9963-4fc5-96ed-639510ad48cc\") " pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:54.703594 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:54.703569    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-22vc9\""
Sep 11 12:56:54.711491 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:54.711472    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-74tx7"
Sep 11 12:56:54.981558 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:54.981490    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-74tx7"]
Sep 11 12:56:54.984558 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:56:54.984527    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6441d0e_9963_4fc5_96ed_639510ad48cc.slice/crio-b0dc41a3403eb4e39cb3622d5138786b4f48332dedafdfa286c8f4f2a72a2564 WatchSource:0}: Error finding container b0dc41a3403eb4e39cb3622d5138786b4f48332dedafdfa286c8f4f2a72a2564: Status 404 returned error can't find the container with id b0dc41a3403eb4e39cb3622d5138786b4f48332dedafdfa286c8f4f2a72a2564
Sep 11 12:56:55.332392 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:55.332358    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74tx7" event={"ID":"c6441d0e-9963-4fc5-96ed-639510ad48cc","Type":"ContainerStarted","Data":"1a882dd90fd605c1e4d55a3c2f620e05d2ab6453f8ab7859c534643fc12feab0"}
Sep 11 12:56:55.332550 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:55.332414    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74tx7" event={"ID":"c6441d0e-9963-4fc5-96ed-639510ad48cc","Type":"ContainerStarted","Data":"b0dc41a3403eb4e39cb3622d5138786b4f48332dedafdfa286c8f4f2a72a2564"}
Sep 11 12:56:56.337779 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:56.337747    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74tx7" event={"ID":"c6441d0e-9963-4fc5-96ed-639510ad48cc","Type":"ContainerStarted","Data":"67c4acc15cab8773d5796e0c3a5c5267f168d561bd6ea4d066381f2394f4bd3f"}
Sep 11 12:56:58.347362 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.347328    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74tx7" event={"ID":"c6441d0e-9963-4fc5-96ed-639510ad48cc","Type":"ContainerStarted","Data":"a3c84a3173d63867e50dab242587453cbb8383077600964d83d7daa79f00825f"}
Sep 11 12:56:58.360178 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.360152    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zn57h"]
Sep 11 12:56:58.363160 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.363144    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.366334 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.366313    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 12:56:58.366481 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.366467    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 12:56:58.367498 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.367485    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 12:56:58.367614 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.367597    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4jg94\""
Sep 11 12:56:58.369889 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.369869    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 12:56:58.370358 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.370344    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 12:56:58.379184 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.379170    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 12:56:58.450063 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.450006    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-74tx7" podStartSLOduration=34.118643074 podStartE2EDuration="36.449990002s" totalImagesPullingTime="2.331346928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 12:56:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:56:58.449603877 +0000 UTC m=+87.953468269" watchObservedRunningTime="2026-09-11 12:56:58.449990002 +0000 UTC m=+87.953854395"
Sep 11 12:56:58.494924 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.494891    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb5143b0-e3db-4bab-8521-4302149bbd7b-metrics-client-ca\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.495079 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.494931    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-accelerators-collector-config\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.495079 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.494958    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-wtmp\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.495079 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.495023    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fb5143b0-e3db-4bab-8521-4302149bbd7b-root\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.495079 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.495075    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb5143b0-e3db-4bab-8521-4302149bbd7b-sys\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.495219 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.495096    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-textfile\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.495219 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.495118    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.495219 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.495184    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-tls\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.495219 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.495212    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44cgq\" (UniqueName: \"kubernetes.io/projected/fb5143b0-e3db-4bab-8521-4302149bbd7b-kube-api-access-44cgq\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.595783 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.595737    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.595963 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.595832    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-tls\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.595963 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.595862    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44cgq\" (UniqueName: \"kubernetes.io/projected/fb5143b0-e3db-4bab-8521-4302149bbd7b-kube-api-access-44cgq\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.595963 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.595880    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb5143b0-e3db-4bab-8521-4302149bbd7b-metrics-client-ca\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.596120 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.595997    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-accelerators-collector-config\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.596120 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.596049    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-wtmp\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.596120 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.596082    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fb5143b0-e3db-4bab-8521-4302149bbd7b-root\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.596120 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.596115    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb5143b0-e3db-4bab-8521-4302149bbd7b-sys\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.596320 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.596137    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-textfile\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.596320 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.596227    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fb5143b0-e3db-4bab-8521-4302149bbd7b-root\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.596320 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.596258    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-wtmp\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.596468 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.596317    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb5143b0-e3db-4bab-8521-4302149bbd7b-sys\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.596468 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.596431    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-textfile\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.596590 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.596568    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb5143b0-e3db-4bab-8521-4302149bbd7b-metrics-client-ca\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.596659 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.596640    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-accelerators-collector-config\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.598634 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.598579    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.598747 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.598670    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fb5143b0-e3db-4bab-8521-4302149bbd7b-node-exporter-tls\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.623751 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.623708    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44cgq\" (UniqueName: \"kubernetes.io/projected/fb5143b0-e3db-4bab-8521-4302149bbd7b-kube-api-access-44cgq\") pod \"node-exporter-zn57h\" (UID: \"fb5143b0-e3db-4bab-8521-4302149bbd7b\") " pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.671817 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:58.671796    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zn57h"
Sep 11 12:56:58.682394 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:56:58.682372    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb5143b0_e3db_4bab_8521_4302149bbd7b.slice/crio-eef132eecc38c516877c4a7478dc733488d95454a9a974f5a49c3c286bebc48e WatchSource:0}: Error finding container eef132eecc38c516877c4a7478dc733488d95454a9a974f5a49c3c286bebc48e: Status 404 returned error can't find the container with id eef132eecc38c516877c4a7478dc733488d95454a9a974f5a49c3c286bebc48e
Sep 11 12:56:59.352010 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:56:59.351971    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zn57h" event={"ID":"fb5143b0-e3db-4bab-8521-4302149bbd7b","Type":"ContainerStarted","Data":"eef132eecc38c516877c4a7478dc733488d95454a9a974f5a49c3c286bebc48e"}
Sep 11 12:57:00.283742 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:00.283695    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:57:00.356902 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:00.356869    2547 generic.go:356] "Generic (PLEG): container finished" podID="fb5143b0-e3db-4bab-8521-4302149bbd7b" containerID="b3dda9293e77fbca32638bd430513b2643566400cac91bb0395acd241f13a3e2" exitCode=0
Sep 11 12:57:00.357360 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:00.356937    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zn57h" event={"ID":"fb5143b0-e3db-4bab-8521-4302149bbd7b","Type":"ContainerDied","Data":"b3dda9293e77fbca32638bd430513b2643566400cac91bb0395acd241f13a3e2"}
Sep 11 12:57:01.362455 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:01.362417    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zn57h" event={"ID":"fb5143b0-e3db-4bab-8521-4302149bbd7b","Type":"ContainerStarted","Data":"2c250af53cd50d2d363cdffebc87ed61df606ceb33aa54d31d36375fdada958e"}
Sep 11 12:57:01.362848 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:01.362475    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zn57h" event={"ID":"fb5143b0-e3db-4bab-8521-4302149bbd7b","Type":"ContainerStarted","Data":"43b92017007453d7bc798f1ef3faba8632f5293441ee039d234313fc9782188d"}
Sep 11 12:57:01.405174 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:01.405128    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zn57h" podStartSLOduration=2.396914562 podStartE2EDuration="3.405114123s" totalImagesPullingTime="948.074263ms" totalInitContainerRuntime="60.125298ms" isStatefulPod=true podCreationTimestamp="2026-09-11 12:56:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:57:01.40334897 +0000 UTC m=+90.907213363" watchObservedRunningTime="2026-09-11 12:57:01.405114123 +0000 UTC m=+90.908978538"
Sep 11 12:57:09.862251 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:09.862219    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-865f5f9d77-twb4l"]
Sep 11 12:57:14.299567 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:14.299534    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nptkm"
Sep 11 12:57:34.880841 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:34.880778    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-865f5f9d77-twb4l" podUID="13d37dae-b611-4d61-a247-1761a5553a5c" containerName="registry" containerID="cri-o://3d484818101feb444d952c6b1e7b26f699b858c663229bd43459602cd32df9ff" gracePeriod=30
Sep 11 12:57:35.120474 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.120451    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:57:35.262503 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.262399    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-bound-sa-token\") pod \"13d37dae-b611-4d61-a247-1761a5553a5c\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") "
Sep 11 12:57:35.262503 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.262460    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13d37dae-b611-4d61-a247-1761a5553a5c-image-registry-private-configuration\") pod \"13d37dae-b611-4d61-a247-1761a5553a5c\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") "
Sep 11 12:57:35.262736 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.262578    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13d37dae-b611-4d61-a247-1761a5553a5c-installation-pull-secrets\") pod \"13d37dae-b611-4d61-a247-1761a5553a5c\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") "
Sep 11 12:57:35.262736 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.262626    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13d37dae-b611-4d61-a247-1761a5553a5c-trusted-ca\") pod \"13d37dae-b611-4d61-a247-1761a5553a5c\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") "
Sep 11 12:57:35.262736 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.262662    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13d37dae-b611-4d61-a247-1761a5553a5c-ca-trust-extracted\") pod \"13d37dae-b611-4d61-a247-1761a5553a5c\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") "
Sep 11 12:57:35.262900 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.262742    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6vb7\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-kube-api-access-s6vb7\") pod \"13d37dae-b611-4d61-a247-1761a5553a5c\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") "
Sep 11 12:57:35.262900 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.262782    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls\") pod \"13d37dae-b611-4d61-a247-1761a5553a5c\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") "
Sep 11 12:57:35.262900 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.262817    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13d37dae-b611-4d61-a247-1761a5553a5c-registry-certificates\") pod \"13d37dae-b611-4d61-a247-1761a5553a5c\" (UID: \"13d37dae-b611-4d61-a247-1761a5553a5c\") "
Sep 11 12:57:35.263358 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.263273    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13d37dae-b611-4d61-a247-1761a5553a5c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "13d37dae-b611-4d61-a247-1761a5553a5c" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:35.263479 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.263414    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13d37dae-b611-4d61-a247-1761a5553a5c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "13d37dae-b611-4d61-a247-1761a5553a5c" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 12:57:35.265159 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.265133    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "13d37dae-b611-4d61-a247-1761a5553a5c" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:35.265279 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.265245    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-kube-api-access-s6vb7" (OuterVolumeSpecName: "kube-api-access-s6vb7") pod "13d37dae-b611-4d61-a247-1761a5553a5c" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c"). InnerVolumeSpecName "kube-api-access-s6vb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:35.265279 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.265262    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13d37dae-b611-4d61-a247-1761a5553a5c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "13d37dae-b611-4d61-a247-1761a5553a5c" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:35.265377 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.265288    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13d37dae-b611-4d61-a247-1761a5553a5c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "13d37dae-b611-4d61-a247-1761a5553a5c" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 12:57:35.265463 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.265367    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "13d37dae-b611-4d61-a247-1761a5553a5c" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 12:57:35.271665 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.271638    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13d37dae-b611-4d61-a247-1761a5553a5c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "13d37dae-b611-4d61-a247-1761a5553a5c" (UID: "13d37dae-b611-4d61-a247-1761a5553a5c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 12:57:35.363732 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.363682    2547 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/13d37dae-b611-4d61-a247-1761a5553a5c-registry-certificates\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 12:57:35.363732 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.363744    2547 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-bound-sa-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 12:57:35.363924 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.363757    2547 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/13d37dae-b611-4d61-a247-1761a5553a5c-image-registry-private-configuration\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 12:57:35.363924 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.363766    2547 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/13d37dae-b611-4d61-a247-1761a5553a5c-installation-pull-secrets\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 12:57:35.363924 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.363776    2547 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/13d37dae-b611-4d61-a247-1761a5553a5c-trusted-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 12:57:35.363924 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.363785    2547 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/13d37dae-b611-4d61-a247-1761a5553a5c-ca-trust-extracted\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 12:57:35.363924 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.363793    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6vb7\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-kube-api-access-s6vb7\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 12:57:35.363924 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.363801    2547 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/13d37dae-b611-4d61-a247-1761a5553a5c-registry-tls\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 12:57:35.469774 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.469741    2547 generic.go:356] "Generic (PLEG): container finished" podID="13d37dae-b611-4d61-a247-1761a5553a5c" containerID="3d484818101feb444d952c6b1e7b26f699b858c663229bd43459602cd32df9ff" exitCode=0
Sep 11 12:57:35.469918 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.469795    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865f5f9d77-twb4l" event={"ID":"13d37dae-b611-4d61-a247-1761a5553a5c","Type":"ContainerDied","Data":"3d484818101feb444d952c6b1e7b26f699b858c663229bd43459602cd32df9ff"}
Sep 11 12:57:35.469918 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.469841    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-865f5f9d77-twb4l"
Sep 11 12:57:35.469918 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.469855    2547 scope.go:117] "RemoveContainer" containerID="3d484818101feb444d952c6b1e7b26f699b858c663229bd43459602cd32df9ff"
Sep 11 12:57:35.470014 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.469844    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-865f5f9d77-twb4l" event={"ID":"13d37dae-b611-4d61-a247-1761a5553a5c","Type":"ContainerDied","Data":"306c84b8f75fdd7be2ee5e4518d2eaecc7063f910f1f3502d3b27c8248df4d1c"}
Sep 11 12:57:35.478916 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.478896    2547 scope.go:117] "RemoveContainer" containerID="3d484818101feb444d952c6b1e7b26f699b858c663229bd43459602cd32df9ff"
Sep 11 12:57:35.479215 ip-10-0-142-110 kubenswrapper[2547]: E0911 12:57:35.479197    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d484818101feb444d952c6b1e7b26f699b858c663229bd43459602cd32df9ff\": container with ID starting with 3d484818101feb444d952c6b1e7b26f699b858c663229bd43459602cd32df9ff not found: ID does not exist" containerID="3d484818101feb444d952c6b1e7b26f699b858c663229bd43459602cd32df9ff"
Sep 11 12:57:35.479294 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.479222    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d484818101feb444d952c6b1e7b26f699b858c663229bd43459602cd32df9ff"} err="failed to get container status \"3d484818101feb444d952c6b1e7b26f699b858c663229bd43459602cd32df9ff\": rpc error: code = NotFound desc = could not find container \"3d484818101feb444d952c6b1e7b26f699b858c663229bd43459602cd32df9ff\": container with ID starting with 3d484818101feb444d952c6b1e7b26f699b858c663229bd43459602cd32df9ff not found: ID does not exist"
Sep 11 12:57:35.490659 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.490637    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-865f5f9d77-twb4l"]
Sep 11 12:57:35.494870 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:35.494849    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-865f5f9d77-twb4l"]
Sep 11 12:57:37.005364 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:37.005328    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13d37dae-b611-4d61-a247-1761a5553a5c" path="/var/lib/kubelet/pods/13d37dae-b611-4d61-a247-1761a5553a5c/volumes"
Sep 11 12:57:40.799808 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:40.799758    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:57:40.802053 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:40.802022    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072-metrics-certs\") pod \"network-metrics-daemon-9z5fc\" (UID: \"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072\") " pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:57:41.019145 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:41.019118    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w7fbx\""
Sep 11 12:57:41.027322 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:41.027299    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9z5fc"
Sep 11 12:57:41.297477 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:41.297444    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9z5fc"]
Sep 11 12:57:41.300171 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:57:41.300147    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ccb32c0_1f13_4c35_b0d7_a24fa7ef2072.slice/crio-27d56912d2e4089e5c7e4543511cb7bab4921b013a873249a728f58a83610359 WatchSource:0}: Error finding container 27d56912d2e4089e5c7e4543511cb7bab4921b013a873249a728f58a83610359: Status 404 returned error can't find the container with id 27d56912d2e4089e5c7e4543511cb7bab4921b013a873249a728f58a83610359
Sep 11 12:57:41.494180 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:41.494097    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9z5fc" event={"ID":"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072","Type":"ContainerStarted","Data":"27d56912d2e4089e5c7e4543511cb7bab4921b013a873249a728f58a83610359"}
Sep 11 12:57:43.502515 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:43.502475    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9z5fc" event={"ID":"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072","Type":"ContainerStarted","Data":"2038cd252d10ff364813ac790fd4497c9cf7aac8f917a7bf53913af9dacb94bd"}
Sep 11 12:57:43.502899 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:43.502544    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9z5fc" event={"ID":"9ccb32c0-1f13-4c35-b0d7-a24fa7ef2072","Type":"ContainerStarted","Data":"e05c16d21fdca36fd71adc23bdbcac7d4b7a810095cb1efac83e6cfc33f714fa"}
Sep 11 12:57:43.518525 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:43.518481    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9z5fc" podStartSLOduration=130.332376288 podStartE2EDuration="2m11.518466804s" totalImagesPullingTime="1.186090516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:55:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:57:43.517426128 +0000 UTC m=+133.021290521" watchObservedRunningTime="2026-09-11 12:57:43.518466804 +0000 UTC m=+133.022331176"
Sep 11 12:57:46.761656 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:46.761611    2547 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx" podUID="14644362-0ebc-486e-b75d-127b491737de" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 11 12:57:56.761592 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:57:56.761555    2547 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx" podUID="14644362-0ebc-486e-b75d-127b491737de" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 11 12:58:06.761274 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:06.761237    2547 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx" podUID="14644362-0ebc-486e-b75d-127b491737de" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 11 12:58:06.761655 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:06.761303    2547 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx"
Sep 11 12:58:06.761782 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:06.761764    2547 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"f63cc6caea9f25e7fed33a86b8c1c81ad2b6ecc317a1e9cac24ceba9b44e07a1"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 11 12:58:06.761826 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:06.761803    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx" podUID="14644362-0ebc-486e-b75d-127b491737de" containerName="service-proxy" containerID="cri-o://f63cc6caea9f25e7fed33a86b8c1c81ad2b6ecc317a1e9cac24ceba9b44e07a1" gracePeriod=30
Sep 11 12:58:07.585310 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:07.585274    2547 generic.go:356] "Generic (PLEG): container finished" podID="14644362-0ebc-486e-b75d-127b491737de" containerID="f63cc6caea9f25e7fed33a86b8c1c81ad2b6ecc317a1e9cac24ceba9b44e07a1" exitCode=2
Sep 11 12:58:07.585476 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:07.585314    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx" event={"ID":"14644362-0ebc-486e-b75d-127b491737de","Type":"ContainerDied","Data":"f63cc6caea9f25e7fed33a86b8c1c81ad2b6ecc317a1e9cac24ceba9b44e07a1"}
Sep 11 12:58:07.585476 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:07.585353    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-db4895496-s9wfx" event={"ID":"14644362-0ebc-486e-b75d-127b491737de","Type":"ContainerStarted","Data":"f2a49562e22d1ed546ba5518f479acfb2942ab07e9094a595f5529a7654870d6"}
Sep 11 12:58:23.012193 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.012163    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f87d46645-2h8nx"]
Sep 11 12:58:23.012642 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.012365    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13d37dae-b611-4d61-a247-1761a5553a5c" containerName="registry"
Sep 11 12:58:23.012642 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.012375    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="13d37dae-b611-4d61-a247-1761a5553a5c" containerName="registry"
Sep 11 12:58:23.012642 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.012424    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="13d37dae-b611-4d61-a247-1761a5553a5c" containerName="registry"
Sep 11 12:58:23.015190 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.015174    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.020436 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.020412    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jjvx4\""
Sep 11 12:58:23.021432 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.021412    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 11 12:58:23.021541 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.021454    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 11 12:58:23.021541 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.021500    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 11 12:58:23.021910 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.021893    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 11 12:58:23.023870 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.023852    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 11 12:58:23.026452 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.026433    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 11 12:58:23.045500 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.045473    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f87d46645-2h8nx"]
Sep 11 12:58:23.098548 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.098473    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c1500d6-9330-416e-b162-b22a6039e0db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.098548 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.098518    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c1500d6-9330-416e-b162-b22a6039e0db-metrics-client-ca\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.098548 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.098542    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4c1500d6-9330-416e-b162-b22a6039e0db-federate-client-tls\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.098780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.098567    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4c1500d6-9330-416e-b162-b22a6039e0db-secret-telemeter-client\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.098780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.098603    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mz7b\" (UniqueName: \"kubernetes.io/projected/4c1500d6-9330-416e-b162-b22a6039e0db-kube-api-access-9mz7b\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.098780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.098627    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4c1500d6-9330-416e-b162-b22a6039e0db-telemeter-client-tls\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.098780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.098651    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1500d6-9330-416e-b162-b22a6039e0db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.098780 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.098680    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1500d6-9330-416e-b162-b22a6039e0db-serving-certs-ca-bundle\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.199229 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.199187    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c1500d6-9330-416e-b162-b22a6039e0db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.199229 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.199236    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c1500d6-9330-416e-b162-b22a6039e0db-metrics-client-ca\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.199368 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.199347    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4c1500d6-9330-416e-b162-b22a6039e0db-federate-client-tls\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.199402 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.199384    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4c1500d6-9330-416e-b162-b22a6039e0db-secret-telemeter-client\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.199447 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.199414    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mz7b\" (UniqueName: \"kubernetes.io/projected/4c1500d6-9330-416e-b162-b22a6039e0db-kube-api-access-9mz7b\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.199447 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.199433    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4c1500d6-9330-416e-b162-b22a6039e0db-telemeter-client-tls\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.199546 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.199461    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1500d6-9330-416e-b162-b22a6039e0db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.199687 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.199663    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1500d6-9330-416e-b162-b22a6039e0db-serving-certs-ca-bundle\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.200061 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.200037    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c1500d6-9330-416e-b162-b22a6039e0db-metrics-client-ca\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.200372 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.200348    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1500d6-9330-416e-b162-b22a6039e0db-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.200616 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.200591    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4c1500d6-9330-416e-b162-b22a6039e0db-serving-certs-ca-bundle\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.201894 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.201874    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4c1500d6-9330-416e-b162-b22a6039e0db-federate-client-tls\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.202051 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.202028    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4c1500d6-9330-416e-b162-b22a6039e0db-secret-telemeter-client\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.202255 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.202237    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4c1500d6-9330-416e-b162-b22a6039e0db-telemeter-client-tls\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.202291 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.202259    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c1500d6-9330-416e-b162-b22a6039e0db-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.207957 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.207936    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mz7b\" (UniqueName: \"kubernetes.io/projected/4c1500d6-9330-416e-b162-b22a6039e0db-kube-api-access-9mz7b\") pod \"telemeter-client-7f87d46645-2h8nx\" (UID: \"4c1500d6-9330-416e-b162-b22a6039e0db\") " pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.323593 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.323553    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx"
Sep 11 12:58:23.605682 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.605607    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f87d46645-2h8nx"]
Sep 11 12:58:23.608701 ip-10-0-142-110 kubenswrapper[2547]: W0911 12:58:23.608678    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1500d6_9330_416e_b162_b22a6039e0db.slice/crio-063a6fefe2ccfca67508bb577e58df446fbd4b3c02b11e794bfdafb59ca5deaf WatchSource:0}: Error finding container 063a6fefe2ccfca67508bb577e58df446fbd4b3c02b11e794bfdafb59ca5deaf: Status 404 returned error can't find the container with id 063a6fefe2ccfca67508bb577e58df446fbd4b3c02b11e794bfdafb59ca5deaf
Sep 11 12:58:23.636968 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:23.636938    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx" event={"ID":"4c1500d6-9330-416e-b162-b22a6039e0db","Type":"ContainerStarted","Data":"063a6fefe2ccfca67508bb577e58df446fbd4b3c02b11e794bfdafb59ca5deaf"}
Sep 11 12:58:25.645868 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:25.645784    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx" event={"ID":"4c1500d6-9330-416e-b162-b22a6039e0db","Type":"ContainerStarted","Data":"bcfac0432057033a4b379ef11baf1eca8c76cd894aa336867757e1af9b3f9753"}
Sep 11 12:58:26.651420 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:26.651392    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx" event={"ID":"4c1500d6-9330-416e-b162-b22a6039e0db","Type":"ContainerStarted","Data":"012f64cf6479e997f1b93decdf7ff3a9bc7ed20c7dae45c8eb6bde42ec306142"}
Sep 11 12:58:27.657260 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:27.657225    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx" event={"ID":"4c1500d6-9330-416e-b162-b22a6039e0db","Type":"ContainerStarted","Data":"b629e524e03c5983d80f1ad5a6c68ba919bb966fdb9f78dc3051f74314db2e1c"}
Sep 11 12:58:27.680944 ip-10-0-142-110 kubenswrapper[2547]: I0911 12:58:27.680879    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f87d46645-2h8nx" podStartSLOduration=2.781758808 podStartE2EDuration="5.680859561s" totalImagesPullingTime="2.899100753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 12:58:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 12:58:27.680155222 +0000 UTC m=+177.184019615" watchObservedRunningTime="2026-09-11 12:58:27.680859561 +0000 UTC m=+177.184723954"
Sep 11 13:00:30.922785 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:00:30.922754    2547 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 13:01:13.554284 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.554253    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"]
Sep 11 13:01:13.557346 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.557330    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.573687 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.573664    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 13:01:13.573829 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.573694    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 13:01:13.576762 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.576742    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 13:01:13.579086 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.579070    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 13:01:13.588391 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.588372    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xt7p7\""
Sep 11 13:01:13.602400 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.602372    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"]
Sep 11 13:01:13.685861 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.685815    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crd84\" (UniqueName: \"kubernetes.io/projected/fdb9935f-3e03-42c2-8262-68302c24e821-kube-api-access-crd84\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.685861 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.685867    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fdb9935f-3e03-42c2-8262-68302c24e821-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.686159 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.685899    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdb9935f-3e03-42c2-8262-68302c24e821-tmp\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.686159 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.685974    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fdb9935f-3e03-42c2-8262-68302c24e821-manifests\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.686159 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.686020    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdb9935f-3e03-42c2-8262-68302c24e821-webhook-cert\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.786730 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.786692    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fdb9935f-3e03-42c2-8262-68302c24e821-manifests\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.786897 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.786788    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdb9935f-3e03-42c2-8262-68302c24e821-webhook-cert\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.786897 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.786819    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crd84\" (UniqueName: \"kubernetes.io/projected/fdb9935f-3e03-42c2-8262-68302c24e821-kube-api-access-crd84\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.786897 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.786848    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fdb9935f-3e03-42c2-8262-68302c24e821-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.786897 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.786870    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdb9935f-3e03-42c2-8262-68302c24e821-tmp\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.787182 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.787157    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fdb9935f-3e03-42c2-8262-68302c24e821-manifests\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.789147 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.789116    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fdb9935f-3e03-42c2-8262-68302c24e821-tmp\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.789325 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.789307    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fdb9935f-3e03-42c2-8262-68302c24e821-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.789368 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.789344    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fdb9935f-3e03-42c2-8262-68302c24e821-webhook-cert\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.799522 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.799497    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crd84\" (UniqueName: \"kubernetes.io/projected/fdb9935f-3e03-42c2-8262-68302c24e821-kube-api-access-crd84\") pod \"opendatahub-operator-controller-manager-56f55dc566-hc69g\" (UID: \"fdb9935f-3e03-42c2-8262-68302c24e821\") " pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:13.866493 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:13.866385    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:14.148548 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:14.148523    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"]
Sep 11 13:01:14.151192 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:01:14.151169    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb9935f_3e03_42c2_8262_68302c24e821.slice/crio-6ad2cf3805ace4b7d3c497ec0f589a6d37c56e35a8db997c7c74b4f5159e9940 WatchSource:0}: Error finding container 6ad2cf3805ace4b7d3c497ec0f589a6d37c56e35a8db997c7c74b4f5159e9940: Status 404 returned error can't find the container with id 6ad2cf3805ace4b7d3c497ec0f589a6d37c56e35a8db997c7c74b4f5159e9940
Sep 11 13:01:14.152920 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:14.152900    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:01:14.192548 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:14.192510    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g" event={"ID":"fdb9935f-3e03-42c2-8262-68302c24e821","Type":"ContainerStarted","Data":"6ad2cf3805ace4b7d3c497ec0f589a6d37c56e35a8db997c7c74b4f5159e9940"}
Sep 11 13:01:17.204385 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:17.204356    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g" event={"ID":"fdb9935f-3e03-42c2-8262-68302c24e821","Type":"ContainerStarted","Data":"e5590238b06bb5508196bb1696693e04cca88f3aafe6b282bb2e1bc4a575bc0a"}
Sep 11 13:01:19.214050 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:19.214014    2547 generic.go:356] "Generic (PLEG): container finished" podID="fdb9935f-3e03-42c2-8262-68302c24e821" containerID="e5590238b06bb5508196bb1696693e04cca88f3aafe6b282bb2e1bc4a575bc0a" exitCode=0
Sep 11 13:01:19.214430 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:19.214087    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g" event={"ID":"fdb9935f-3e03-42c2-8262-68302c24e821","Type":"ContainerDied","Data":"e5590238b06bb5508196bb1696693e04cca88f3aafe6b282bb2e1bc4a575bc0a"}
Sep 11 13:01:20.219807 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:20.219767    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g" event={"ID":"fdb9935f-3e03-42c2-8262-68302c24e821","Type":"ContainerStarted","Data":"0f5a70ee7a48e50809530ad6d4910bfb3b2ccaaaf1970406a6df0c7a66cab6a8"}
Sep 11 13:01:20.220214 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:20.219979    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:20.246319 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:20.246251    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g" podStartSLOduration=2.690009027 podStartE2EDuration="7.246227468s" totalImagesPullingTime="3.511434779s" totalInitContainerRuntime="1.044783662s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:01:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:01:20.244318891 +0000 UTC m=+349.748183283" watchObservedRunningTime="2026-09-11 13:01:20.246227468 +0000 UTC m=+349.750091861"
Sep 11 13:01:31.225983 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:31.225902    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56f55dc566-hc69g"
Sep 11 13:01:34.535891 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.535853    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85d97b946f-dww45"]
Sep 11 13:01:34.546587 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.546559    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45"
Sep 11 13:01:34.550036 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.550012    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 13:01:34.550182 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.550014    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 13:01:34.550540 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.550520    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 13:01:34.550637 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.550618    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 13:01:34.588061 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.588022    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85d97b946f-dww45"]
Sep 11 13:01:34.638793 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.638760    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aaf46ce0-2f53-4e2d-a064-6e588568117c-tmp\") pod \"kube-auth-proxy-85d97b946f-dww45\" (UID: \"aaf46ce0-2f53-4e2d-a064-6e588568117c\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45"
Sep 11 13:01:34.638793 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.638799    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaf46ce0-2f53-4e2d-a064-6e588568117c-tls-certs\") pod \"kube-auth-proxy-85d97b946f-dww45\" (UID: \"aaf46ce0-2f53-4e2d-a064-6e588568117c\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45"
Sep 11 13:01:34.639009 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.638824    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsln7\" (UniqueName: \"kubernetes.io/projected/aaf46ce0-2f53-4e2d-a064-6e588568117c-kube-api-access-wsln7\") pod \"kube-auth-proxy-85d97b946f-dww45\" (UID: \"aaf46ce0-2f53-4e2d-a064-6e588568117c\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45"
Sep 11 13:01:34.740192 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.740155    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aaf46ce0-2f53-4e2d-a064-6e588568117c-tmp\") pod \"kube-auth-proxy-85d97b946f-dww45\" (UID: \"aaf46ce0-2f53-4e2d-a064-6e588568117c\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45"
Sep 11 13:01:34.740192 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.740196    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaf46ce0-2f53-4e2d-a064-6e588568117c-tls-certs\") pod \"kube-auth-proxy-85d97b946f-dww45\" (UID: \"aaf46ce0-2f53-4e2d-a064-6e588568117c\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45"
Sep 11 13:01:34.740405 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.740215    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsln7\" (UniqueName: \"kubernetes.io/projected/aaf46ce0-2f53-4e2d-a064-6e588568117c-kube-api-access-wsln7\") pod \"kube-auth-proxy-85d97b946f-dww45\" (UID: \"aaf46ce0-2f53-4e2d-a064-6e588568117c\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45"
Sep 11 13:01:34.742574 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.742541    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aaf46ce0-2f53-4e2d-a064-6e588568117c-tmp\") pod \"kube-auth-proxy-85d97b946f-dww45\" (UID: \"aaf46ce0-2f53-4e2d-a064-6e588568117c\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45"
Sep 11 13:01:34.742789 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.742771    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aaf46ce0-2f53-4e2d-a064-6e588568117c-tls-certs\") pod \"kube-auth-proxy-85d97b946f-dww45\" (UID: \"aaf46ce0-2f53-4e2d-a064-6e588568117c\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45"
Sep 11 13:01:34.761258 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.761221    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsln7\" (UniqueName: \"kubernetes.io/projected/aaf46ce0-2f53-4e2d-a064-6e588568117c-kube-api-access-wsln7\") pod \"kube-auth-proxy-85d97b946f-dww45\" (UID: \"aaf46ce0-2f53-4e2d-a064-6e588568117c\") " pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45"
Sep 11 13:01:34.855908 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:34.855805    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45"
Sep 11 13:01:35.133860 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:35.133786    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85d97b946f-dww45"]
Sep 11 13:01:35.136601 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:01:35.136573    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf46ce0_2f53_4e2d_a064_6e588568117c.slice/crio-ec79e698db92b0901b529fb833727103da4344db3ce6bf3385166ce0652ce6cf WatchSource:0}: Error finding container ec79e698db92b0901b529fb833727103da4344db3ce6bf3385166ce0652ce6cf: Status 404 returned error can't find the container with id ec79e698db92b0901b529fb833727103da4344db3ce6bf3385166ce0652ce6cf
Sep 11 13:01:35.269688 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:35.269653    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45" event={"ID":"aaf46ce0-2f53-4e2d-a064-6e588568117c","Type":"ContainerStarted","Data":"ec79e698db92b0901b529fb833727103da4344db3ce6bf3385166ce0652ce6cf"}
Sep 11 13:01:36.646179 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.646142    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"]
Sep 11 13:01:36.653509 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.653083    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.656522 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.656246    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 13:01:36.656522 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.656275    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 13:01:36.656522 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.656380    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 13:01:36.656826 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.656573    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 13:01:36.656826 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.656797    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tcj6m\""
Sep 11 13:01:36.664316 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.664286    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"]
Sep 11 13:01:36.757061 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.757025    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.757243 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.757076    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a72b9a-792f-45d8-bfce-48326fc7bf20-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.757243 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.757098    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.757243 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.757115    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtg76\" (UniqueName: \"kubernetes.io/projected/91a72b9a-792f-45d8-bfce-48326fc7bf20-kube-api-access-jtg76\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.757243 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.757139    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.757243 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.757232    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.757512 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.757260    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.858321 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.858280    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.858504 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.858336    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.858504 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.858400    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.858504 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.858454    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a72b9a-792f-45d8-bfce-48326fc7bf20-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.858504 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.858487    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.858692 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.858511    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtg76\" (UniqueName: \"kubernetes.io/projected/91a72b9a-792f-45d8-bfce-48326fc7bf20-kube-api-access-jtg76\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.858692 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.858536    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.859161 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.859109    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.861230 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.861200    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.861336 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.861288    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a72b9a-792f-45d8-bfce-48326fc7bf20-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.861401 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.861360    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.861535 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.861509    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.867164 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.867140    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtg76\" (UniqueName: \"kubernetes.io/projected/91a72b9a-792f-45d8-bfce-48326fc7bf20-kube-api-access-jtg76\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.867270 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.867248    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-xm9r5\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:36.967687 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:36.967601    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:38.138519 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:38.138400    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"]
Sep 11 13:01:38.142068 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:01:38.142038    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a72b9a_792f_45d8_bfce_48326fc7bf20.slice/crio-aac47339e19d852be335a907759adb62ae7b15ec22c8a46d03b6a31df0398a2f WatchSource:0}: Error finding container aac47339e19d852be335a907759adb62ae7b15ec22c8a46d03b6a31df0398a2f: Status 404 returned error can't find the container with id aac47339e19d852be335a907759adb62ae7b15ec22c8a46d03b6a31df0398a2f
Sep 11 13:01:38.282477 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:38.282438    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45" event={"ID":"aaf46ce0-2f53-4e2d-a064-6e588568117c","Type":"ContainerStarted","Data":"095fa518155048daeefd90577c284ae662c077e617db202b19f54fd3c21b1c52"}
Sep 11 13:01:38.283737 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:38.283692    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5" event={"ID":"91a72b9a-792f-45d8-bfce-48326fc7bf20","Type":"ContainerStarted","Data":"aac47339e19d852be335a907759adb62ae7b15ec22c8a46d03b6a31df0398a2f"}
Sep 11 13:01:38.310949 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:38.310887    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85d97b946f-dww45" podStartSLOduration=1.5224060449999999 podStartE2EDuration="4.310871205s" totalImagesPullingTime="2.78846516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:01:38.309026052 +0000 UTC m=+367.812890443" watchObservedRunningTime="2026-09-11 13:01:38.310871205 +0000 UTC m=+367.814735598"
Sep 11 13:01:40.850076 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:40.850040    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:01:40.850363 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:40.850108    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:01:41.296453 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:41.296420    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5" event={"ID":"91a72b9a-792f-45d8-bfce-48326fc7bf20","Type":"ContainerStarted","Data":"86fd78d12096c7adeef4766ce6599149e02551a6ab0a926a233bf30ca251b3bc"}
Sep 11 13:01:41.296807 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:41.296634    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:41.298326 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:41.298298    2547 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-xm9r5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:01:41.298456 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:41.298353    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5" podUID="91a72b9a-792f-45d8-bfce-48326fc7bf20" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:01:41.327053 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:41.326992    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5" podStartSLOduration=2.621293281 podStartE2EDuration="5.326975624s" totalImagesPullingTime="2.705682343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:01:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:01:41.325165315 +0000 UTC m=+370.829029709" watchObservedRunningTime="2026-09-11 13:01:41.326975624 +0000 UTC m=+370.830840017"
Sep 11 13:01:42.271186 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.271154    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"]
Sep 11 13:01:42.274377 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.274357    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.277913 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.277892    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kvwz5\""
Sep 11 13:01:42.292569 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.292539    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"]
Sep 11 13:01:42.301655 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.301633    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:42.303971 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.303947    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/414a5cda-bfb9-435d-9de8-fa74da97911e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.304097 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.303999    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/414a5cda-bfb9-435d-9de8-fa74da97911e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.304097 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.304061    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.304188 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.304106    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mf6h\" (UniqueName: \"kubernetes.io/projected/414a5cda-bfb9-435d-9de8-fa74da97911e-kube-api-access-6mf6h\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.304188 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.304169    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.304275 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.304191    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.304275 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.304206    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/414a5cda-bfb9-435d-9de8-fa74da97911e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.304275 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.304242    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.304394 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.304288    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.405651 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.405619    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/414a5cda-bfb9-435d-9de8-fa74da97911e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.405803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.405665    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.405803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.405689    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mf6h\" (UniqueName: \"kubernetes.io/projected/414a5cda-bfb9-435d-9de8-fa74da97911e-kube-api-access-6mf6h\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.405803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.405737    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.405803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.405762    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.405803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.405790    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/414a5cda-bfb9-435d-9de8-fa74da97911e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.406081 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.405886    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.406081 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.405916    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.406081 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.405960    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/414a5cda-bfb9-435d-9de8-fa74da97911e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.406238 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.406137    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.406238 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.406161    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.406343 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.406283    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.406343 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.406322    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.406990 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.406967    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/414a5cda-bfb9-435d-9de8-fa74da97911e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.408182 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.408159    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/414a5cda-bfb9-435d-9de8-fa74da97911e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.408346 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.408326    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/414a5cda-bfb9-435d-9de8-fa74da97911e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.416133 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.416109    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mf6h\" (UniqueName: \"kubernetes.io/projected/414a5cda-bfb9-435d-9de8-fa74da97911e-kube-api-access-6mf6h\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.417651 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.417630    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/414a5cda-bfb9-435d-9de8-fa74da97911e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm\" (UID: \"414a5cda-bfb9-435d-9de8-fa74da97911e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.584281 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.584199    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:42.861345 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:42.861319    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"]
Sep 11 13:01:42.863469 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:01:42.863441    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod414a5cda_bfb9_435d_9de8_fa74da97911e.slice/crio-e2f2c9990aab54ab59e940139fa6aa8de8d7144595fbc4c912394dcf11bbd4a4 WatchSource:0}: Error finding container e2f2c9990aab54ab59e940139fa6aa8de8d7144595fbc4c912394dcf11bbd4a4: Status 404 returned error can't find the container with id e2f2c9990aab54ab59e940139fa6aa8de8d7144595fbc4c912394dcf11bbd4a4
Sep 11 13:01:43.305442 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:43.305402    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm" event={"ID":"414a5cda-bfb9-435d-9de8-fa74da97911e","Type":"ContainerStarted","Data":"e2f2c9990aab54ab59e940139fa6aa8de8d7144595fbc4c912394dcf11bbd4a4"}
Sep 11 13:01:46.151742 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:46.151690    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:01:46.152123 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:46.151775    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:01:46.152123 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:46.151808    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:01:46.318965 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:46.318916    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm" event={"ID":"414a5cda-bfb9-435d-9de8-fa74da97911e","Type":"ContainerStarted","Data":"9007c4923172c52db31962aaedcf7588d0e606d4b89176ad8f1f6d74746fff2b"}
Sep 11 13:01:46.342010 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:46.341949    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm" podStartSLOduration=1.056126886 podStartE2EDuration="4.341928137s" totalImagesPullingTime="3.285801251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:01:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:01:46.339446487 +0000 UTC m=+375.843310894" watchObservedRunningTime="2026-09-11 13:01:46.341928137 +0000 UTC m=+375.845792533"
Sep 11 13:01:46.584978 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:46.584938    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:47.589815 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:47.589776    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:48.326580 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:48.326545    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:48.327696 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:48.327670    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm"
Sep 11 13:01:52.869223 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:52.869189    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"]
Sep 11 13:01:52.873688 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:52.873665    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:52.898143 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:52.898110    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"]
Sep 11 13:01:52.997212 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:52.997177    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ca6b81e-b43c-40c0-a38f-7a70204db34b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:52.997378 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:52.997220    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5ca6b81e-b43c-40c0-a38f-7a70204db34b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:52.997378 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:52.997242    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ca6b81e-b43c-40c0-a38f-7a70204db34b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:52.997378 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:52.997299    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25rt\" (UniqueName: \"kubernetes.io/projected/5ca6b81e-b43c-40c0-a38f-7a70204db34b-kube-api-access-b25rt\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:52.997378 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:52.997367    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ca6b81e-b43c-40c0-a38f-7a70204db34b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:52.997511 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:52.997414    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5ca6b81e-b43c-40c0-a38f-7a70204db34b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:52.997511 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:52.997438    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5ca6b81e-b43c-40c0-a38f-7a70204db34b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.098444 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.098408    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5ca6b81e-b43c-40c0-a38f-7a70204db34b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.098444 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.098450    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5ca6b81e-b43c-40c0-a38f-7a70204db34b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.098699 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.098490    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ca6b81e-b43c-40c0-a38f-7a70204db34b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.098699 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.098519    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5ca6b81e-b43c-40c0-a38f-7a70204db34b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.098699 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.098535    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ca6b81e-b43c-40c0-a38f-7a70204db34b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.098699 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.098559    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b25rt\" (UniqueName: \"kubernetes.io/projected/5ca6b81e-b43c-40c0-a38f-7a70204db34b-kube-api-access-b25rt\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.098699 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.098680    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ca6b81e-b43c-40c0-a38f-7a70204db34b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.099276 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.099246    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5ca6b81e-b43c-40c0-a38f-7a70204db34b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.100885 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.100859    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ca6b81e-b43c-40c0-a38f-7a70204db34b-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.101163 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.101143    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5ca6b81e-b43c-40c0-a38f-7a70204db34b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.101309 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.101257    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5ca6b81e-b43c-40c0-a38f-7a70204db34b-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.101411 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.101395    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5ca6b81e-b43c-40c0-a38f-7a70204db34b-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.121371 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.121315    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ca6b81e-b43c-40c0-a38f-7a70204db34b-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.121880 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.121858    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25rt\" (UniqueName: \"kubernetes.io/projected/5ca6b81e-b43c-40c0-a38f-7a70204db34b-kube-api-access-b25rt\") pod \"istiod-openshift-gateway-5677ccb49b-mnjl8\" (UID: \"5ca6b81e-b43c-40c0-a38f-7a70204db34b\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.182998 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.182961    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:53.462932 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.462767    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"]
Sep 11 13:01:53.465499 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:01:53.465472    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca6b81e_b43c_40c0_a38f_7a70204db34b.slice/crio-7e814d6d8821370be80aecacf78980ec1190d1059dcde292fff31dd015bf320f WatchSource:0}: Error finding container 7e814d6d8821370be80aecacf78980ec1190d1059dcde292fff31dd015bf320f: Status 404 returned error can't find the container with id 7e814d6d8821370be80aecacf78980ec1190d1059dcde292fff31dd015bf320f
Sep 11 13:01:53.468540 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.468511    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:01:53.468607 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:53.468572    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:01:54.349799 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:54.349757    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8" event={"ID":"5ca6b81e-b43c-40c0-a38f-7a70204db34b","Type":"ContainerStarted","Data":"8aac0889420f99535fc2820ef2e8177bc1f01bbc9f953941f1a136cd4d46a0db"}
Sep 11 13:01:54.350296 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:54.349828    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8" event={"ID":"5ca6b81e-b43c-40c0-a38f-7a70204db34b","Type":"ContainerStarted","Data":"7e814d6d8821370be80aecacf78980ec1190d1059dcde292fff31dd015bf320f"}
Sep 11 13:01:54.350296 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:54.350018    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:54.352008 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:54.351918    2547 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-mnjl8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:01:54.352008 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:54.351977    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8" podUID="5ca6b81e-b43c-40c0-a38f-7a70204db34b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:01:54.400079 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:54.400014    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8" podStartSLOduration=2.399994824 podStartE2EDuration="2.399994824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:01:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:01:54.397081937 +0000 UTC m=+383.900946330" watchObservedRunningTime="2026-09-11 13:01:54.399994824 +0000 UTC m=+383.903859217"
Sep 11 13:01:55.353858 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.353830    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-mnjl8"
Sep 11 13:01:55.541962 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.541924    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"]
Sep 11 13:01:55.542164 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.542124    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5" podUID="91a72b9a-792f-45d8-bfce-48326fc7bf20" containerName="discovery" containerID="cri-o://86fd78d12096c7adeef4766ce6599149e02551a6ab0a926a233bf30ca251b3bc" gracePeriod=30
Sep 11 13:01:55.794082 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.794057    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:55.922821 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.922702    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-token\") pod \"91a72b9a-792f-45d8-bfce-48326fc7bf20\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") "
Sep 11 13:01:55.922821 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.922793    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-cacerts\") pod \"91a72b9a-792f-45d8-bfce-48326fc7bf20\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") "
Sep 11 13:01:55.923061 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.922825    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-csr-ca-configmap\") pod \"91a72b9a-792f-45d8-bfce-48326fc7bf20\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") "
Sep 11 13:01:55.923061 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.922858    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtg76\" (UniqueName: \"kubernetes.io/projected/91a72b9a-792f-45d8-bfce-48326fc7bf20-kube-api-access-jtg76\") pod \"91a72b9a-792f-45d8-bfce-48326fc7bf20\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") "
Sep 11 13:01:55.923061 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.922888    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-csr-dns-cert\") pod \"91a72b9a-792f-45d8-bfce-48326fc7bf20\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") "
Sep 11 13:01:55.923061 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.922941    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a72b9a-792f-45d8-bfce-48326fc7bf20-local-certs\") pod \"91a72b9a-792f-45d8-bfce-48326fc7bf20\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") "
Sep 11 13:01:55.923061 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.922996    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-kubeconfig\") pod \"91a72b9a-792f-45d8-bfce-48326fc7bf20\" (UID: \"91a72b9a-792f-45d8-bfce-48326fc7bf20\") "
Sep 11 13:01:55.923277 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.923240    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "91a72b9a-792f-45d8-bfce-48326fc7bf20" (UID: "91a72b9a-792f-45d8-bfce-48326fc7bf20"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:01:55.925229 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.925198    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-cacerts" (OuterVolumeSpecName: "cacerts") pod "91a72b9a-792f-45d8-bfce-48326fc7bf20" (UID: "91a72b9a-792f-45d8-bfce-48326fc7bf20"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:01:55.925229 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.925215    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "91a72b9a-792f-45d8-bfce-48326fc7bf20" (UID: "91a72b9a-792f-45d8-bfce-48326fc7bf20"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:01:55.925420 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.925345    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a72b9a-792f-45d8-bfce-48326fc7bf20-local-certs" (OuterVolumeSpecName: "local-certs") pod "91a72b9a-792f-45d8-bfce-48326fc7bf20" (UID: "91a72b9a-792f-45d8-bfce-48326fc7bf20"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:01:55.925420 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.925369    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a72b9a-792f-45d8-bfce-48326fc7bf20-kube-api-access-jtg76" (OuterVolumeSpecName: "kube-api-access-jtg76") pod "91a72b9a-792f-45d8-bfce-48326fc7bf20" (UID: "91a72b9a-792f-45d8-bfce-48326fc7bf20"). InnerVolumeSpecName "kube-api-access-jtg76". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:01:55.925519 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.925497    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-token" (OuterVolumeSpecName: "istio-token") pod "91a72b9a-792f-45d8-bfce-48326fc7bf20" (UID: "91a72b9a-792f-45d8-bfce-48326fc7bf20"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:01:55.925551 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:55.925497    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "91a72b9a-792f-45d8-bfce-48326fc7bf20" (UID: "91a72b9a-792f-45d8-bfce-48326fc7bf20"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:01:56.024107 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.024073    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:01:56.024107 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.024098    2547 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-cacerts\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:01:56.024107 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.024108    2547 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-csr-ca-configmap\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:01:56.024324 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.024116    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtg76\" (UniqueName: \"kubernetes.io/projected/91a72b9a-792f-45d8-bfce-48326fc7bf20-kube-api-access-jtg76\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:01:56.024324 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.024127    2547 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-csr-dns-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:01:56.024324 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.024135    2547 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a72b9a-792f-45d8-bfce-48326fc7bf20-local-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:01:56.024324 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.024143    2547 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/91a72b9a-792f-45d8-bfce-48326fc7bf20-istio-kubeconfig\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:01:56.358553 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.358519    2547 generic.go:356] "Generic (PLEG): container finished" podID="91a72b9a-792f-45d8-bfce-48326fc7bf20" containerID="86fd78d12096c7adeef4766ce6599149e02551a6ab0a926a233bf30ca251b3bc" exitCode=0
Sep 11 13:01:56.358970 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.358581    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"
Sep 11 13:01:56.358970 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.358599    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5" event={"ID":"91a72b9a-792f-45d8-bfce-48326fc7bf20","Type":"ContainerDied","Data":"86fd78d12096c7adeef4766ce6599149e02551a6ab0a926a233bf30ca251b3bc"}
Sep 11 13:01:56.358970 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.358678    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5" event={"ID":"91a72b9a-792f-45d8-bfce-48326fc7bf20","Type":"ContainerDied","Data":"aac47339e19d852be335a907759adb62ae7b15ec22c8a46d03b6a31df0398a2f"}
Sep 11 13:01:56.358970 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.358699    2547 scope.go:117] "RemoveContainer" containerID="86fd78d12096c7adeef4766ce6599149e02551a6ab0a926a233bf30ca251b3bc"
Sep 11 13:01:56.367374 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.367359    2547 scope.go:117] "RemoveContainer" containerID="86fd78d12096c7adeef4766ce6599149e02551a6ab0a926a233bf30ca251b3bc"
Sep 11 13:01:56.367623 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:01:56.367606    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86fd78d12096c7adeef4766ce6599149e02551a6ab0a926a233bf30ca251b3bc\": container with ID starting with 86fd78d12096c7adeef4766ce6599149e02551a6ab0a926a233bf30ca251b3bc not found: ID does not exist" containerID="86fd78d12096c7adeef4766ce6599149e02551a6ab0a926a233bf30ca251b3bc"
Sep 11 13:01:56.367682 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.367628    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86fd78d12096c7adeef4766ce6599149e02551a6ab0a926a233bf30ca251b3bc"} err="failed to get container status \"86fd78d12096c7adeef4766ce6599149e02551a6ab0a926a233bf30ca251b3bc\": rpc error: code = NotFound desc = could not find container \"86fd78d12096c7adeef4766ce6599149e02551a6ab0a926a233bf30ca251b3bc\": container with ID starting with 86fd78d12096c7adeef4766ce6599149e02551a6ab0a926a233bf30ca251b3bc not found: ID does not exist"
Sep 11 13:01:56.386307 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.386281    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"]
Sep 11 13:01:56.396229 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:56.396205    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-xm9r5"]
Sep 11 13:01:57.005672 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:01:57.005639    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91a72b9a-792f-45d8-bfce-48326fc7bf20" path="/var/lib/kubelet/pods/91a72b9a-792f-45d8-bfce-48326fc7bf20/volumes"
Sep 11 13:03:04.183590 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.183505    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-sj4ss"]
Sep 11 13:03:04.184167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.183941    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91a72b9a-792f-45d8-bfce-48326fc7bf20" containerName="discovery"
Sep 11 13:03:04.184167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.183960    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="91a72b9a-792f-45d8-bfce-48326fc7bf20" containerName="discovery"
Sep 11 13:03:04.184167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.184026    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="91a72b9a-792f-45d8-bfce-48326fc7bf20" containerName="discovery"
Sep 11 13:03:04.186997 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.186974    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-sj4ss"
Sep 11 13:03:04.189599 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.189580    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 13:03:04.189684 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.189617    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 13:03:04.190499 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.190485    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jw8fp\""
Sep 11 13:03:04.199972 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.199949    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-sj4ss"]
Sep 11 13:03:04.261865 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.261830    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9slrk\" (UniqueName: \"kubernetes.io/projected/ed77d2f1-174b-4c21-af69-a67ee7bbb923-kube-api-access-9slrk\") pod \"authorino-operator-76b478bd78-sj4ss\" (UID: \"ed77d2f1-174b-4c21-af69-a67ee7bbb923\") " pod="kuadrant-system/authorino-operator-76b478bd78-sj4ss"
Sep 11 13:03:04.362781 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.362748    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9slrk\" (UniqueName: \"kubernetes.io/projected/ed77d2f1-174b-4c21-af69-a67ee7bbb923-kube-api-access-9slrk\") pod \"authorino-operator-76b478bd78-sj4ss\" (UID: \"ed77d2f1-174b-4c21-af69-a67ee7bbb923\") " pod="kuadrant-system/authorino-operator-76b478bd78-sj4ss"
Sep 11 13:03:04.390642 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.390610    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9slrk\" (UniqueName: \"kubernetes.io/projected/ed77d2f1-174b-4c21-af69-a67ee7bbb923-kube-api-access-9slrk\") pod \"authorino-operator-76b478bd78-sj4ss\" (UID: \"ed77d2f1-174b-4c21-af69-a67ee7bbb923\") " pod="kuadrant-system/authorino-operator-76b478bd78-sj4ss"
Sep 11 13:03:04.497438 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.497351    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-sj4ss"
Sep 11 13:03:04.768486 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:04.768338    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-sj4ss"]
Sep 11 13:03:04.771155 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:03:04.771126    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded77d2f1_174b_4c21_af69_a67ee7bbb923.slice/crio-4996d9cfd8b2f990405765800017ed2e90817a6e21d2e2e049db57e21b39c453 WatchSource:0}: Error finding container 4996d9cfd8b2f990405765800017ed2e90817a6e21d2e2e049db57e21b39c453: Status 404 returned error can't find the container with id 4996d9cfd8b2f990405765800017ed2e90817a6e21d2e2e049db57e21b39c453
Sep 11 13:03:05.607117 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:05.607082    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-sj4ss" event={"ID":"ed77d2f1-174b-4c21-af69-a67ee7bbb923","Type":"ContainerStarted","Data":"4996d9cfd8b2f990405765800017ed2e90817a6e21d2e2e049db57e21b39c453"}
Sep 11 13:03:08.622272 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:08.622236    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-sj4ss" event={"ID":"ed77d2f1-174b-4c21-af69-a67ee7bbb923","Type":"ContainerStarted","Data":"99aff9cfad2b8e6dfcb1f26f97457a17a9b8c3b3611c2c6fd5317c6c7d0e953a"}
Sep 11 13:03:08.622807 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:08.622338    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-sj4ss"
Sep 11 13:03:08.653932 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:08.653884    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-sj4ss" podStartSLOduration=1.855870392 podStartE2EDuration="4.653870187s" totalImagesPullingTime="2.797999795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:08.652359896 +0000 UTC m=+458.156224300" watchObservedRunningTime="2026-09-11 13:03:08.653870187 +0000 UTC m=+458.157734579"
Sep 11 13:03:10.920287 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:10.920254    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"]
Sep 11 13:03:10.923350 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:10.923332    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:10.925978 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:10.925954    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-986lr\""
Sep 11 13:03:10.964347 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:10.964324    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"]
Sep 11 13:03:11.017103 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:11.017076    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq9m9\" (UniqueName: \"kubernetes.io/projected/b6b01a48-7eee-476b-9b55-7e1f126b5b58-kube-api-access-jq9m9\") pod \"limitador-operator-controller-manager-74495c69f8-ndf9l\" (UID: \"b6b01a48-7eee-476b-9b55-7e1f126b5b58\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:11.118439 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:11.118410    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq9m9\" (UniqueName: \"kubernetes.io/projected/b6b01a48-7eee-476b-9b55-7e1f126b5b58-kube-api-access-jq9m9\") pod \"limitador-operator-controller-manager-74495c69f8-ndf9l\" (UID: \"b6b01a48-7eee-476b-9b55-7e1f126b5b58\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:11.145897 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:11.145866    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq9m9\" (UniqueName: \"kubernetes.io/projected/b6b01a48-7eee-476b-9b55-7e1f126b5b58-kube-api-access-jq9m9\") pod \"limitador-operator-controller-manager-74495c69f8-ndf9l\" (UID: \"b6b01a48-7eee-476b-9b55-7e1f126b5b58\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:11.232978 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:11.232909    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:11.528211 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:11.528178    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"]
Sep 11 13:03:11.531101 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:03:11.531074    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b01a48_7eee_476b_9b55_7e1f126b5b58.slice/crio-5172a2fe30c2acea3cd399417bfc5bf583b43e776e547b6ea6a8b62463f56e55 WatchSource:0}: Error finding container 5172a2fe30c2acea3cd399417bfc5bf583b43e776e547b6ea6a8b62463f56e55: Status 404 returned error can't find the container with id 5172a2fe30c2acea3cd399417bfc5bf583b43e776e547b6ea6a8b62463f56e55
Sep 11 13:03:11.635512 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:11.635480    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l" event={"ID":"b6b01a48-7eee-476b-9b55-7e1f126b5b58","Type":"ContainerStarted","Data":"5172a2fe30c2acea3cd399417bfc5bf583b43e776e547b6ea6a8b62463f56e55"}
Sep 11 13:03:13.646597 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:13.646563    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l" event={"ID":"b6b01a48-7eee-476b-9b55-7e1f126b5b58","Type":"ContainerStarted","Data":"b157dbb0285264a5727c8bd177585fedc158b5cfc1a3ce22af0d0fd47ad73eb6"}
Sep 11 13:03:13.647026 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:13.646626    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:13.750480 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:13.750426    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l" podStartSLOduration=2.077720114 podStartE2EDuration="3.7504109s" totalImagesPullingTime="1.672690786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:13.7470739 +0000 UTC m=+463.250938295" watchObservedRunningTime="2026-09-11 13:03:13.7504109 +0000 UTC m=+463.254275293"
Sep 11 13:03:13.971056 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:13.970978    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-89v6f"]
Sep 11 13:03:13.974075 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:13.974059    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-89v6f"
Sep 11 13:03:13.977316 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:13.977295    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8mw5x\""
Sep 11 13:03:13.977586 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:13.977573    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 13:03:14.004829 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:14.004804    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-89v6f"]
Sep 11 13:03:14.040732 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:14.040697    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjs5t\" (UniqueName: \"kubernetes.io/projected/3ef51b41-6453-49d3-89f0-e875a5437ebd-kube-api-access-fjs5t\") pod \"dns-operator-controller-manager-7b84cd7c9c-89v6f\" (UID: \"3ef51b41-6453-49d3-89f0-e875a5437ebd\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-89v6f"
Sep 11 13:03:14.142028 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:14.142002    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjs5t\" (UniqueName: \"kubernetes.io/projected/3ef51b41-6453-49d3-89f0-e875a5437ebd-kube-api-access-fjs5t\") pod \"dns-operator-controller-manager-7b84cd7c9c-89v6f\" (UID: \"3ef51b41-6453-49d3-89f0-e875a5437ebd\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-89v6f"
Sep 11 13:03:14.157275 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:14.157245    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjs5t\" (UniqueName: \"kubernetes.io/projected/3ef51b41-6453-49d3-89f0-e875a5437ebd-kube-api-access-fjs5t\") pod \"dns-operator-controller-manager-7b84cd7c9c-89v6f\" (UID: \"3ef51b41-6453-49d3-89f0-e875a5437ebd\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-89v6f"
Sep 11 13:03:14.284294 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:14.284265    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-89v6f"
Sep 11 13:03:14.570814 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:14.570791    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-89v6f"]
Sep 11 13:03:14.572988 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:03:14.572959    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ef51b41_6453_49d3_89f0_e875a5437ebd.slice/crio-193e706885532ca57d4e2c2f12960052804a06cb79f8ef3f4dea204801f9c91b WatchSource:0}: Error finding container 193e706885532ca57d4e2c2f12960052804a06cb79f8ef3f4dea204801f9c91b: Status 404 returned error can't find the container with id 193e706885532ca57d4e2c2f12960052804a06cb79f8ef3f4dea204801f9c91b
Sep 11 13:03:14.651183 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:14.651152    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-89v6f" event={"ID":"3ef51b41-6453-49d3-89f0-e875a5437ebd","Type":"ContainerStarted","Data":"193e706885532ca57d4e2c2f12960052804a06cb79f8ef3f4dea204801f9c91b"}
Sep 11 13:03:16.662370 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:16.662330    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-89v6f" event={"ID":"3ef51b41-6453-49d3-89f0-e875a5437ebd","Type":"ContainerStarted","Data":"df88ebd16aa43298e6f7fa48bfea9dccfcc2806304f2e7eac5454a20bc27d0bd"}
Sep 11 13:03:16.662752 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:16.662459    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-89v6f"
Sep 11 13:03:16.681573 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:16.681526    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-89v6f" podStartSLOduration=2.104133928 podStartE2EDuration="3.681513397s" totalImagesPullingTime="1.577379469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:16.680249501 +0000 UTC m=+466.184113894" watchObservedRunningTime="2026-09-11 13:03:16.681513397 +0000 UTC m=+466.185377789"
Sep 11 13:03:19.628681 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:19.628653    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-sj4ss"
Sep 11 13:03:24.653149 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:24.653120    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:27.126514 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.126479    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"]
Sep 11 13:03:27.126979 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.126708    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l" podUID="b6b01a48-7eee-476b-9b55-7e1f126b5b58" containerName="manager" containerID="cri-o://b157dbb0285264a5727c8bd177585fedc158b5cfc1a3ce22af0d0fd47ad73eb6" gracePeriod=2
Sep 11 13:03:27.143448 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.143102    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"]
Sep 11 13:03:27.163110 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.163080    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-8bjnx"]
Sep 11 13:03:27.163878 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.163853    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6b01a48-7eee-476b-9b55-7e1f126b5b58" containerName="manager"
Sep 11 13:03:27.164012 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.164001    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6b01a48-7eee-476b-9b55-7e1f126b5b58" containerName="manager"
Sep 11 13:03:27.164151 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.164141    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6b01a48-7eee-476b-9b55-7e1f126b5b58" containerName="manager"
Sep 11 13:03:27.169002 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.168983    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-8bjnx"
Sep 11 13:03:27.199396 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.199365    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-8bjnx"]
Sep 11 13:03:27.273125 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:03:27.273086    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ndf9l\" is forbidden: User \"system:node:ip-10-0-142-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-110.ec2.internal' and this object" podUID="b6b01a48-7eee-476b-9b55-7e1f126b5b58" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:27.349855 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.349817    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4rrt\" (UniqueName: \"kubernetes.io/projected/568b55b8-0fa6-4266-a828-789dc1d3dc9a-kube-api-access-d4rrt\") pod \"limitador-operator-controller-manager-74495c69f8-8bjnx\" (UID: \"568b55b8-0fa6-4266-a828-789dc1d3dc9a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-8bjnx"
Sep 11 13:03:27.371587 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.371567    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:27.373847 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:03:27.373817    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ndf9l\" is forbidden: User \"system:node:ip-10-0-142-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-110.ec2.internal' and this object" podUID="b6b01a48-7eee-476b-9b55-7e1f126b5b58" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:27.451167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.451089    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4rrt\" (UniqueName: \"kubernetes.io/projected/568b55b8-0fa6-4266-a828-789dc1d3dc9a-kube-api-access-d4rrt\") pod \"limitador-operator-controller-manager-74495c69f8-8bjnx\" (UID: \"568b55b8-0fa6-4266-a828-789dc1d3dc9a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-8bjnx"
Sep 11 13:03:27.465480 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.465456    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4rrt\" (UniqueName: \"kubernetes.io/projected/568b55b8-0fa6-4266-a828-789dc1d3dc9a-kube-api-access-d4rrt\") pod \"limitador-operator-controller-manager-74495c69f8-8bjnx\" (UID: \"568b55b8-0fa6-4266-a828-789dc1d3dc9a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-8bjnx"
Sep 11 13:03:27.509569 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.509545    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-8bjnx"
Sep 11 13:03:27.551587 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.551559    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq9m9\" (UniqueName: \"kubernetes.io/projected/b6b01a48-7eee-476b-9b55-7e1f126b5b58-kube-api-access-jq9m9\") pod \"b6b01a48-7eee-476b-9b55-7e1f126b5b58\" (UID: \"b6b01a48-7eee-476b-9b55-7e1f126b5b58\") "
Sep 11 13:03:27.554066 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.554020    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6b01a48-7eee-476b-9b55-7e1f126b5b58-kube-api-access-jq9m9" (OuterVolumeSpecName: "kube-api-access-jq9m9") pod "b6b01a48-7eee-476b-9b55-7e1f126b5b58" (UID: "b6b01a48-7eee-476b-9b55-7e1f126b5b58"). InnerVolumeSpecName "kube-api-access-jq9m9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:03:27.652608 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.652572    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq9m9\" (UniqueName: \"kubernetes.io/projected/b6b01a48-7eee-476b-9b55-7e1f126b5b58-kube-api-access-jq9m9\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:03:27.667870 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.667844    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-89v6f"
Sep 11 13:03:27.692765 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:03:27.692706    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ndf9l\" is forbidden: User \"system:node:ip-10-0-142-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-110.ec2.internal' and this object" podUID="b6b01a48-7eee-476b-9b55-7e1f126b5b58" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:27.710353 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.710268    2547 generic.go:356] "Generic (PLEG): container finished" podID="b6b01a48-7eee-476b-9b55-7e1f126b5b58" containerID="b157dbb0285264a5727c8bd177585fedc158b5cfc1a3ce22af0d0fd47ad73eb6" exitCode=0
Sep 11 13:03:27.710353 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.710331    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:27.710515 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.710374    2547 scope.go:117] "RemoveContainer" containerID="b157dbb0285264a5727c8bd177585fedc158b5cfc1a3ce22af0d0fd47ad73eb6"
Sep 11 13:03:27.712420 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:03:27.712395    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ndf9l\" is forbidden: User \"system:node:ip-10-0-142-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-110.ec2.internal' and this object" podUID="b6b01a48-7eee-476b-9b55-7e1f126b5b58" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:27.718385 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.718359    2547 scope.go:117] "RemoveContainer" containerID="b157dbb0285264a5727c8bd177585fedc158b5cfc1a3ce22af0d0fd47ad73eb6"
Sep 11 13:03:27.718647 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:03:27.718631    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b157dbb0285264a5727c8bd177585fedc158b5cfc1a3ce22af0d0fd47ad73eb6\": container with ID starting with b157dbb0285264a5727c8bd177585fedc158b5cfc1a3ce22af0d0fd47ad73eb6 not found: ID does not exist" containerID="b157dbb0285264a5727c8bd177585fedc158b5cfc1a3ce22af0d0fd47ad73eb6"
Sep 11 13:03:27.718740 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.718654    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b157dbb0285264a5727c8bd177585fedc158b5cfc1a3ce22af0d0fd47ad73eb6"} err="failed to get container status \"b157dbb0285264a5727c8bd177585fedc158b5cfc1a3ce22af0d0fd47ad73eb6\": rpc error: code = NotFound desc = could not find container \"b157dbb0285264a5727c8bd177585fedc158b5cfc1a3ce22af0d0fd47ad73eb6\": container with ID starting with b157dbb0285264a5727c8bd177585fedc158b5cfc1a3ce22af0d0fd47ad73eb6 not found: ID does not exist"
Sep 11 13:03:27.722790 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:03:27.722759    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ndf9l\" is forbidden: User \"system:node:ip-10-0-142-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-110.ec2.internal' and this object" podUID="b6b01a48-7eee-476b-9b55-7e1f126b5b58" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:27.792558 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:27.792451    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-8bjnx"]
Sep 11 13:03:27.795205 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:03:27.795178    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod568b55b8_0fa6_4266_a828_789dc1d3dc9a.slice/crio-7cc5500534f98a9c566ede166646421ba0a9ecca379a119d2aef52ea2f93d060 WatchSource:0}: Error finding container 7cc5500534f98a9c566ede166646421ba0a9ecca379a119d2aef52ea2f93d060: Status 404 returned error can't find the container with id 7cc5500534f98a9c566ede166646421ba0a9ecca379a119d2aef52ea2f93d060
Sep 11 13:03:28.717256 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:28.717220    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-8bjnx" event={"ID":"568b55b8-0fa6-4266-a828-789dc1d3dc9a","Type":"ContainerStarted","Data":"05e75f72e7cfc729ff8470654ee1e0f3ed759da91109558dc61b0d1c32f52ab4"}
Sep 11 13:03:28.717641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:28.717277    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-8bjnx" event={"ID":"568b55b8-0fa6-4266-a828-789dc1d3dc9a","Type":"ContainerStarted","Data":"7cc5500534f98a9c566ede166646421ba0a9ecca379a119d2aef52ea2f93d060"}
Sep 11 13:03:28.717641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:28.717362    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-8bjnx"
Sep 11 13:03:28.774475 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:03:28.774400    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-ndf9l\" is forbidden: User \"system:node:ip-10-0-142-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-142-110.ec2.internal' and this object" podUID="b6b01a48-7eee-476b-9b55-7e1f126b5b58" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ndf9l"
Sep 11 13:03:28.775348 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:28.775304    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-8bjnx" podStartSLOduration=1.77528883 podStartE2EDuration="1.77528883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:28.772238813 +0000 UTC m=+478.276103206" watchObservedRunningTime="2026-09-11 13:03:28.77528883 +0000 UTC m=+478.279153224"
Sep 11 13:03:29.006014 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:29.005940    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6b01a48-7eee-476b-9b55-7e1f126b5b58" path="/var/lib/kubelet/pods/b6b01a48-7eee-476b-9b55-7e1f126b5b58/volumes"
Sep 11 13:03:39.723705 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:39.723672    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-8bjnx"
Sep 11 13:03:58.354034 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.354005    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"]
Sep 11 13:03:58.357448 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.357427    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.361209 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.361188    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5wtl5\""
Sep 11 13:03:58.361791 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.361768    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.361853 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.361809    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.361898 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.361881    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5tpn\" (UniqueName: \"kubernetes.io/projected/05776d44-651e-44ef-b37e-f2a05e9dadd4-kube-api-access-c5tpn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.361970 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.361951    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05776d44-651e-44ef-b37e-f2a05e9dadd4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.362006 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.361989    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.362039 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.362016    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05776d44-651e-44ef-b37e-f2a05e9dadd4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.362081 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.362048    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.362081 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.362068    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05776d44-651e-44ef-b37e-f2a05e9dadd4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.362167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.362088    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.382974 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.382944    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"]
Sep 11 13:03:58.462373 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.462340    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.462373 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.462373    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05776d44-651e-44ef-b37e-f2a05e9dadd4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.462587 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.462393    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.462587 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.462416    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.462698 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.462629    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.462789 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.462710    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5tpn\" (UniqueName: \"kubernetes.io/projected/05776d44-651e-44ef-b37e-f2a05e9dadd4-kube-api-access-c5tpn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.462789 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.462767    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.462789 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.462780    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05776d44-651e-44ef-b37e-f2a05e9dadd4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.462937 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.462804    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.462937 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.462814    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.462937 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.462850    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.462937 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.462869    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05776d44-651e-44ef-b37e-f2a05e9dadd4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.463083 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.462959    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.463216 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.463195    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05776d44-651e-44ef-b37e-f2a05e9dadd4-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.464972 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.464950    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05776d44-651e-44ef-b37e-f2a05e9dadd4-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.465253 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.465236    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05776d44-651e-44ef-b37e-f2a05e9dadd4-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.471004 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.470983    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05776d44-651e-44ef-b37e-f2a05e9dadd4-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.473079 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.473054    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5tpn\" (UniqueName: \"kubernetes.io/projected/05776d44-651e-44ef-b37e-f2a05e9dadd4-kube-api-access-c5tpn\") pod \"maas-default-gateway-openshift-default-78bb78ff78-nf8zn\" (UID: \"05776d44-651e-44ef-b37e-f2a05e9dadd4\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.667571 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.667484    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:03:58.942119 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.942095    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"]
Sep 11 13:03:58.944228 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:03:58.944203    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05776d44_651e_44ef_b37e_f2a05e9dadd4.slice/crio-e1878cb9bffabe702be2c7f9a6798275ae61498bd45648c431e3a210c40bc7d9 WatchSource:0}: Error finding container e1878cb9bffabe702be2c7f9a6798275ae61498bd45648c431e3a210c40bc7d9: Status 404 returned error can't find the container with id e1878cb9bffabe702be2c7f9a6798275ae61498bd45648c431e3a210c40bc7d9
Sep 11 13:03:58.946269 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.946241    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:03:58.946340 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.946303    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:03:58.946340 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:58.946331    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:03:59.843668 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:59.843636    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn" event={"ID":"05776d44-651e-44ef-b37e-f2a05e9dadd4","Type":"ContainerStarted","Data":"a0307ba2b830346200367e90d0c22233df420f5f1b831c3a123a090b043f8556"}
Sep 11 13:03:59.844078 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:59.843710    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn" event={"ID":"05776d44-651e-44ef-b37e-f2a05e9dadd4","Type":"ContainerStarted","Data":"e1878cb9bffabe702be2c7f9a6798275ae61498bd45648c431e3a210c40bc7d9"}
Sep 11 13:03:59.888561 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:03:59.888513    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn" podStartSLOduration=1.888496196 podStartE2EDuration="1.888496196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:03:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:03:59.887404203 +0000 UTC m=+509.391268597" watchObservedRunningTime="2026-09-11 13:03:59.888496196 +0000 UTC m=+509.392360638"
Sep 11 13:04:00.668575 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:00.668538    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:04:00.673145 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:00.673122    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:04:00.848198 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:00.848172    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:04:00.849075 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:00.849055    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:04:01.491892 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:01.491855    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:04:01.495190 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:01.495168    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"
Sep 11 13:04:01.500083 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:01.500065    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rxs7x\""
Sep 11 13:04:01.500378 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:01.500364    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 13:04:01.509608 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:01.509585    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:04:01.547102 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:01.547070    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:04:01.590013 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:01.589977    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmqpq\" (UniqueName: \"kubernetes.io/projected/3162ee1e-4106-4b20-9bec-f3d88b08ec62-kube-api-access-hmqpq\") pod \"limitador-limitador-84994f7ffc-5nmfp\" (UID: \"3162ee1e-4106-4b20-9bec-f3d88b08ec62\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"
Sep 11 13:04:01.590193 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:01.590046    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3162ee1e-4106-4b20-9bec-f3d88b08ec62-config-file\") pod \"limitador-limitador-84994f7ffc-5nmfp\" (UID: \"3162ee1e-4106-4b20-9bec-f3d88b08ec62\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"
Sep 11 13:04:01.690524 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:01.690487    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqpq\" (UniqueName: \"kubernetes.io/projected/3162ee1e-4106-4b20-9bec-f3d88b08ec62-kube-api-access-hmqpq\") pod \"limitador-limitador-84994f7ffc-5nmfp\" (UID: \"3162ee1e-4106-4b20-9bec-f3d88b08ec62\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"
Sep 11 13:04:01.690754 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:01.690537    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3162ee1e-4106-4b20-9bec-f3d88b08ec62-config-file\") pod \"limitador-limitador-84994f7ffc-5nmfp\" (UID: \"3162ee1e-4106-4b20-9bec-f3d88b08ec62\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"
Sep 11 13:04:01.691185 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:01.691165    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3162ee1e-4106-4b20-9bec-f3d88b08ec62-config-file\") pod \"limitador-limitador-84994f7ffc-5nmfp\" (UID: \"3162ee1e-4106-4b20-9bec-f3d88b08ec62\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"
Sep 11 13:04:01.699256 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:01.699224    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmqpq\" (UniqueName: \"kubernetes.io/projected/3162ee1e-4106-4b20-9bec-f3d88b08ec62-kube-api-access-hmqpq\") pod \"limitador-limitador-84994f7ffc-5nmfp\" (UID: \"3162ee1e-4106-4b20-9bec-f3d88b08ec62\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"
Sep 11 13:04:01.805389 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:01.805353    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"
Sep 11 13:04:02.081298 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:02.081274    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:04:02.083322 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:04:02.083297    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3162ee1e_4106_4b20_9bec_f3d88b08ec62.slice/crio-bef63dc8cab0514788f964022389f62793d52e3418cc3ec04cf0e84e04d8f433 WatchSource:0}: Error finding container bef63dc8cab0514788f964022389f62793d52e3418cc3ec04cf0e84e04d8f433: Status 404 returned error can't find the container with id bef63dc8cab0514788f964022389f62793d52e3418cc3ec04cf0e84e04d8f433
Sep 11 13:04:02.860547 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:02.860508    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nmfp" event={"ID":"3162ee1e-4106-4b20-9bec-f3d88b08ec62","Type":"ContainerStarted","Data":"bef63dc8cab0514788f964022389f62793d52e3418cc3ec04cf0e84e04d8f433"}
Sep 11 13:04:03.866344 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:03.866310    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nmfp" event={"ID":"3162ee1e-4106-4b20-9bec-f3d88b08ec62","Type":"ContainerStarted","Data":"2806c0e8066a9911d1805acbf020ca68d9777801194d5df908d0bc6dc3db6668"}
Sep 11 13:04:03.866749 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:03.866383    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"
Sep 11 13:04:03.892464 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:03.892412    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nmfp" podStartSLOduration=1.909538666 podStartE2EDuration="2.892396168s" totalImagesPullingTime="982.857502ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:04:03.891651747 +0000 UTC m=+513.395516139" watchObservedRunningTime="2026-09-11 13:04:03.892396168 +0000 UTC m=+513.396260561"
Sep 11 13:04:14.871462 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:04:14.871427    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"
Sep 11 13:05:18.037743 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:18.037656    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:05:27.207670 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:27.207590    2547 generic.go:356] "Generic (PLEG): container finished" podID="05776d44-651e-44ef-b37e-f2a05e9dadd4" containerID="a0307ba2b830346200367e90d0c22233df420f5f1b831c3a123a090b043f8556" exitCode=0
Sep 11 13:05:27.207670 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:27.207657    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn" event={"ID":"05776d44-651e-44ef-b37e-f2a05e9dadd4","Type":"ContainerDied","Data":"a0307ba2b830346200367e90d0c22233df420f5f1b831c3a123a090b043f8556"}
Sep 11 13:05:27.208137 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:27.208012    2547 scope.go:117] "RemoveContainer" containerID="a0307ba2b830346200367e90d0c22233df420f5f1b831c3a123a090b043f8556"
Sep 11 13:05:27.208930 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:27.208903    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:05:27.208989 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:27.208969    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:05:27.209026 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:27.209000    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:05:28.213489 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:28.213460    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn" event={"ID":"05776d44-651e-44ef-b37e-f2a05e9dadd4","Type":"ContainerStarted","Data":"1b777dbbbf0dd173bd5dfb8e271be95b1a0c3c097aef1aa9ad7ff9709d0844d6"}
Sep 11 13:05:28.668620 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:28.668572    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:05:28.669877 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:28.669851    2547 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nf8zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" start-of-body=
Sep 11 13:05:28.669995 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:28.669902    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn" podUID="05776d44-651e-44ef-b37e-f2a05e9dadd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused"
Sep 11 13:05:29.668830 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:29.668790    2547 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nf8zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" start-of-body=
Sep 11 13:05:29.669215 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:29.668851    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn" podUID="05776d44-651e-44ef-b37e-f2a05e9dadd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused"
Sep 11 13:05:30.667976 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:30.667933    2547 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nf8zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" start-of-body=
Sep 11 13:05:30.668147 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:30.668006    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn" podUID="05776d44-651e-44ef-b37e-f2a05e9dadd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused"
Sep 11 13:05:30.849327 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:30.848593    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:05:31.668556 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:31.668516    2547 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nf8zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" start-of-body=
Sep 11 13:05:31.668763 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:31.668586    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn" podUID="05776d44-651e-44ef-b37e-f2a05e9dadd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused"
Sep 11 13:05:32.668750 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:32.668697    2547 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-nf8zn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused" start-of-body=
Sep 11 13:05:32.669132 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:32.668769    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn" podUID="05776d44-651e-44ef-b37e-f2a05e9dadd4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.23:15021/healthz/ready\": dial tcp 10.132.0.23:15021: connect: connection refused"
Sep 11 13:05:33.671967 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:33.671937    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:05:33.672890 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:33.672870    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-nf8zn"
Sep 11 13:05:36.916770 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:36.916733    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:05:53.618523 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:05:53.618439    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:06:04.316918 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:04.316879    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:06:13.958978 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:13.958943    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:06:18.018663 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.018626    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"]
Sep 11 13:06:18.021901 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.021885    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.025740 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.025696    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 11 13:06:18.025886 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.025748    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 13:06:18.025886 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.025766    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pjglm\""
Sep 11 13:06:18.026023 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.025890    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 13:06:18.033606 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.033581    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"]
Sep 11 13:06:18.115058 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.115016    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/166347c2-238b-468f-ab57-878b1be5df94-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.115245 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.115080    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5c2g\" (UniqueName: \"kubernetes.io/projected/166347c2-238b-468f-ab57-878b1be5df94-kube-api-access-k5c2g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.115245 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.115178    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/166347c2-238b-468f-ab57-878b1be5df94-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.115245 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.115225    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/166347c2-238b-468f-ab57-878b1be5df94-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.115409 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.115365    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/166347c2-238b-468f-ab57-878b1be5df94-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.115456 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.115407    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/166347c2-238b-468f-ab57-878b1be5df94-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.216662 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.216625    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/166347c2-238b-468f-ab57-878b1be5df94-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.216858 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.216687    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5c2g\" (UniqueName: \"kubernetes.io/projected/166347c2-238b-468f-ab57-878b1be5df94-kube-api-access-k5c2g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.216858 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.216737    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/166347c2-238b-468f-ab57-878b1be5df94-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.216858 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.216792    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/166347c2-238b-468f-ab57-878b1be5df94-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.216858 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.216844    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/166347c2-238b-468f-ab57-878b1be5df94-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.217063 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.216871    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/166347c2-238b-468f-ab57-878b1be5df94-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.217161 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.217127    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/166347c2-238b-468f-ab57-878b1be5df94-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.217330 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.217300    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/166347c2-238b-468f-ab57-878b1be5df94-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.217422 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.217348    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/166347c2-238b-468f-ab57-878b1be5df94-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.219763 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.219739    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/166347c2-238b-468f-ab57-878b1be5df94-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.220008 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.219986    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/166347c2-238b-468f-ab57-878b1be5df94-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.226417 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.226388    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5c2g\" (UniqueName: \"kubernetes.io/projected/166347c2-238b-468f-ab57-878b1be5df94-kube-api-access-k5c2g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5\" (UID: \"166347c2-238b-468f-ab57-878b1be5df94\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.332745 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.332687    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:18.606676 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.606651    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"]
Sep 11 13:06:18.609366 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:06:18.609333    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod166347c2_238b_468f_ab57_878b1be5df94.slice/crio-e76a4258eb108b9f598c17a803b90f11a1a0621bc526a31b86872b49e5c72477 WatchSource:0}: Error finding container e76a4258eb108b9f598c17a803b90f11a1a0621bc526a31b86872b49e5c72477: Status 404 returned error can't find the container with id e76a4258eb108b9f598c17a803b90f11a1a0621bc526a31b86872b49e5c72477
Sep 11 13:06:18.611047 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:18.611029    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:06:19.437251 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:19.437210    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5" event={"ID":"166347c2-238b-468f-ab57-878b1be5df94","Type":"ContainerStarted","Data":"e76a4258eb108b9f598c17a803b90f11a1a0621bc526a31b86872b49e5c72477"}
Sep 11 13:06:19.530799 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:19.530761    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:06:20.443936 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:20.443902    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5" event={"ID":"166347c2-238b-468f-ab57-878b1be5df94","Type":"ContainerStarted","Data":"053a338eafc32b3b24edb688432fdc7b3e020676718244a6883b1d896887ae3f"}
Sep 11 13:06:20.465085 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:20.465029    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5" podStartSLOduration=1.470216807 podStartE2EDuration="2.46501076s" totalImagesPullingTime="994.793953ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:06:20.463126682 +0000 UTC m=+649.966991098" watchObservedRunningTime="2026-09-11 13:06:20.46501076 +0000 UTC m=+649.968875152"
Sep 11 13:06:28.332989 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:28.332949    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:28.333493 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:28.333006    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:28.345203 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:28.345170    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:28.486989 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:28.486960    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5"
Sep 11 13:06:35.948282 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:35.948243    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:06:51.656358 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:06:51.656323    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:08:21.532700 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.532661    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"]
Sep 11 13:08:21.535935 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.535916    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.540814 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.540791    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-528ff6-openshift-default-dockercfg-j5t9d\""
Sep 11 13:08:21.567444 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.567408    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"]
Sep 11 13:08:21.649886 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.649851    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-podinfo\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.649886 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.649889    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90478a56-0c65-4f7d-9d39-95a7720e8622-istiod-ca-cert\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.650094 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.649986    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-credential-socket\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.650094 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.650025    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-workload-socket\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.650094 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.650054    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-token\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.650204 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.650097    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-envoy\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.650204 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.650120    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-workload-certs\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.650204 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.650139    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkx6k\" (UniqueName: \"kubernetes.io/projected/90478a56-0c65-4f7d-9d39-95a7720e8622-kube-api-access-gkx6k\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.650204 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.650170    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-data\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.751229 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.751179    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-envoy\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.751229 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.751235    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-workload-certs\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.751492 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.751353    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkx6k\" (UniqueName: \"kubernetes.io/projected/90478a56-0c65-4f7d-9d39-95a7720e8622-kube-api-access-gkx6k\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.751492 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.751395    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-data\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.751492 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.751458    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-podinfo\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.751492 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.751487    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90478a56-0c65-4f7d-9d39-95a7720e8622-istiod-ca-cert\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.751697 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.751535    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-credential-socket\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.751697 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.751574    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-workload-socket\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.751697 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.751601    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-token\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.751697 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.751650    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-workload-certs\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.752312 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.752287    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-data\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.752478 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.752396    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-workload-socket\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.752897 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.752870    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90478a56-0c65-4f7d-9d39-95a7720e8622-istiod-ca-cert\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.753004 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.752984    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-credential-socket\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.754189 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.754142    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-envoy\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.754802 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.754782    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-podinfo\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.763327 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.763302    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkx6k\" (UniqueName: \"kubernetes.io/projected/90478a56-0c65-4f7d-9d39-95a7720e8622-kube-api-access-gkx6k\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.764038 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.764014    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-token\") pod \"e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") " pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:21.846933 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:21.846847    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:22.129972 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:22.129888    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"]
Sep 11 13:08:22.133276 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:08:22.133244    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90478a56_0c65_4f7d_9d39_95a7720e8622.slice/crio-22aa785720a7fc6839178d60e81dbd95c5c1e770ec35ed6a22a66611ef4854a9 WatchSource:0}: Error finding container 22aa785720a7fc6839178d60e81dbd95c5c1e770ec35ed6a22a66611ef4854a9: Status 404 returned error can't find the container with id 22aa785720a7fc6839178d60e81dbd95c5c1e770ec35ed6a22a66611ef4854a9
Sep 11 13:08:22.135580 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:22.135548    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:22.135671 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:22.135633    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:22.135748 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:22.135675    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:22.958553 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:22.958521    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" event={"ID":"90478a56-0c65-4f7d-9d39-95a7720e8622","Type":"ContainerStarted","Data":"d2bb88ba9b8e25f1a8ed994eb371a47d578a8d4db66d8711d1f040c520630ff6"}
Sep 11 13:08:22.958994 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:22.958570    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" event={"ID":"90478a56-0c65-4f7d-9d39-95a7720e8622","Type":"ContainerStarted","Data":"22aa785720a7fc6839178d60e81dbd95c5c1e770ec35ed6a22a66611ef4854a9"}
Sep 11 13:08:22.988295 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:22.988238    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" podStartSLOduration=1.988221477 podStartE2EDuration="1.988221477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:22.986502021 +0000 UTC m=+772.490366414" watchObservedRunningTime="2026-09-11 13:08:22.988221477 +0000 UTC m=+772.492085870"
Sep 11 13:08:23.847263 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:23.847219    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:23.852369 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:23.852342    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:23.962804 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:23.962774    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:23.963890 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:23.963870    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:24.980191 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:24.980161    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:08:27.230056 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.230022    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"]
Sep 11 13:08:27.233170 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.233151    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"
Sep 11 13:08:27.236550 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.236525    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-528ff6-dockercfg-5wvdm\""
Sep 11 13:08:27.236681 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.236577    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-528ff6\""
Sep 11 13:08:27.250841 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.250812    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"]
Sep 11 13:08:27.401730 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.401683    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss4ch\" (UniqueName: \"kubernetes.io/projected/c0d59ba9-257e-4488-85dc-5c5b2bfce8d2-kube-api-access-ss4ch\") pod \"payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5\" (UID: \"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"
Sep 11 13:08:27.401900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.401740    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0d59ba9-257e-4488-85dc-5c5b2bfce8d2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5\" (UID: \"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"
Sep 11 13:08:27.482112 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.482033    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7790-7767af"]
Sep 11 13:08:27.485142 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.485123    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7790-7767af"
Sep 11 13:08:27.488494 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.488472    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-46lmf\""
Sep 11 13:08:27.497398 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.497372    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7790-7767af"]
Sep 11 13:08:27.502953 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.502928    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss4ch\" (UniqueName: \"kubernetes.io/projected/c0d59ba9-257e-4488-85dc-5c5b2bfce8d2-kube-api-access-ss4ch\") pod \"payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5\" (UID: \"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"
Sep 11 13:08:27.503059 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.502966    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0d59ba9-257e-4488-85dc-5c5b2bfce8d2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5\" (UID: \"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"
Sep 11 13:08:27.503668 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.503649    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0d59ba9-257e-4488-85dc-5c5b2bfce8d2-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5\" (UID: \"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"
Sep 11 13:08:27.513572 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.513539    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss4ch\" (UniqueName: \"kubernetes.io/projected/c0d59ba9-257e-4488-85dc-5c5b2bfce8d2-kube-api-access-ss4ch\") pod \"payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5\" (UID: \"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"
Sep 11 13:08:27.543178 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.543147    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"
Sep 11 13:08:27.604462 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.604427    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgv7v\" (UniqueName: \"kubernetes.io/projected/1c24171b-6f42-4955-9a17-8854248a21fe-kube-api-access-tgv7v\") pod \"test-curl-7790-7767af\" (UID: \"1c24171b-6f42-4955-9a17-8854248a21fe\") " pod="opendatahub/test-curl-7790-7767af"
Sep 11 13:08:27.705621 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.705584    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgv7v\" (UniqueName: \"kubernetes.io/projected/1c24171b-6f42-4955-9a17-8854248a21fe-kube-api-access-tgv7v\") pod \"test-curl-7790-7767af\" (UID: \"1c24171b-6f42-4955-9a17-8854248a21fe\") " pod="opendatahub/test-curl-7790-7767af"
Sep 11 13:08:27.715580 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.715554    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgv7v\" (UniqueName: \"kubernetes.io/projected/1c24171b-6f42-4955-9a17-8854248a21fe-kube-api-access-tgv7v\") pod \"test-curl-7790-7767af\" (UID: \"1c24171b-6f42-4955-9a17-8854248a21fe\") " pod="opendatahub/test-curl-7790-7767af"
Sep 11 13:08:27.793472 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.793441    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7790-7767af"
Sep 11 13:08:27.818664 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.818633    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"]
Sep 11 13:08:27.821141 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:08:27.821117    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d59ba9_257e_4488_85dc_5c5b2bfce8d2.slice/crio-3e99a5a44f535b6a57bf3d987457527f50315cf74193575996d82420bb7be220 WatchSource:0}: Error finding container 3e99a5a44f535b6a57bf3d987457527f50315cf74193575996d82420bb7be220: Status 404 returned error can't find the container with id 3e99a5a44f535b6a57bf3d987457527f50315cf74193575996d82420bb7be220
Sep 11 13:08:27.981413 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:27.981379    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5" event={"ID":"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2","Type":"ContainerStarted","Data":"3e99a5a44f535b6a57bf3d987457527f50315cf74193575996d82420bb7be220"}
Sep 11 13:08:28.079349 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:28.079267    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7790-7767af"]
Sep 11 13:08:28.082044 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:08:28.082014    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c24171b_6f42_4955_9a17_8854248a21fe.slice/crio-ad1c142f496f0b802ab61b3409af4538119d71eb0cc0fcfcec8d3154abb0848b WatchSource:0}: Error finding container ad1c142f496f0b802ab61b3409af4538119d71eb0cc0fcfcec8d3154abb0848b: Status 404 returned error can't find the container with id ad1c142f496f0b802ab61b3409af4538119d71eb0cc0fcfcec8d3154abb0848b
Sep 11 13:08:28.989794 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:28.989754    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7790-7767af" event={"ID":"1c24171b-6f42-4955-9a17-8854248a21fe","Type":"ContainerStarted","Data":"ad1c142f496f0b802ab61b3409af4538119d71eb0cc0fcfcec8d3154abb0848b"}
Sep 11 13:08:31.150501 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.150440    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"]
Sep 11 13:08:31.153812 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.153791    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.157109 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.157082    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-976b6f6f-openshift-default-dockercfg-844cg\""
Sep 11 13:08:31.175011 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.174985    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"]
Sep 11 13:08:31.240930 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.240825    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-credential-socket\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.240930 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.240871    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-istio-data\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.240930 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.240913    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-istio-envoy\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.241190 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.241018    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-workload-socket\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.241190 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.241059    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aea02725-d149-4763-a14e-1b02b0ac751a-istio-podinfo\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.241190 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.241142    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55ldc\" (UniqueName: \"kubernetes.io/projected/aea02725-d149-4763-a14e-1b02b0ac751a-kube-api-access-55ldc\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.241317 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.241211    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aea02725-d149-4763-a14e-1b02b0ac751a-istio-token\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.241317 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.241237    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-workload-certs\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.241317 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.241273    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aea02725-d149-4763-a14e-1b02b0ac751a-istiod-ca-cert\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.342534 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.342490    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55ldc\" (UniqueName: \"kubernetes.io/projected/aea02725-d149-4763-a14e-1b02b0ac751a-kube-api-access-55ldc\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.342778 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.342552    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aea02725-d149-4763-a14e-1b02b0ac751a-istio-token\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.342778 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.342572    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-workload-certs\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.342778 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.342769    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aea02725-d149-4763-a14e-1b02b0ac751a-istiod-ca-cert\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.342957 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.342846    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-credential-socket\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.342957 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.342873    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-istio-data\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.342957 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.342915    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-istio-envoy\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.342957 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.342944    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-workload-socket\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.343168 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.342970    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aea02725-d149-4763-a14e-1b02b0ac751a-istio-podinfo\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.343168 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.343036    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-workload-certs\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.343278 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.343227    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-istio-data\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.343360 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.343326    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-workload-socket\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.343427 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.343404    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-credential-socket\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.343551 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.343527    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aea02725-d149-4763-a14e-1b02b0ac751a-istiod-ca-cert\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.345284 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.345249    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-istio-envoy\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.345405 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.345384    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aea02725-d149-4763-a14e-1b02b0ac751a-istio-podinfo\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.354744 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.354692    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aea02725-d149-4763-a14e-1b02b0ac751a-istio-token\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.354861 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.354798    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55ldc\" (UniqueName: \"kubernetes.io/projected/aea02725-d149-4763-a14e-1b02b0ac751a-kube-api-access-55ldc\") pod \"e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") " pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.463732 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.463686    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:31.756375 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.756348    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"]
Sep 11 13:08:31.759079 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:08:31.759044    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea02725_d149_4763_a14e_1b02b0ac751a.slice/crio-8e2eeb0021c158c984981912ebd5bf394518034fdaff6db2ebea8afe849cb5e3 WatchSource:0}: Error finding container 8e2eeb0021c158c984981912ebd5bf394518034fdaff6db2ebea8afe849cb5e3: Status 404 returned error can't find the container with id 8e2eeb0021c158c984981912ebd5bf394518034fdaff6db2ebea8afe849cb5e3
Sep 11 13:08:31.761272 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.761240    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:31.761359 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.761317    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:31.761359 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:31.761345    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:32.012019 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:32.011921    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7790-7767af" event={"ID":"1c24171b-6f42-4955-9a17-8854248a21fe","Type":"ContainerStarted","Data":"750816d3ecda74626f375271f9c7d6383fccd2be75f46b54a3256380da76f823"}
Sep 11 13:08:32.014799 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:32.014707    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5" event={"ID":"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2","Type":"ContainerStarted","Data":"72d261cf7077a32415afa2d3313fb6fd696ca1d50cd8ad8c4f83f62660a0e198"}
Sep 11 13:08:32.015015 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:32.015003    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"
Sep 11 13:08:32.016756 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:32.016664    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" event={"ID":"aea02725-d149-4763-a14e-1b02b0ac751a","Type":"ContainerStarted","Data":"b25ef8c29daa1fe605e9812a1f7c594fa06945c42055c76de5f8688d652e8dbd"}
Sep 11 13:08:32.016756 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:32.016709    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" event={"ID":"aea02725-d149-4763-a14e-1b02b0ac751a","Type":"ContainerStarted","Data":"8e2eeb0021c158c984981912ebd5bf394518034fdaff6db2ebea8afe849cb5e3"}
Sep 11 13:08:32.050546 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:32.050466    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7790-7767af" podStartSLOduration=2.153716633 podStartE2EDuration="5.050445131s" totalImagesPullingTime="2.896728498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:32.049611592 +0000 UTC m=+781.553475999" watchObservedRunningTime="2026-09-11 13:08:32.050445131 +0000 UTC m=+781.554309525"
Sep 11 13:08:32.094577 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:32.094512    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5" podStartSLOduration=1.93744124 podStartE2EDuration="5.094490529s" totalImagesPullingTime="3.157049289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:32.09360525 +0000 UTC m=+781.597469643" watchObservedRunningTime="2026-09-11 13:08:32.094490529 +0000 UTC m=+781.598354923"
Sep 11 13:08:32.138250 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:32.138188    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" podStartSLOduration=1.138171347 podStartE2EDuration="1.138171347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:32.137102749 +0000 UTC m=+781.640967142" watchObservedRunningTime="2026-09-11 13:08:32.138171347 +0000 UTC m=+781.642035740"
Sep 11 13:08:32.465051 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:32.465011    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:32.478242 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:32.478188    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:32.925585 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:32.925549    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7790-7767af"]
Sep 11 13:08:32.931231 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:32.931206    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7790-7767af"]
Sep 11 13:08:33.021438 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:08:33.021400    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7790-7767af" container="test-curl-7790-7767af"
Sep 11 13:08:33.021632 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:33.021563    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:33.022323 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:33.022303    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:34.029617 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.027680    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7790-7767af" podUID="1c24171b-6f42-4955-9a17-8854248a21fe" containerName="test-curl-7790-7767af" containerID="cri-o://750816d3ecda74626f375271f9c7d6383fccd2be75f46b54a3256380da76f823" gracePeriod=2
Sep 11 13:08:34.073310 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.073272    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"]
Sep 11 13:08:34.073630 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.073612    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c24171b-6f42-4955-9a17-8854248a21fe" containerName="test-curl-7790-7767af"
Sep 11 13:08:34.073630 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.073628    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c24171b-6f42-4955-9a17-8854248a21fe" containerName="test-curl-7790-7767af"
Sep 11 13:08:34.073821 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.073690    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c24171b-6f42-4955-9a17-8854248a21fe" containerName="test-curl-7790-7767af"
Sep 11 13:08:34.076881 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.076863    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.085001 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.084981    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-efc023-openshift-default-dockercfg-9wctt\""
Sep 11 13:08:34.124276 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.124240    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"]
Sep 11 13:08:34.175376 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.175325    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-token\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.175577 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.175401    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/269008b9-49c9-4163-b666-1f75b18bb8b8-istiod-ca-cert\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.175577 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.175486    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-envoy\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.175708 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.175660    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-workload-certs\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.175708 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.175695    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-data\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.175856 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.175779    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-workload-socket\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.175922 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.175895    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-credential-socket\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.175980 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.175938    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbzzl\" (UniqueName: \"kubernetes.io/projected/269008b9-49c9-4163-b666-1f75b18bb8b8-kube-api-access-pbzzl\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.176042 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.176007    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-podinfo\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.276956 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.276909    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-workload-certs\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.276956 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.276959    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-data\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.277189 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.277013    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-workload-socket\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.277189 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.277039    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-credential-socket\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.277189 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.277061    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbzzl\" (UniqueName: \"kubernetes.io/projected/269008b9-49c9-4163-b666-1f75b18bb8b8-kube-api-access-pbzzl\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.277189 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.277104    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-podinfo\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.277189 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.277149    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-token\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.277189 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.277168    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/269008b9-49c9-4163-b666-1f75b18bb8b8-istiod-ca-cert\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.277450 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.277203    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-envoy\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.277811 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.277786    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-data\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.277964 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.277937    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-credential-socket\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.278032 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.277977    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-workload-certs\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.278094 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.277840    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-workload-socket\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.278602 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.278580    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/269008b9-49c9-4163-b666-1f75b18bb8b8-istiod-ca-cert\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.280627 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.280491    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-envoy\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.280759 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.280740    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-podinfo\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.288128 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.288090    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbzzl\" (UniqueName: \"kubernetes.io/projected/269008b9-49c9-4163-b666-1f75b18bb8b8-kube-api-access-pbzzl\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.289499 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.289480    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-token\") pod \"e2e-autores-efc023-openshift-default-586b67554d-jxb5m\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") " pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.388879 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.388839    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:34.704226 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.704201    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"]
Sep 11 13:08:34.705906 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:08:34.705876    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod269008b9_49c9_4163_b666_1f75b18bb8b8.slice/crio-038516d42a6da1b0c57a667abadde2cd671b2a85c2cf32634ac91fe7f1d0cce8 WatchSource:0}: Error finding container 038516d42a6da1b0c57a667abadde2cd671b2a85c2cf32634ac91fe7f1d0cce8: Status 404 returned error can't find the container with id 038516d42a6da1b0c57a667abadde2cd671b2a85c2cf32634ac91fe7f1d0cce8
Sep 11 13:08:34.708214 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.708185    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:34.708289 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.708248    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:34.708289 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:34.708278    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:35.034319 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:35.034282    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" event={"ID":"269008b9-49c9-4163-b666-1f75b18bb8b8","Type":"ContainerStarted","Data":"53ba30d836facf6664661308daa1e41fc252d06c2b03cb9859de9eb71a8b53a7"}
Sep 11 13:08:35.034787 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:35.034337    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" event={"ID":"269008b9-49c9-4163-b666-1f75b18bb8b8","Type":"ContainerStarted","Data":"038516d42a6da1b0c57a667abadde2cd671b2a85c2cf32634ac91fe7f1d0cce8"}
Sep 11 13:08:35.067564 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:35.067490    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" podStartSLOduration=1.067466012 podStartE2EDuration="1.067466012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:35.063673491 +0000 UTC m=+784.567537887" watchObservedRunningTime="2026-09-11 13:08:35.067466012 +0000 UTC m=+784.571330409"
Sep 11 13:08:35.390077 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:35.389996    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:35.395144 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:35.395114    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:36.039495 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:36.039469    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:36.040385 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:36.040368    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:36.273336 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:36.273303    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7790-7767af"
Sep 11 13:08:36.398527 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:36.398431    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgv7v\" (UniqueName: \"kubernetes.io/projected/1c24171b-6f42-4955-9a17-8854248a21fe-kube-api-access-tgv7v\") pod \"1c24171b-6f42-4955-9a17-8854248a21fe\" (UID: \"1c24171b-6f42-4955-9a17-8854248a21fe\") "
Sep 11 13:08:36.400774 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:36.400744    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c24171b-6f42-4955-9a17-8854248a21fe-kube-api-access-tgv7v" (OuterVolumeSpecName: "kube-api-access-tgv7v") pod "1c24171b-6f42-4955-9a17-8854248a21fe" (UID: "1c24171b-6f42-4955-9a17-8854248a21fe"). InnerVolumeSpecName "kube-api-access-tgv7v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:08:36.499677 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:36.499621    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgv7v\" (UniqueName: \"kubernetes.io/projected/1c24171b-6f42-4955-9a17-8854248a21fe-kube-api-access-tgv7v\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:08:36.752413 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:36.752313    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:08:37.006841 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:37.006753    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c24171b-6f42-4955-9a17-8854248a21fe" path="/var/lib/kubelet/pods/1c24171b-6f42-4955-9a17-8854248a21fe/volumes"
Sep 11 13:08:37.047701 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:37.047657    2547 generic.go:356] "Generic (PLEG): container finished" podID="1c24171b-6f42-4955-9a17-8854248a21fe" containerID="750816d3ecda74626f375271f9c7d6383fccd2be75f46b54a3256380da76f823" exitCode=137
Sep 11 13:08:37.047701 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:37.047703    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7790-7767af"
Sep 11 13:08:37.048283 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:37.047794    2547 scope.go:117] "RemoveContainer" containerID="750816d3ecda74626f375271f9c7d6383fccd2be75f46b54a3256380da76f823"
Sep 11 13:08:37.065419 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:37.065390    2547 scope.go:117] "RemoveContainer" containerID="750816d3ecda74626f375271f9c7d6383fccd2be75f46b54a3256380da76f823"
Sep 11 13:08:37.067281 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:08:37.067246    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"750816d3ecda74626f375271f9c7d6383fccd2be75f46b54a3256380da76f823\": container with ID starting with 750816d3ecda74626f375271f9c7d6383fccd2be75f46b54a3256380da76f823 not found: ID does not exist" containerID="750816d3ecda74626f375271f9c7d6383fccd2be75f46b54a3256380da76f823"
Sep 11 13:08:37.067406 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:37.067291    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"750816d3ecda74626f375271f9c7d6383fccd2be75f46b54a3256380da76f823"} err="failed to get container status \"750816d3ecda74626f375271f9c7d6383fccd2be75f46b54a3256380da76f823\": rpc error: code = NotFound desc = could not find container \"750816d3ecda74626f375271f9c7d6383fccd2be75f46b54a3256380da76f823\": container with ID starting with 750816d3ecda74626f375271f9c7d6383fccd2be75f46b54a3256380da76f823 not found: ID does not exist"
Sep 11 13:08:39.964398 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:39.964366    2547 patch_prober.go:28] interesting pod/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 13:08:39.964803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:39.964420    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 13:08:40.437584 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.437542    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"]
Sep 11 13:08:40.441663 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.441637    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.444576 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.444549    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a6ba91-openshift-default-dockercfg-dkmwb\""
Sep 11 13:08:40.458582 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.458553    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"]
Sep 11 13:08:40.532933 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.532894    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-workload-socket\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.533291 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.533259    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-credential-socket\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.533406 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.533303    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1337198d-52af-4648-8f4b-809ac212ece2-istio-token\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.533406 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.533335    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1337198d-52af-4648-8f4b-809ac212ece2-istiod-ca-cert\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.533406 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.533373    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b76zw\" (UniqueName: \"kubernetes.io/projected/1337198d-52af-4648-8f4b-809ac212ece2-kube-api-access-b76zw\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.533581 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.533413    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-istio-data\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.533581 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.533493    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-workload-certs\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.533581 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.533523    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-istio-envoy\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.533581 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.533553    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1337198d-52af-4648-8f4b-809ac212ece2-istio-podinfo\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.634658 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.634618    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-workload-socket\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.634658 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.634670    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-credential-socket\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.634967 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.634687    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1337198d-52af-4648-8f4b-809ac212ece2-istio-token\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.634967 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.634711    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1337198d-52af-4648-8f4b-809ac212ece2-istiod-ca-cert\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.634967 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.634771    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b76zw\" (UniqueName: \"kubernetes.io/projected/1337198d-52af-4648-8f4b-809ac212ece2-kube-api-access-b76zw\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.634967 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.634814    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-istio-data\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.634967 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.634896    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-workload-certs\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.634967 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.634928    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-istio-envoy\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.634967 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.634955    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1337198d-52af-4648-8f4b-809ac212ece2-istio-podinfo\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.635316 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.635139    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-workload-socket\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.635316 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.635231    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-credential-socket\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.635316 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.635307    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-istio-data\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.635464 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.635376    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-workload-certs\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.635548 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.635527    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1337198d-52af-4648-8f4b-809ac212ece2-istiod-ca-cert\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.637368 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.637337    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-istio-envoy\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.637577 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.637561    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1337198d-52af-4648-8f4b-809ac212ece2-istio-podinfo\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.644302 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.644279    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1337198d-52af-4648-8f4b-809ac212ece2-istio-token\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.644506 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.644489    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b76zw\" (UniqueName: \"kubernetes.io/projected/1337198d-52af-4648-8f4b-809ac212ece2-kube-api-access-b76zw\") pod \"e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") " pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:40.752835 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:40.752744    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:41.050785 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:41.050563    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"]
Sep 11 13:08:41.053215 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:08:41.053180    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1337198d_52af_4648_8f4b_809ac212ece2.slice/crio-4a5e4c3715ecb58f6722d00f07484d48792816d72a5f10d8e185f6358912fc47 WatchSource:0}: Error finding container 4a5e4c3715ecb58f6722d00f07484d48792816d72a5f10d8e185f6358912fc47: Status 404 returned error can't find the container with id 4a5e4c3715ecb58f6722d00f07484d48792816d72a5f10d8e185f6358912fc47
Sep 11 13:08:41.055366 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:41.055334    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:41.055429 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:41.055401    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:41.055481 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:41.055428    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:41.068535 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:41.068501    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4" event={"ID":"1337198d-52af-4648-8f4b-809ac212ece2","Type":"ContainerStarted","Data":"4a5e4c3715ecb58f6722d00f07484d48792816d72a5f10d8e185f6358912fc47"}
Sep 11 13:08:41.070213 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:41.070189    2547 generic.go:356] "Generic (PLEG): container finished" podID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerID="d2bb88ba9b8e25f1a8ed994eb371a47d578a8d4db66d8711d1f040c520630ff6" exitCode=0
Sep 11 13:08:41.070338 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:41.070269    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" event={"ID":"90478a56-0c65-4f7d-9d39-95a7720e8622","Type":"ContainerDied","Data":"d2bb88ba9b8e25f1a8ed994eb371a47d578a8d4db66d8711d1f040c520630ff6"}
Sep 11 13:08:41.070710 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:41.070694    2547 scope.go:117] "RemoveContainer" containerID="d2bb88ba9b8e25f1a8ed994eb371a47d578a8d4db66d8711d1f040c520630ff6"
Sep 11 13:08:41.071798 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:41.071768    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:41.071882 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:41.071858    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:41.071930 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:41.071899    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:42.077424 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:42.077384    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4" event={"ID":"1337198d-52af-4648-8f4b-809ac212ece2","Type":"ContainerStarted","Data":"5d249892fb2b2e8623f643a389d3813f809de6ee70e5fb1f4409946b5c17a8be"}
Sep 11 13:08:42.079445 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:42.079414    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" event={"ID":"90478a56-0c65-4f7d-9d39-95a7720e8622","Type":"ContainerStarted","Data":"f510f5c25ab7c280150f9155d55e35f5f65df32688e3677c83400b92f5a25e31"}
Sep 11 13:08:42.103359 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:42.103299    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4" podStartSLOduration=2.103278404 podStartE2EDuration="2.103278404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:42.102305676 +0000 UTC m=+791.606170080" watchObservedRunningTime="2026-09-11 13:08:42.103278404 +0000 UTC m=+791.607142797"
Sep 11 13:08:42.754940 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:42.754895    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:42.765563 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:42.765525    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:42.847469 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:42.847424    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:42.847679 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:42.847647    2547 patch_prober.go:28] interesting pod/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body=
Sep 11 13:08:42.847764 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:42.847708    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused"
Sep 11 13:08:43.085102 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:43.085067    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:43.086141 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:43.086119    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:08:43.847671 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:43.847629    2547 patch_prober.go:28] interesting pod/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body=
Sep 11 13:08:43.847990 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:43.847955    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused"
Sep 11 13:08:44.030185 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:44.030151    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"
Sep 11 13:08:44.848381 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:44.848328    2547 patch_prober.go:28] interesting pod/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body=
Sep 11 13:08:44.848915 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:44.848408    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused"
Sep 11 13:08:45.847870 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:45.847823    2547 patch_prober.go:28] interesting pod/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body=
Sep 11 13:08:45.848089 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:45.847900    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused"
Sep 11 13:08:46.615463 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.615415    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"]
Sep 11 13:08:46.622612 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.622581    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"
Sep 11 13:08:46.625892 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.625863    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-a6ba91-dockercfg-vmvgh\""
Sep 11 13:08:46.626391 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.626371    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-a6ba91\""
Sep 11 13:08:46.649809 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.649770    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"]
Sep 11 13:08:46.696168 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.696121    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmc4m\" (UniqueName: \"kubernetes.io/projected/cb2e76f1-c213-4ca5-8db3-f410bd448e75-kube-api-access-wmc4m\") pod \"payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr\" (UID: \"cb2e76f1-c213-4ca5-8db3-f410bd448e75\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"
Sep 11 13:08:46.696508 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.696489    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb2e76f1-c213-4ca5-8db3-f410bd448e75-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr\" (UID: \"cb2e76f1-c213-4ca5-8db3-f410bd448e75\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"
Sep 11 13:08:46.801740 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.801409    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb2e76f1-c213-4ca5-8db3-f410bd448e75-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr\" (UID: \"cb2e76f1-c213-4ca5-8db3-f410bd448e75\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"
Sep 11 13:08:46.801740 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.801557    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmc4m\" (UniqueName: \"kubernetes.io/projected/cb2e76f1-c213-4ca5-8db3-f410bd448e75-kube-api-access-wmc4m\") pod \"payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr\" (UID: \"cb2e76f1-c213-4ca5-8db3-f410bd448e75\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"
Sep 11 13:08:46.805738 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.803023    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb2e76f1-c213-4ca5-8db3-f410bd448e75-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr\" (UID: \"cb2e76f1-c213-4ca5-8db3-f410bd448e75\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"
Sep 11 13:08:46.831270 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.821269    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmc4m\" (UniqueName: \"kubernetes.io/projected/cb2e76f1-c213-4ca5-8db3-f410bd448e75-kube-api-access-wmc4m\") pod \"payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr\" (UID: \"cb2e76f1-c213-4ca5-8db3-f410bd448e75\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"
Sep 11 13:08:46.850743 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.848289    2547 patch_prober.go:28] interesting pod/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body=
Sep 11 13:08:46.850743 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.848371    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused"
Sep 11 13:08:46.941506 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:46.941426    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"
Sep 11 13:08:47.427489 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:47.427459    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"]
Sep 11 13:08:47.430583 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:08:47.430559    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2e76f1_c213_4ca5_8db3_f410bd448e75.slice/crio-d09847132e27682b410839faf28ca08145d4896f4b6aabbe2b8647f1d29f2f65 WatchSource:0}: Error finding container d09847132e27682b410839faf28ca08145d4896f4b6aabbe2b8647f1d29f2f65: Status 404 returned error can't find the container with id d09847132e27682b410839faf28ca08145d4896f4b6aabbe2b8647f1d29f2f65
Sep 11 13:08:47.847584 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:47.847542    2547 patch_prober.go:28] interesting pod/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused" start-of-body=
Sep 11 13:08:47.848158 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:47.847611    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.26:15021/healthz/ready\": dial tcp 10.132.0.26:15021: connect: connection refused"
Sep 11 13:08:48.135855 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:48.135763    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr" event={"ID":"cb2e76f1-c213-4ca5-8db3-f410bd448e75","Type":"ContainerStarted","Data":"3df4a838c15171c177619753d7abb77ea1fd2b6aee74df997b8a95d3771a7f42"}
Sep 11 13:08:48.135855 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:48.135829    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr" event={"ID":"cb2e76f1-c213-4ca5-8db3-f410bd448e75","Type":"ContainerStarted","Data":"d09847132e27682b410839faf28ca08145d4896f4b6aabbe2b8647f1d29f2f65"}
Sep 11 13:08:48.136037 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:48.135986    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"
Sep 11 13:08:48.159349 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:48.159275    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr" podStartSLOduration=2.159251466 podStartE2EDuration="2.159251466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:08:48.157636143 +0000 UTC m=+797.661500534" watchObservedRunningTime="2026-09-11 13:08:48.159251466 +0000 UTC m=+797.663115861"
Sep 11 13:08:48.861734 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:48.861674    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:48.862991 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:48.862765    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:48.864488 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:48.864464    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:08:54.019758 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:54.019625    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd"]
Sep 11 13:08:54.026316 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:54.026290    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd"
Sep 11 13:08:54.029514 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:54.029490    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:08:54.031177 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:54.030233    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:08:54.032771 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:54.032676    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd"]
Sep 11 13:08:54.093584 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:54.093545    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95c33ee-49a8-4499-8a68-9b61f38a6e32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd\" (UID: \"d95c33ee-49a8-4499-8a68-9b61f38a6e32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd"
Sep 11 13:08:54.143590 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:54.143551    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:08:54.196626 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:54.196584    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95c33ee-49a8-4499-8a68-9b61f38a6e32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd\" (UID: \"d95c33ee-49a8-4499-8a68-9b61f38a6e32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd"
Sep 11 13:08:54.197398 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:54.197372    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95c33ee-49a8-4499-8a68-9b61f38a6e32-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd\" (UID: \"d95c33ee-49a8-4499-8a68-9b61f38a6e32\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd"
Sep 11 13:08:54.340547 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:54.340505    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd"
Sep 11 13:08:54.636417 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:54.636388    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd"]
Sep 11 13:08:54.639384 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:08:54.639352    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95c33ee_49a8_4499_8a68_9b61f38a6e32.slice/crio-41c77ed6d32198f9a6d04b274673375dffbf25e69a4d3c8ef69893721689f3a1 WatchSource:0}: Error finding container 41c77ed6d32198f9a6d04b274673375dffbf25e69a4d3c8ef69893721689f3a1: Status 404 returned error can't find the container with id 41c77ed6d32198f9a6d04b274673375dffbf25e69a4d3c8ef69893721689f3a1
Sep 11 13:08:55.181210 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:55.181120    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd" event={"ID":"d95c33ee-49a8-4499-8a68-9b61f38a6e32","Type":"ContainerStarted","Data":"41c77ed6d32198f9a6d04b274673375dffbf25e69a4d3c8ef69893721689f3a1"}
Sep 11 13:08:55.183626 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:55.182817    2547 generic.go:356] "Generic (PLEG): container finished" podID="aea02725-d149-4763-a14e-1b02b0ac751a" containerID="b25ef8c29daa1fe605e9812a1f7c594fa06945c42055c76de5f8688d652e8dbd" exitCode=0
Sep 11 13:08:55.183626 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:55.182883    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" event={"ID":"aea02725-d149-4763-a14e-1b02b0ac751a","Type":"ContainerDied","Data":"b25ef8c29daa1fe605e9812a1f7c594fa06945c42055c76de5f8688d652e8dbd"}
Sep 11 13:08:55.183626 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:55.183279    2547 scope.go:117] "RemoveContainer" containerID="b25ef8c29daa1fe605e9812a1f7c594fa06945c42055c76de5f8688d652e8dbd"
Sep 11 13:08:55.184536 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:55.184504    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:55.184658 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:55.184587    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:55.184658 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:55.184636    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:56.202516 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:56.202425    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" event={"ID":"aea02725-d149-4763-a14e-1b02b0ac751a","Type":"ContainerStarted","Data":"c48d68103efcddaadf88cc299022745d03b0776f2c621eaefdf12f4201dbc289"}
Sep 11 13:08:56.204638 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:56.204610    2547 generic.go:356] "Generic (PLEG): container finished" podID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerID="53ba30d836facf6664661308daa1e41fc252d06c2b03cb9859de9eb71a8b53a7" exitCode=0
Sep 11 13:08:56.204773 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:56.204760    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" event={"ID":"269008b9-49c9-4163-b666-1f75b18bb8b8","Type":"ContainerDied","Data":"53ba30d836facf6664661308daa1e41fc252d06c2b03cb9859de9eb71a8b53a7"}
Sep 11 13:08:56.205193 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:56.205173    2547 scope.go:117] "RemoveContainer" containerID="53ba30d836facf6664661308daa1e41fc252d06c2b03cb9859de9eb71a8b53a7"
Sep 11 13:08:56.206584 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:56.206432    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:56.206584 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:56.206513    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:56.206584 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:56.206559    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:08:56.466809 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:56.464135    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:08:56.466809 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:56.464271    2547 patch_prober.go:28] interesting pod/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 11 13:08:56.466809 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:56.464316    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 11 13:08:57.213650 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:57.213094    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" event={"ID":"269008b9-49c9-4163-b666-1f75b18bb8b8","Type":"ContainerStarted","Data":"4bc961f10bed047bcf11621d61a614929818ae1ac2a216e5046a399a4d4e70fd"}
Sep 11 13:08:57.393740 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:57.391141    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:08:57.393740 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:57.391278    2547 patch_prober.go:28] interesting pod/e2e-autores-efc023-openshift-default-586b67554d-jxb5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 11 13:08:57.393740 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:57.391324    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 11 13:08:57.465787 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:57.464862    2547 patch_prober.go:28] interesting pod/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 11 13:08:57.465787 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:57.464935    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 11 13:08:58.393171 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:58.393123    2547 patch_prober.go:28] interesting pod/e2e-autores-efc023-openshift-default-586b67554d-jxb5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 11 13:08:58.393683 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:58.393197    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 11 13:08:58.469744 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:58.466747    2547 patch_prober.go:28] interesting pod/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 11 13:08:58.469744 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:58.466822    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 11 13:08:59.153156 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:59.152243    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"
Sep 11 13:08:59.392793 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:59.392750    2547 patch_prober.go:28] interesting pod/e2e-autores-efc023-openshift-default-586b67554d-jxb5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 11 13:08:59.393090 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:59.393051    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 11 13:08:59.464548 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:59.464446    2547 patch_prober.go:28] interesting pod/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 11 13:08:59.465174 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:08:59.465122    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 11 13:09:00.266773 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:00.265906    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd" event={"ID":"d95c33ee-49a8-4499-8a68-9b61f38a6e32","Type":"ContainerStarted","Data":"8c538c4789fd3db7a73f30f76b04cb8c01451b475ce023a62c3a082d38fad661"}
Sep 11 13:09:00.303207 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:00.303128    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd" podStartSLOduration=2.375676255 podStartE2EDuration="7.303105304s" totalImagesPullingTime="4.927429049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:00.299398794 +0000 UTC m=+809.803263189" watchObservedRunningTime="2026-09-11 13:09:00.303105304 +0000 UTC m=+809.806969699"
Sep 11 13:09:00.390190 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:00.390150    2547 patch_prober.go:28] interesting pod/e2e-autores-efc023-openshift-default-586b67554d-jxb5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 11 13:09:00.390511 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:00.390460    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 11 13:09:00.464327 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:00.464286    2547 patch_prober.go:28] interesting pod/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 11 13:09:00.464541 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:00.464355    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 11 13:09:01.276039 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:01.275614    2547 generic.go:356] "Generic (PLEG): container finished" podID="d95c33ee-49a8-4499-8a68-9b61f38a6e32" containerID="8c538c4789fd3db7a73f30f76b04cb8c01451b475ce023a62c3a082d38fad661" exitCode=0
Sep 11 13:09:01.276039 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:01.275677    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd" event={"ID":"d95c33ee-49a8-4499-8a68-9b61f38a6e32","Type":"ContainerDied","Data":"8c538c4789fd3db7a73f30f76b04cb8c01451b475ce023a62c3a082d38fad661"}
Sep 11 13:09:01.389770 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:01.389652    2547 patch_prober.go:28] interesting pod/e2e-autores-efc023-openshift-default-586b67554d-jxb5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 11 13:09:01.390047 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:01.389997    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 11 13:09:01.464381 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:01.464330    2547 patch_prober.go:28] interesting pod/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 11 13:09:01.464688 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:01.464652    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 11 13:09:02.390629 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:02.390141    2547 patch_prober.go:28] interesting pod/e2e-autores-efc023-openshift-default-586b67554d-jxb5m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused" start-of-body=
Sep 11 13:09:02.390629 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:02.390207    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.30:15021/healthz/ready\": dial tcp 10.132.0.30:15021: connect: connection refused"
Sep 11 13:09:02.465123 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:02.465089    2547 patch_prober.go:28] interesting pod/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused" start-of-body=
Sep 11 13:09:02.465202 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:02.465149    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.29:15021/healthz/ready\": dial tcp 10.132.0.29:15021: connect: connection refused"
Sep 11 13:09:02.503118 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:02.502931    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd"
Sep 11 13:09:02.631291 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:02.631187    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95c33ee-49a8-4499-8a68-9b61f38a6e32-maas-api-service-ca\") pod \"d95c33ee-49a8-4499-8a68-9b61f38a6e32\" (UID: \"d95c33ee-49a8-4499-8a68-9b61f38a6e32\") "
Sep 11 13:09:02.631592 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:02.631563    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d95c33ee-49a8-4499-8a68-9b61f38a6e32-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d95c33ee-49a8-4499-8a68-9b61f38a6e32" (UID: "d95c33ee-49a8-4499-8a68-9b61f38a6e32"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:09:02.732528 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:02.732487    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d95c33ee-49a8-4499-8a68-9b61f38a6e32-maas-api-service-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:03.021604 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:03.021573    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:09:03.290819 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:03.290786    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd" event={"ID":"d95c33ee-49a8-4499-8a68-9b61f38a6e32","Type":"ContainerDied","Data":"41c77ed6d32198f9a6d04b274673375dffbf25e69a4d3c8ef69893721689f3a1"}
Sep 11 13:09:03.290973 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:03.290859    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="41c77ed6d32198f9a6d04b274673375dffbf25e69a4d3c8ef69893721689f3a1"
Sep 11 13:09:03.290973 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:03.290856    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd"
Sep 11 13:09:03.393515 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:03.393485    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:09:03.393932 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:03.393751    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:09:03.394441 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:03.394418    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:09:03.469341 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:03.469311    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:09:03.470916 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:03.470877    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:09:05.303450 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:05.303412    2547 generic.go:356] "Generic (PLEG): container finished" podID="1337198d-52af-4648-8f4b-809ac212ece2" containerID="5d249892fb2b2e8623f643a389d3813f809de6ee70e5fb1f4409946b5c17a8be" exitCode=0
Sep 11 13:09:05.303997 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:05.303478    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4" event={"ID":"1337198d-52af-4648-8f4b-809ac212ece2","Type":"ContainerDied","Data":"5d249892fb2b2e8623f643a389d3813f809de6ee70e5fb1f4409946b5c17a8be"}
Sep 11 13:09:05.304079 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:05.304059    2547 scope.go:117] "RemoveContainer" containerID="5d249892fb2b2e8623f643a389d3813f809de6ee70e5fb1f4409946b5c17a8be"
Sep 11 13:09:05.305196 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:05.305163    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:09:05.305329 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:05.305258    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:09:05.305329 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:05.305298    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:09:05.565046 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:05.564963    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd"]
Sep 11 13:09:05.567602 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:05.567577    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-976b6f6f-hzrvd"]
Sep 11 13:09:05.720132 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:05.720096    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"]
Sep 11 13:09:05.720342 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:05.720315    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy" containerID="cri-o://c48d68103efcddaadf88cc299022745d03b0776f2c621eaefdf12f4201dbc289" gracePeriod=30
Sep 11 13:09:06.311334 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:06.311298    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4" event={"ID":"1337198d-52af-4648-8f4b-809ac212ece2","Type":"ContainerStarted","Data":"631a1d5cafcb6b16b6318de77c028e5f9b4a3791052496107cdeb5eb0411871b"}
Sep 11 13:09:06.753413 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:06.753321    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:09:06.753695 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:06.753368    2547 patch_prober.go:28] interesting pod/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:09:06.753896 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:06.753869    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4" podUID="1337198d-52af-4648-8f4b-809ac212ece2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Sep 11 13:09:07.006737 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.006639    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d95c33ee-49a8-4499-8a68-9b61f38a6e32" path="/var/lib/kubelet/pods/d95c33ee-49a8-4499-8a68-9b61f38a6e32/volumes"
Sep 11 13:09:07.356742 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.352017    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"]
Sep 11 13:09:07.356742 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.352584    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d95c33ee-49a8-4499-8a68-9b61f38a6e32" containerName="revoke-keys"
Sep 11 13:09:07.356742 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.352603    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d95c33ee-49a8-4499-8a68-9b61f38a6e32" containerName="revoke-keys"
Sep 11 13:09:07.356742 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.352687    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d95c33ee-49a8-4499-8a68-9b61f38a6e32" containerName="revoke-keys"
Sep 11 13:09:07.361793 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.361281    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.369337 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.369301    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-87e2eb97-gw-openshift-default-dockercfg-w8gnj\""
Sep 11 13:09:07.431242 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.431161    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"]
Sep 11 13:09:07.483365 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.483328    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-workload-socket\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.483538 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.483369    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-podinfo\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.483538 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.483397    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-workload-certs\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.483538 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.483479    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-credential-socket\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.483642 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.483536    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-data\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.483642 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.483557    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-envoy\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.483642 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.483574    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istiod-ca-cert\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.483642 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.483594    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-token\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.483642 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.483609    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dmlr\" (UniqueName: \"kubernetes.io/projected/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-kube-api-access-2dmlr\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.584328 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.584276    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-workload-socket\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.584521 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.584346    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-podinfo\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.584521 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.584380    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-workload-certs\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.584521 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.584416    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-credential-socket\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.584521 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.584478    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-data\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.584521 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.584511    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-envoy\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.584841 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.584538    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istiod-ca-cert\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.584841 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.584573    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-token\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.584841 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.584598    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dmlr\" (UniqueName: \"kubernetes.io/projected/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-kube-api-access-2dmlr\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.584841 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.584781    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-workload-socket\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.584841 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.584828    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-workload-certs\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.585089 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.584849    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-credential-socket\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.585089 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.584917    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-data\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.585364 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.585346    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istiod-ca-cert\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.587328 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.587305    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-envoy\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.587643 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.587621    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-podinfo\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.598863 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.598837    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dmlr\" (UniqueName: \"kubernetes.io/projected/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-kube-api-access-2dmlr\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.600128 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.600099    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-token\") pod \"e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") " pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.676209 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.676111    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:07.766741 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.764140    2547 patch_prober.go:28] interesting pod/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:09:07.766741 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:07.764205    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4" podUID="1337198d-52af-4648-8f4b-809ac212ece2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Sep 11 13:09:08.011103 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:08.011071    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"]
Sep 11 13:09:08.011681 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:09:08.011654    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c2e10a4_6163_450f_bc80_afcbdd0bdbc9.slice/crio-9519a14380571f0367b5ca5ea7e39e490a2ef3a6017c1e387aeaefd1c8581bfa WatchSource:0}: Error finding container 9519a14380571f0367b5ca5ea7e39e490a2ef3a6017c1e387aeaefd1c8581bfa: Status 404 returned error can't find the container with id 9519a14380571f0367b5ca5ea7e39e490a2ef3a6017c1e387aeaefd1c8581bfa
Sep 11 13:09:08.014116 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:08.014085    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:09:08.014197 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:08.014149    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:09:08.014197 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:08.014177    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:09:08.323923 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:08.323622    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m" event={"ID":"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9","Type":"ContainerStarted","Data":"e499c056d96d0246fbd0a18c4fcbff697eeee5934617a81c7301bab82090fbf3"}
Sep 11 13:09:08.323923 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:08.323674    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m" event={"ID":"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9","Type":"ContainerStarted","Data":"9519a14380571f0367b5ca5ea7e39e490a2ef3a6017c1e387aeaefd1c8581bfa"}
Sep 11 13:09:08.391301 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:08.391240    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m" podStartSLOduration=1.391222868 podStartE2EDuration="1.391222868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:08.39098598 +0000 UTC m=+817.894850374" watchObservedRunningTime="2026-09-11 13:09:08.391222868 +0000 UTC m=+817.895087260"
Sep 11 13:09:08.676995 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:08.676906    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:08.753918 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:08.753871    2547 patch_prober.go:28] interesting pod/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:09:08.754123 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:08.753944    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4" podUID="1337198d-52af-4648-8f4b-809ac212ece2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Sep 11 13:09:09.682568 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:09.682536    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:09.754065 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:09.754015    2547 patch_prober.go:28] interesting pod/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:09:09.754272 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:09.754094    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4" podUID="1337198d-52af-4648-8f4b-809ac212ece2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Sep 11 13:09:10.332826 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:10.332700    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:10.333957 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:10.333935    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:10.753327 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:10.753232    2547 patch_prober.go:28] interesting pod/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Sep 11 13:09:10.754315 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:10.753915    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4" podUID="1337198d-52af-4648-8f4b-809ac212ece2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Sep 11 13:09:11.120840 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.120814    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:09:11.221466 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.221432    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-credential-socket\") pod \"aea02725-d149-4763-a14e-1b02b0ac751a\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") "
Sep 11 13:09:11.221641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.221478    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-workload-socket\") pod \"aea02725-d149-4763-a14e-1b02b0ac751a\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") "
Sep 11 13:09:11.221641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.221515    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aea02725-d149-4763-a14e-1b02b0ac751a-istiod-ca-cert\") pod \"aea02725-d149-4763-a14e-1b02b0ac751a\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") "
Sep 11 13:09:11.221641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.221558    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-workload-certs\") pod \"aea02725-d149-4763-a14e-1b02b0ac751a\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") "
Sep 11 13:09:11.221641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.221599    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aea02725-d149-4763-a14e-1b02b0ac751a-istio-podinfo\") pod \"aea02725-d149-4763-a14e-1b02b0ac751a\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") "
Sep 11 13:09:11.221888 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.221641    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55ldc\" (UniqueName: \"kubernetes.io/projected/aea02725-d149-4763-a14e-1b02b0ac751a-kube-api-access-55ldc\") pod \"aea02725-d149-4763-a14e-1b02b0ac751a\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") "
Sep 11 13:09:11.221888 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.221678    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-istio-envoy\") pod \"aea02725-d149-4763-a14e-1b02b0ac751a\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") "
Sep 11 13:09:11.221888 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.221702    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-istio-data\") pod \"aea02725-d149-4763-a14e-1b02b0ac751a\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") "
Sep 11 13:09:11.221888 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.221778    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aea02725-d149-4763-a14e-1b02b0ac751a" (UID: "aea02725-d149-4763-a14e-1b02b0ac751a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:09:11.221888 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.221849    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aea02725-d149-4763-a14e-1b02b0ac751a-istio-token\") pod \"aea02725-d149-4763-a14e-1b02b0ac751a\" (UID: \"aea02725-d149-4763-a14e-1b02b0ac751a\") "
Sep 11 13:09:11.221888 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.221857    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aea02725-d149-4763-a14e-1b02b0ac751a" (UID: "aea02725-d149-4763-a14e-1b02b0ac751a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:09:11.222167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.221895    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aea02725-d149-4763-a14e-1b02b0ac751a" (UID: "aea02725-d149-4763-a14e-1b02b0ac751a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:09:11.222167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.221990    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aea02725-d149-4763-a14e-1b02b0ac751a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aea02725-d149-4763-a14e-1b02b0ac751a" (UID: "aea02725-d149-4763-a14e-1b02b0ac751a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:09:11.222167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.222127    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-istio-data" (OuterVolumeSpecName: "istio-data") pod "aea02725-d149-4763-a14e-1b02b0ac751a" (UID: "aea02725-d149-4763-a14e-1b02b0ac751a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:09:11.222331 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.222253    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:11.222331 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.222275    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:11.222331 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.222291    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aea02725-d149-4763-a14e-1b02b0ac751a-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:11.222331 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.222303    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:11.222331 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.222315    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:11.224082 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.224053    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aea02725-d149-4763-a14e-1b02b0ac751a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aea02725-d149-4763-a14e-1b02b0ac751a" (UID: "aea02725-d149-4763-a14e-1b02b0ac751a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:09:11.224200 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.224097    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aea02725-d149-4763-a14e-1b02b0ac751a-kube-api-access-55ldc" (OuterVolumeSpecName: "kube-api-access-55ldc") pod "aea02725-d149-4763-a14e-1b02b0ac751a" (UID: "aea02725-d149-4763-a14e-1b02b0ac751a"). InnerVolumeSpecName "kube-api-access-55ldc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:09:11.224200 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.224100    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aea02725-d149-4763-a14e-1b02b0ac751a-istio-token" (OuterVolumeSpecName: "istio-token") pod "aea02725-d149-4763-a14e-1b02b0ac751a" (UID: "aea02725-d149-4763-a14e-1b02b0ac751a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:09:11.224341 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.224323    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aea02725-d149-4763-a14e-1b02b0ac751a" (UID: "aea02725-d149-4763-a14e-1b02b0ac751a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:09:11.322808 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.322757    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aea02725-d149-4763-a14e-1b02b0ac751a-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:11.322808 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.322800    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aea02725-d149-4763-a14e-1b02b0ac751a-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:11.322808 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.322813    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55ldc\" (UniqueName: \"kubernetes.io/projected/aea02725-d149-4763-a14e-1b02b0ac751a-kube-api-access-55ldc\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:11.323045 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.322827    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aea02725-d149-4763-a14e-1b02b0ac751a-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:11.338050 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.338017    2547 generic.go:356] "Generic (PLEG): container finished" podID="aea02725-d149-4763-a14e-1b02b0ac751a" containerID="c48d68103efcddaadf88cc299022745d03b0776f2c621eaefdf12f4201dbc289" exitCode=0
Sep 11 13:09:11.338174 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.338080    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"
Sep 11 13:09:11.338174 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.338102    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" event={"ID":"aea02725-d149-4763-a14e-1b02b0ac751a","Type":"ContainerDied","Data":"c48d68103efcddaadf88cc299022745d03b0776f2c621eaefdf12f4201dbc289"}
Sep 11 13:09:11.338260 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.338187    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57" event={"ID":"aea02725-d149-4763-a14e-1b02b0ac751a","Type":"ContainerDied","Data":"8e2eeb0021c158c984981912ebd5bf394518034fdaff6db2ebea8afe849cb5e3"}
Sep 11 13:09:11.338260 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.338210    2547 scope.go:117] "RemoveContainer" containerID="c48d68103efcddaadf88cc299022745d03b0776f2c621eaefdf12f4201dbc289"
Sep 11 13:09:11.372790 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.372751    2547 scope.go:117] "RemoveContainer" containerID="b25ef8c29daa1fe605e9812a1f7c594fa06945c42055c76de5f8688d652e8dbd"
Sep 11 13:09:11.381656 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.381634    2547 scope.go:117] "RemoveContainer" containerID="c48d68103efcddaadf88cc299022745d03b0776f2c621eaefdf12f4201dbc289"
Sep 11 13:09:11.381962 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:09:11.381941    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c48d68103efcddaadf88cc299022745d03b0776f2c621eaefdf12f4201dbc289\": container with ID starting with c48d68103efcddaadf88cc299022745d03b0776f2c621eaefdf12f4201dbc289 not found: ID does not exist" containerID="c48d68103efcddaadf88cc299022745d03b0776f2c621eaefdf12f4201dbc289"
Sep 11 13:09:11.382025 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.381970    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48d68103efcddaadf88cc299022745d03b0776f2c621eaefdf12f4201dbc289"} err="failed to get container status \"c48d68103efcddaadf88cc299022745d03b0776f2c621eaefdf12f4201dbc289\": rpc error: code = NotFound desc = could not find container \"c48d68103efcddaadf88cc299022745d03b0776f2c621eaefdf12f4201dbc289\": container with ID starting with c48d68103efcddaadf88cc299022745d03b0776f2c621eaefdf12f4201dbc289 not found: ID does not exist"
Sep 11 13:09:11.382025 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.381990    2547 scope.go:117] "RemoveContainer" containerID="b25ef8c29daa1fe605e9812a1f7c594fa06945c42055c76de5f8688d652e8dbd"
Sep 11 13:09:11.382193 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:09:11.382178    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b25ef8c29daa1fe605e9812a1f7c594fa06945c42055c76de5f8688d652e8dbd\": container with ID starting with b25ef8c29daa1fe605e9812a1f7c594fa06945c42055c76de5f8688d652e8dbd not found: ID does not exist" containerID="b25ef8c29daa1fe605e9812a1f7c594fa06945c42055c76de5f8688d652e8dbd"
Sep 11 13:09:11.382240 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.382196    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b25ef8c29daa1fe605e9812a1f7c594fa06945c42055c76de5f8688d652e8dbd"} err="failed to get container status \"b25ef8c29daa1fe605e9812a1f7c594fa06945c42055c76de5f8688d652e8dbd\": rpc error: code = NotFound desc = could not find container \"b25ef8c29daa1fe605e9812a1f7c594fa06945c42055c76de5f8688d652e8dbd\": container with ID starting with b25ef8c29daa1fe605e9812a1f7c594fa06945c42055c76de5f8688d652e8dbd not found: ID does not exist"
Sep 11 13:09:11.402672 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.402633    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"]
Sep 11 13:09:11.417935 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.417909    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-976b6f6f-openshift-default-65ff76b648-z7k57"]
Sep 11 13:09:11.486779 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.486742    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:09:11.757897 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.757829    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:09:11.758372 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.758127    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:09:11.758855 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:11.758837    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:09:13.008017 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:13.007987    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" path="/var/lib/kubelet/pods/aea02725-d149-4763-a14e-1b02b0ac751a/volumes"
Sep 11 13:09:17.583134 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.583098    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"]
Sep 11 13:09:17.583534 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.583492    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy"
Sep 11 13:09:17.583534 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.583505    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy"
Sep 11 13:09:17.583621 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.583574    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy"
Sep 11 13:09:17.583621 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.583590    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy"
Sep 11 13:09:17.588146 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.588122    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"
Sep 11 13:09:17.593754 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.593729    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-87e2eb97\""
Sep 11 13:09:17.594296 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.594273    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-87e2eb97-dockercfg-bxm9v\""
Sep 11 13:09:17.606753 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.606711    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"]
Sep 11 13:09:17.684331 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.684290    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8820e561-691c-468c-ad21-1fd5c72e0dee-plugins-config-volume\") pod \"payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp\" (UID: \"8820e561-691c-468c-ad21-1fd5c72e0dee\") " pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"
Sep 11 13:09:17.684512 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.684422    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr96m\" (UniqueName: \"kubernetes.io/projected/8820e561-691c-468c-ad21-1fd5c72e0dee-kube-api-access-tr96m\") pod \"payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp\" (UID: \"8820e561-691c-468c-ad21-1fd5c72e0dee\") " pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"
Sep 11 13:09:17.785311 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.785269    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr96m\" (UniqueName: \"kubernetes.io/projected/8820e561-691c-468c-ad21-1fd5c72e0dee-kube-api-access-tr96m\") pod \"payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp\" (UID: \"8820e561-691c-468c-ad21-1fd5c72e0dee\") " pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"
Sep 11 13:09:17.785499 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.785329    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8820e561-691c-468c-ad21-1fd5c72e0dee-plugins-config-volume\") pod \"payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp\" (UID: \"8820e561-691c-468c-ad21-1fd5c72e0dee\") " pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"
Sep 11 13:09:17.786097 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.786077    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8820e561-691c-468c-ad21-1fd5c72e0dee-plugins-config-volume\") pod \"payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp\" (UID: \"8820e561-691c-468c-ad21-1fd5c72e0dee\") " pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"
Sep 11 13:09:17.819142 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.819104    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr96m\" (UniqueName: \"kubernetes.io/projected/8820e561-691c-468c-ad21-1fd5c72e0dee-kube-api-access-tr96m\") pod \"payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp\" (UID: \"8820e561-691c-468c-ad21-1fd5c72e0dee\") " pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"
Sep 11 13:09:17.897957 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:17.897850    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"
Sep 11 13:09:18.200810 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:18.200784    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"]
Sep 11 13:09:18.203280 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:09:18.203242    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8820e561_691c_468c_ad21_1fd5c72e0dee.slice/crio-d815eb21df23ade1b13313aaa6aa08cb21fef28647aeadb5c77222edac89d1d8 WatchSource:0}: Error finding container d815eb21df23ade1b13313aaa6aa08cb21fef28647aeadb5c77222edac89d1d8: Status 404 returned error can't find the container with id d815eb21df23ade1b13313aaa6aa08cb21fef28647aeadb5c77222edac89d1d8
Sep 11 13:09:18.376809 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:18.376771    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp" event={"ID":"8820e561-691c-468c-ad21-1fd5c72e0dee","Type":"ContainerStarted","Data":"97fe9dae7961b3c77d6978ecbc2aac70aa9fc6045843fda919ba5be90dee5e1d"}
Sep 11 13:09:18.376975 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:18.376835    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp" event={"ID":"8820e561-691c-468c-ad21-1fd5c72e0dee","Type":"ContainerStarted","Data":"d815eb21df23ade1b13313aaa6aa08cb21fef28647aeadb5c77222edac89d1d8"}
Sep 11 13:09:18.376975 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:18.376894    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"
Sep 11 13:09:18.401532 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:18.401467    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp" podStartSLOduration=1.401445695 podStartE2EDuration="1.401445695s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:18.400495132 +0000 UTC m=+827.904359525" watchObservedRunningTime="2026-09-11 13:09:18.401445695 +0000 UTC m=+827.905310091"
Sep 11 13:09:29.383894 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:29.383861    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"
Sep 11 13:09:29.525411 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:29.525380    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:09:30.439549 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:30.439514    2547 generic.go:356] "Generic (PLEG): container finished" podID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerID="e499c056d96d0246fbd0a18c4fcbff697eeee5934617a81c7301bab82090fbf3" exitCode=0
Sep 11 13:09:30.439939 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:30.439589    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m" event={"ID":"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9","Type":"ContainerDied","Data":"e499c056d96d0246fbd0a18c4fcbff697eeee5934617a81c7301bab82090fbf3"}
Sep 11 13:09:30.439999 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:30.439985    2547 scope.go:117] "RemoveContainer" containerID="e499c056d96d0246fbd0a18c4fcbff697eeee5934617a81c7301bab82090fbf3"
Sep 11 13:09:30.441116 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:30.441077    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:09:30.441185 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:30.441165    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:09:30.441221 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:30.441196    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:09:31.451186 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:31.451138    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m" event={"ID":"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9","Type":"ContainerStarted","Data":"1eb26d2be40cae0ac75812bf6b7c14069fd206bb5d21baf106923f0d6b806045"}
Sep 11 13:09:31.676657 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:31.676613    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:31.676994 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:31.676958    2547 patch_prober.go:28] interesting pod/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 11 13:09:31.677143 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:31.677021    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m" podUID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 11 13:09:32.676988 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:32.676949    2547 patch_prober.go:28] interesting pod/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 11 13:09:32.677390 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:32.677012    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m" podUID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 11 13:09:33.676543 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:33.676506    2547 patch_prober.go:28] interesting pod/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 11 13:09:33.676745 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:33.676571    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m" podUID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 11 13:09:34.677357 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:34.677313    2547 patch_prober.go:28] interesting pod/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 11 13:09:34.677876 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:34.677397    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m" podUID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 11 13:09:35.677352 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:35.677313    2547 patch_prober.go:28] interesting pod/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body=
Sep 11 13:09:35.677526 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:35.677375    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m" podUID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused"
Sep 11 13:09:36.681778 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:36.681747    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:36.682207 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:36.682039    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:36.682804 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:36.682784    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:40.258443 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:40.258398    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2"]
Sep 11 13:09:40.258993 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:40.258973    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy"
Sep 11 13:09:40.259043 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:40.258998    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea02725-d149-4763-a14e-1b02b0ac751a" containerName="istio-proxy"
Sep 11 13:09:40.263862 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:40.263838    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2"
Sep 11 13:09:40.267409 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:40.267381    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:09:40.268008 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:40.267986    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:09:40.301694 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:40.301656    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2"]
Sep 11 13:09:40.321695 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:40.321658    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15573182-b7c4-4c84-81df-c868d29690d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2\" (UID: \"15573182-b7c4-4c84-81df-c868d29690d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2"
Sep 11 13:09:40.422814 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:40.422765    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15573182-b7c4-4c84-81df-c868d29690d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2\" (UID: \"15573182-b7c4-4c84-81df-c868d29690d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2"
Sep 11 13:09:40.423442 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:40.423415    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15573182-b7c4-4c84-81df-c868d29690d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2\" (UID: \"15573182-b7c4-4c84-81df-c868d29690d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2"
Sep 11 13:09:40.575800 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:40.575758    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2"
Sep 11 13:09:40.854585 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:40.854495    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2"]
Sep 11 13:09:40.859285 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:09:40.859254    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15573182_b7c4_4c84_81df_c868d29690d6.slice/crio-2b09b1d9f5e955b23d59823cccf6ea46043335d81d5eac94e1f1e7b218af8a5c WatchSource:0}: Error finding container 2b09b1d9f5e955b23d59823cccf6ea46043335d81d5eac94e1f1e7b218af8a5c: Status 404 returned error can't find the container with id 2b09b1d9f5e955b23d59823cccf6ea46043335d81d5eac94e1f1e7b218af8a5c
Sep 11 13:09:41.515260 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:41.515226    2547 generic.go:356] "Generic (PLEG): container finished" podID="15573182-b7c4-4c84-81df-c868d29690d6" containerID="7475169fb6c714ae0fd6d175e6c6e817eab900b16349c55ba852f6fdec8b2a19" exitCode=0
Sep 11 13:09:41.515641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:41.515303    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2" event={"ID":"15573182-b7c4-4c84-81df-c868d29690d6","Type":"ContainerDied","Data":"7475169fb6c714ae0fd6d175e6c6e817eab900b16349c55ba852f6fdec8b2a19"}
Sep 11 13:09:41.515641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:41.515357    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2" event={"ID":"15573182-b7c4-4c84-81df-c868d29690d6","Type":"ContainerStarted","Data":"2b09b1d9f5e955b23d59823cccf6ea46043335d81d5eac94e1f1e7b218af8a5c"}
Sep 11 13:09:42.649500 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:42.649477    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2"
Sep 11 13:09:42.745835 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:42.745795    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15573182-b7c4-4c84-81df-c868d29690d6-maas-api-service-ca\") pod \"15573182-b7c4-4c84-81df-c868d29690d6\" (UID: \"15573182-b7c4-4c84-81df-c868d29690d6\") "
Sep 11 13:09:42.746226 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:42.746203    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15573182-b7c4-4c84-81df-c868d29690d6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "15573182-b7c4-4c84-81df-c868d29690d6" (UID: "15573182-b7c4-4c84-81df-c868d29690d6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:09:42.847587 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:42.847483    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/15573182-b7c4-4c84-81df-c868d29690d6-maas-api-service-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:43.526954 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:43.526924    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2"
Sep 11 13:09:43.526954 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:43.526931    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2" event={"ID":"15573182-b7c4-4c84-81df-c868d29690d6","Type":"ContainerDied","Data":"2b09b1d9f5e955b23d59823cccf6ea46043335d81d5eac94e1f1e7b218af8a5c"}
Sep 11 13:09:43.527162 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:43.527004    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b09b1d9f5e955b23d59823cccf6ea46043335d81d5eac94e1f1e7b218af8a5c"
Sep 11 13:09:47.029052 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:47.029014    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:09:52.241699 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.241663    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"]
Sep 11 13:09:52.242206 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.241951    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp" podUID="8820e561-691c-468c-ad21-1fd5c72e0dee" containerName="payload-processing" containerID="cri-o://97fe9dae7961b3c77d6978ecbc2aac70aa9fc6045843fda919ba5be90dee5e1d" gracePeriod=30
Sep 11 13:09:52.503023 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.502943    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2"]
Sep 11 13:09:52.506791 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.506760    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-87e2eb97-8b6m2"]
Sep 11 13:09:52.535650 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.535623    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"
Sep 11 13:09:52.572284 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.572246    2547 generic.go:356] "Generic (PLEG): container finished" podID="8820e561-691c-468c-ad21-1fd5c72e0dee" containerID="97fe9dae7961b3c77d6978ecbc2aac70aa9fc6045843fda919ba5be90dee5e1d" exitCode=0
Sep 11 13:09:52.572460 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.572296    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"
Sep 11 13:09:52.572460 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.572323    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp" event={"ID":"8820e561-691c-468c-ad21-1fd5c72e0dee","Type":"ContainerDied","Data":"97fe9dae7961b3c77d6978ecbc2aac70aa9fc6045843fda919ba5be90dee5e1d"}
Sep 11 13:09:52.572460 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.572379    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp" event={"ID":"8820e561-691c-468c-ad21-1fd5c72e0dee","Type":"ContainerDied","Data":"d815eb21df23ade1b13313aaa6aa08cb21fef28647aeadb5c77222edac89d1d8"}
Sep 11 13:09:52.572460 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.572402    2547 scope.go:117] "RemoveContainer" containerID="97fe9dae7961b3c77d6978ecbc2aac70aa9fc6045843fda919ba5be90dee5e1d"
Sep 11 13:09:52.594116 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.594079    2547 scope.go:117] "RemoveContainer" containerID="97fe9dae7961b3c77d6978ecbc2aac70aa9fc6045843fda919ba5be90dee5e1d"
Sep 11 13:09:52.594573 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:09:52.594543    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97fe9dae7961b3c77d6978ecbc2aac70aa9fc6045843fda919ba5be90dee5e1d\": container with ID starting with 97fe9dae7961b3c77d6978ecbc2aac70aa9fc6045843fda919ba5be90dee5e1d not found: ID does not exist" containerID="97fe9dae7961b3c77d6978ecbc2aac70aa9fc6045843fda919ba5be90dee5e1d"
Sep 11 13:09:52.594665 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.594588    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97fe9dae7961b3c77d6978ecbc2aac70aa9fc6045843fda919ba5be90dee5e1d"} err="failed to get container status \"97fe9dae7961b3c77d6978ecbc2aac70aa9fc6045843fda919ba5be90dee5e1d\": rpc error: code = NotFound desc = could not find container \"97fe9dae7961b3c77d6978ecbc2aac70aa9fc6045843fda919ba5be90dee5e1d\": container with ID starting with 97fe9dae7961b3c77d6978ecbc2aac70aa9fc6045843fda919ba5be90dee5e1d not found: ID does not exist"
Sep 11 13:09:52.636243 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.636214    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr96m\" (UniqueName: \"kubernetes.io/projected/8820e561-691c-468c-ad21-1fd5c72e0dee-kube-api-access-tr96m\") pod \"8820e561-691c-468c-ad21-1fd5c72e0dee\" (UID: \"8820e561-691c-468c-ad21-1fd5c72e0dee\") "
Sep 11 13:09:52.636243 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.636253    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8820e561-691c-468c-ad21-1fd5c72e0dee-plugins-config-volume\") pod \"8820e561-691c-468c-ad21-1fd5c72e0dee\" (UID: \"8820e561-691c-468c-ad21-1fd5c72e0dee\") "
Sep 11 13:09:52.636693 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.636668    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8820e561-691c-468c-ad21-1fd5c72e0dee-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8820e561-691c-468c-ad21-1fd5c72e0dee" (UID: "8820e561-691c-468c-ad21-1fd5c72e0dee"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:09:52.639566 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.639542    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8820e561-691c-468c-ad21-1fd5c72e0dee-kube-api-access-tr96m" (OuterVolumeSpecName: "kube-api-access-tr96m") pod "8820e561-691c-468c-ad21-1fd5c72e0dee" (UID: "8820e561-691c-468c-ad21-1fd5c72e0dee"). InnerVolumeSpecName "kube-api-access-tr96m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:09:52.695250 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.695212    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"]
Sep 11 13:09:52.695452 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.695425    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m" podUID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerName="istio-proxy" containerID="cri-o://1eb26d2be40cae0ac75812bf6b7c14069fd206bb5d21baf106923f0d6b806045" gracePeriod=30
Sep 11 13:09:52.739696 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.739661    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr96m\" (UniqueName: \"kubernetes.io/projected/8820e561-691c-468c-ad21-1fd5c72e0dee-kube-api-access-tr96m\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:52.739696 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.739689    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8820e561-691c-468c-ad21-1fd5c72e0dee-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:52.899607 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.899563    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"]
Sep 11 13:09:52.902049 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:52.902018    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-87e2eb97-5d748b5686-mphdp"]
Sep 11 13:09:53.007058 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.007023    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15573182-b7c4-4c84-81df-c868d29690d6" path="/var/lib/kubelet/pods/15573182-b7c4-4c84-81df-c868d29690d6/volumes"
Sep 11 13:09:53.007460 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.007445    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8820e561-691c-468c-ad21-1fd5c72e0dee" path="/var/lib/kubelet/pods/8820e561-691c-468c-ad21-1fd5c72e0dee/volumes"
Sep 11 13:09:53.663811 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.663770    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"]
Sep 11 13:09:53.664327 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.664296    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15573182-b7c4-4c84-81df-c868d29690d6" containerName="revoke-keys"
Sep 11 13:09:53.664415 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.664330    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="15573182-b7c4-4c84-81df-c868d29690d6" containerName="revoke-keys"
Sep 11 13:09:53.664415 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.664361    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8820e561-691c-468c-ad21-1fd5c72e0dee" containerName="payload-processing"
Sep 11 13:09:53.664415 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.664371    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8820e561-691c-468c-ad21-1fd5c72e0dee" containerName="payload-processing"
Sep 11 13:09:53.664574 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.664452    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="15573182-b7c4-4c84-81df-c868d29690d6" containerName="revoke-keys"
Sep 11 13:09:53.664574 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.664466    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8820e561-691c-468c-ad21-1fd5c72e0dee" containerName="payload-processing"
Sep 11 13:09:53.669301 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.669268    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.676767 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.676679    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-48769560-openshift-default-dockercfg-hlbms\""
Sep 11 13:09:53.711142 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.711106    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"]
Sep 11 13:09:53.749013 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.748969    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-workload-certs\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.749013 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.749016    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d8599b5-2a55-44a7-9e2a-8802f770a413-istiod-ca-cert\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.749266 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.749082    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbdfc\" (UniqueName: \"kubernetes.io/projected/2d8599b5-2a55-44a7-9e2a-8802f770a413-kube-api-access-wbdfc\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.749266 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.749122    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-envoy\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.749266 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.749169    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-data\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.749266 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.749189    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-podinfo\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.749266 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.749249    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-token\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.749514 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.749367    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-workload-socket\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.749514 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.749418    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-credential-socket\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.850733 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.850678    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-envoy\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.850912 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.850807    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-data\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.850912 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.850846    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-podinfo\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.850912 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.850876    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-token\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.851067 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.850999    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-workload-socket\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.851281 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.851253    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-data\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.851381 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.851310    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-credential-socket\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.851381 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.851363    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-workload-certs\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.851381 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.851368    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-workload-socket\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.851551 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.851438    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d8599b5-2a55-44a7-9e2a-8802f770a413-istiod-ca-cert\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.851551 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.851485    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbdfc\" (UniqueName: \"kubernetes.io/projected/2d8599b5-2a55-44a7-9e2a-8802f770a413-kube-api-access-wbdfc\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.851653 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.851609    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-credential-socket\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.851731 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.851653    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-workload-certs\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.852310 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.852284    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d8599b5-2a55-44a7-9e2a-8802f770a413-istiod-ca-cert\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.853386 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.853365    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-envoy\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.853977 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.853956    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-podinfo\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.860386 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.860361    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-token\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.863682 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.863658    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbdfc\" (UniqueName: \"kubernetes.io/projected/2d8599b5-2a55-44a7-9e2a-8802f770a413-kube-api-access-wbdfc\") pod \"e2e-ait-48769560-openshift-default-5d556f484b-jkrsq\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") " pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:53.986795 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:53.986665    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:54.290188 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:54.290156    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"]
Sep 11 13:09:54.293561 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:09:54.293533    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d8599b5_2a55_44a7_9e2a_8802f770a413.slice/crio-73f976df35a1635518b509a795771b84066f183b7c7f1996bb16bccbd84d6907 WatchSource:0}: Error finding container 73f976df35a1635518b509a795771b84066f183b7c7f1996bb16bccbd84d6907: Status 404 returned error can't find the container with id 73f976df35a1635518b509a795771b84066f183b7c7f1996bb16bccbd84d6907
Sep 11 13:09:54.295853 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:54.295824    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:09:54.295914 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:54.295892    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:09:54.295955 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:54.295923    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:09:54.584936 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:54.584832    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq" event={"ID":"2d8599b5-2a55-44a7-9e2a-8802f770a413","Type":"ContainerStarted","Data":"3e34b1211e59d38aecb31eb483c0fbaae98d80ce41115f61cf65ad6887257ad9"}
Sep 11 13:09:54.584936 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:54.584884    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq" event={"ID":"2d8599b5-2a55-44a7-9e2a-8802f770a413","Type":"ContainerStarted","Data":"73f976df35a1635518b509a795771b84066f183b7c7f1996bb16bccbd84d6907"}
Sep 11 13:09:54.629528 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:54.629444    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq" podStartSLOduration=1.629421438 podStartE2EDuration="1.629421438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:09:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:09:54.628119792 +0000 UTC m=+864.131984185" watchObservedRunningTime="2026-09-11 13:09:54.629421438 +0000 UTC m=+864.133285831"
Sep 11 13:09:54.987479 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:54.987385    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:55.992868 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:55.992841    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:56.594014 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:56.593976    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:56.595087 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:56.595065    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:09:57.980769 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:57.980742    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:58.095690 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.095638    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istiod-ca-cert\") pod \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") "
Sep 11 13:09:58.095910 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.095776    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-envoy\") pod \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") "
Sep 11 13:09:58.095910 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.095823    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dmlr\" (UniqueName: \"kubernetes.io/projected/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-kube-api-access-2dmlr\") pod \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") "
Sep 11 13:09:58.095910 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.095852    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-token\") pod \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") "
Sep 11 13:09:58.096063 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.095909    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-podinfo\") pod \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") "
Sep 11 13:09:58.096063 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.095936    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-credential-socket\") pod \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") "
Sep 11 13:09:58.096063 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.095976    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-workload-socket\") pod \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") "
Sep 11 13:09:58.096063 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.096025    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-workload-certs\") pod \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") "
Sep 11 13:09:58.096262 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.096066    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-data\") pod \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\" (UID: \"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9\") "
Sep 11 13:09:58.096262 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.096081    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" (UID: "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:09:58.096369 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.096268    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" (UID: "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:09:58.096426 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.096403    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" (UID: "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:09:58.096476 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.096429    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:58.096476 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.096424    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" (UID: "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:09:58.096476 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.096448    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:58.096758 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.096710    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" (UID: "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:09:58.098203 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.098176    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" (UID: "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:09:58.098329 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.098233    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" (UID: "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:09:58.098410 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.098394    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" (UID: "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:09:58.098795 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.098780    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-kube-api-access-2dmlr" (OuterVolumeSpecName: "kube-api-access-2dmlr") pod "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" (UID: "1c2e10a4-6163-450f-bc80-afcbdd0bdbc9"). InnerVolumeSpecName "kube-api-access-2dmlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:09:58.197217 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.197184    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:58.197217 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.197212    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dmlr\" (UniqueName: \"kubernetes.io/projected/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-kube-api-access-2dmlr\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:58.197217 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.197225    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:58.197450 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.197234    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:58.197450 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.197242    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:58.197450 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.197250    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:58.197450 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.197257    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:09:58.606585 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.606544    2547 generic.go:356] "Generic (PLEG): container finished" podID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerID="1eb26d2be40cae0ac75812bf6b7c14069fd206bb5d21baf106923f0d6b806045" exitCode=0
Sep 11 13:09:58.606785 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.606611    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"
Sep 11 13:09:58.606785 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.606618    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m" event={"ID":"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9","Type":"ContainerDied","Data":"1eb26d2be40cae0ac75812bf6b7c14069fd206bb5d21baf106923f0d6b806045"}
Sep 11 13:09:58.606785 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.606689    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m" event={"ID":"1c2e10a4-6163-450f-bc80-afcbdd0bdbc9","Type":"ContainerDied","Data":"9519a14380571f0367b5ca5ea7e39e490a2ef3a6017c1e387aeaefd1c8581bfa"}
Sep 11 13:09:58.606785 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.606743    2547 scope.go:117] "RemoveContainer" containerID="1eb26d2be40cae0ac75812bf6b7c14069fd206bb5d21baf106923f0d6b806045"
Sep 11 13:09:58.616832 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.616812    2547 scope.go:117] "RemoveContainer" containerID="e499c056d96d0246fbd0a18c4fcbff697eeee5934617a81c7301bab82090fbf3"
Sep 11 13:09:58.625294 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.625273    2547 scope.go:117] "RemoveContainer" containerID="1eb26d2be40cae0ac75812bf6b7c14069fd206bb5d21baf106923f0d6b806045"
Sep 11 13:09:58.625587 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:09:58.625571    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eb26d2be40cae0ac75812bf6b7c14069fd206bb5d21baf106923f0d6b806045\": container with ID starting with 1eb26d2be40cae0ac75812bf6b7c14069fd206bb5d21baf106923f0d6b806045 not found: ID does not exist" containerID="1eb26d2be40cae0ac75812bf6b7c14069fd206bb5d21baf106923f0d6b806045"
Sep 11 13:09:58.625634 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.625596    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eb26d2be40cae0ac75812bf6b7c14069fd206bb5d21baf106923f0d6b806045"} err="failed to get container status \"1eb26d2be40cae0ac75812bf6b7c14069fd206bb5d21baf106923f0d6b806045\": rpc error: code = NotFound desc = could not find container \"1eb26d2be40cae0ac75812bf6b7c14069fd206bb5d21baf106923f0d6b806045\": container with ID starting with 1eb26d2be40cae0ac75812bf6b7c14069fd206bb5d21baf106923f0d6b806045 not found: ID does not exist"
Sep 11 13:09:58.625634 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.625616    2547 scope.go:117] "RemoveContainer" containerID="e499c056d96d0246fbd0a18c4fcbff697eeee5934617a81c7301bab82090fbf3"
Sep 11 13:09:58.625869 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:09:58.625854    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e499c056d96d0246fbd0a18c4fcbff697eeee5934617a81c7301bab82090fbf3\": container with ID starting with e499c056d96d0246fbd0a18c4fcbff697eeee5934617a81c7301bab82090fbf3 not found: ID does not exist" containerID="e499c056d96d0246fbd0a18c4fcbff697eeee5934617a81c7301bab82090fbf3"
Sep 11 13:09:58.625930 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.625875    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e499c056d96d0246fbd0a18c4fcbff697eeee5934617a81c7301bab82090fbf3"} err="failed to get container status \"e499c056d96d0246fbd0a18c4fcbff697eeee5934617a81c7301bab82090fbf3\": rpc error: code = NotFound desc = could not find container \"e499c056d96d0246fbd0a18c4fcbff697eeee5934617a81c7301bab82090fbf3\": container with ID starting with e499c056d96d0246fbd0a18c4fcbff697eeee5934617a81c7301bab82090fbf3 not found: ID does not exist"
Sep 11 13:09:58.658629 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.658591    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"]
Sep 11 13:09:58.686462 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:58.686426    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-87e2eb97-gw-openshift-default-664bf54f4d-b7t2m"]
Sep 11 13:09:59.007218 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:09:59.007132    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" path="/var/lib/kubelet/pods/1c2e10a4-6163-450f-bc80-afcbdd0bdbc9/volumes"
Sep 11 13:10:01.336265 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.336230    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"]
Sep 11 13:10:01.336678 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.336567    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerName="istio-proxy"
Sep 11 13:10:01.336678 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.336578    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerName="istio-proxy"
Sep 11 13:10:01.336678 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.336592    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerName="istio-proxy"
Sep 11 13:10:01.336678 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.336598    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerName="istio-proxy"
Sep 11 13:10:01.336678 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.336660    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerName="istio-proxy"
Sep 11 13:10:01.341024 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.341007    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"
Sep 11 13:10:01.343828 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.343805    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-48769560\""
Sep 11 13:10:01.343913 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.343861    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-48769560-dockercfg-9jvll\""
Sep 11 13:10:01.363536 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.363508    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"]
Sep 11 13:10:01.445816 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.445777    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"]
Sep 11 13:10:01.446448 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.446391    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c2e10a4-6163-450f-bc80-afcbdd0bdbc9" containerName="istio-proxy"
Sep 11 13:10:01.449817 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.449795    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"
Sep 11 13:10:01.511243 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.511209    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"]
Sep 11 13:10:01.528550 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.528522    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76bbdb8f-8477-42e0-82d5-a5f83673e5bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts\" (UID: \"76bbdb8f-8477-42e0-82d5-a5f83673e5bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"
Sep 11 13:10:01.528742 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.528610    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4qv8\" (UniqueName: \"kubernetes.io/projected/76bbdb8f-8477-42e0-82d5-a5f83673e5bd-kube-api-access-j4qv8\") pod \"payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts\" (UID: \"76bbdb8f-8477-42e0-82d5-a5f83673e5bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"
Sep 11 13:10:01.629442 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.629362    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/421fd451-267e-489d-a41f-091cecb9f9c2-plugins-config-volume\") pod \"payload-processing-e2e-ait-48769560-6c68755cd9-8tw25\" (UID: \"421fd451-267e-489d-a41f-091cecb9f9c2\") " pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"
Sep 11 13:10:01.629442 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.629414    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4qv8\" (UniqueName: \"kubernetes.io/projected/76bbdb8f-8477-42e0-82d5-a5f83673e5bd-kube-api-access-j4qv8\") pod \"payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts\" (UID: \"76bbdb8f-8477-42e0-82d5-a5f83673e5bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"
Sep 11 13:10:01.629622 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.629440    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9vsg\" (UniqueName: \"kubernetes.io/projected/421fd451-267e-489d-a41f-091cecb9f9c2-kube-api-access-f9vsg\") pod \"payload-processing-e2e-ait-48769560-6c68755cd9-8tw25\" (UID: \"421fd451-267e-489d-a41f-091cecb9f9c2\") " pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"
Sep 11 13:10:01.629622 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.629567    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76bbdb8f-8477-42e0-82d5-a5f83673e5bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts\" (UID: \"76bbdb8f-8477-42e0-82d5-a5f83673e5bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"
Sep 11 13:10:01.630248 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.630232    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76bbdb8f-8477-42e0-82d5-a5f83673e5bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts\" (UID: \"76bbdb8f-8477-42e0-82d5-a5f83673e5bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"
Sep 11 13:10:01.639166 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.639136    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4qv8\" (UniqueName: \"kubernetes.io/projected/76bbdb8f-8477-42e0-82d5-a5f83673e5bd-kube-api-access-j4qv8\") pod \"payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts\" (UID: \"76bbdb8f-8477-42e0-82d5-a5f83673e5bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"
Sep 11 13:10:01.651116 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.651095    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"
Sep 11 13:10:01.730310 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.730270    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/421fd451-267e-489d-a41f-091cecb9f9c2-plugins-config-volume\") pod \"payload-processing-e2e-ait-48769560-6c68755cd9-8tw25\" (UID: \"421fd451-267e-489d-a41f-091cecb9f9c2\") " pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"
Sep 11 13:10:01.730488 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.730326    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9vsg\" (UniqueName: \"kubernetes.io/projected/421fd451-267e-489d-a41f-091cecb9f9c2-kube-api-access-f9vsg\") pod \"payload-processing-e2e-ait-48769560-6c68755cd9-8tw25\" (UID: \"421fd451-267e-489d-a41f-091cecb9f9c2\") " pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"
Sep 11 13:10:01.730991 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.730969    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/421fd451-267e-489d-a41f-091cecb9f9c2-plugins-config-volume\") pod \"payload-processing-e2e-ait-48769560-6c68755cd9-8tw25\" (UID: \"421fd451-267e-489d-a41f-091cecb9f9c2\") " pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"
Sep 11 13:10:01.739340 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.739314    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9vsg\" (UniqueName: \"kubernetes.io/projected/421fd451-267e-489d-a41f-091cecb9f9c2-kube-api-access-f9vsg\") pod \"payload-processing-e2e-ait-48769560-6c68755cd9-8tw25\" (UID: \"421fd451-267e-489d-a41f-091cecb9f9c2\") " pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"
Sep 11 13:10:01.767470 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.767432    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"
Sep 11 13:10:01.851217 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.851181    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"]
Sep 11 13:10:01.855686 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.855661    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:01.862690 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.862669    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-528ff6\"/\"kube-root-ca.crt\""
Sep 11 13:10:01.862826 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.862709    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-528ff6\"/\"test-model-528ff6-kserve-self-signed-certs\""
Sep 11 13:10:01.863951 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.863933    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-528ff6\"/\"openshift-service-ca.crt\""
Sep 11 13:10:01.866242 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.866226    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-528ff6\"/\"default-dockercfg-kzrzs\""
Sep 11 13:10:01.873310 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.873282    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"]
Sep 11 13:10:01.929490 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:01.929468    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"]
Sep 11 13:10:01.934182 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:10:01.934124    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76bbdb8f_8477_42e0_82d5_a5f83673e5bd.slice/crio-2d48a7b2ca4b248fc0d14382ae330810fbc55fac0d34b311d0b35d93bc1872f0 WatchSource:0}: Error finding container 2d48a7b2ca4b248fc0d14382ae330810fbc55fac0d34b311d0b35d93bc1872f0: Status 404 returned error can't find the container with id 2d48a7b2ca4b248fc0d14382ae330810fbc55fac0d34b311d0b35d93bc1872f0
Sep 11 13:10:02.033801 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.033768    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-home\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.033973 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.033809    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-dshm\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.033973 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.033830    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v4kn\" (UniqueName: \"kubernetes.io/projected/817f01aa-7d39-451f-930e-c541dc600881-kube-api-access-7v4kn\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.034098 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.033979    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-tmp-dir\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.034098 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.034057    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-model-cache\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.034188 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.034095    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/817f01aa-7d39-451f-930e-c541dc600881-tls-certs\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.057820 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.057772    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"]
Sep 11 13:10:02.062046 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:10:02.062014    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod421fd451_267e_489d_a41f_091cecb9f9c2.slice/crio-768ffd6826ded83296ce640f0e384663e8ee99e63f56722ac1548f4343c952a4 WatchSource:0}: Error finding container 768ffd6826ded83296ce640f0e384663e8ee99e63f56722ac1548f4343c952a4: Status 404 returned error can't find the container with id 768ffd6826ded83296ce640f0e384663e8ee99e63f56722ac1548f4343c952a4
Sep 11 13:10:02.135756 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.135690    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-tmp-dir\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.135896 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.135850    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-model-cache\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.136026 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.136002    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/817f01aa-7d39-451f-930e-c541dc600881-tls-certs\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.136080 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.136058    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-tmp-dir\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.136194 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.136175    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-home\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.136244 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.136198    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-model-cache\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.136244 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.136221    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-dshm\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.136244 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.136240    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v4kn\" (UniqueName: \"kubernetes.io/projected/817f01aa-7d39-451f-930e-c541dc600881-kube-api-access-7v4kn\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.136424 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.136403    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-home\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.138237 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.138219    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/817f01aa-7d39-451f-930e-c541dc600881-tls-certs\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.138315 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.138269    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-dshm\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.145704 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.145682    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v4kn\" (UniqueName: \"kubernetes.io/projected/817f01aa-7d39-451f-930e-c541dc600881-kube-api-access-7v4kn\") pod \"test-model-528ff6-kserve-d77469d59-kpsnc\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") " pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.165730 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.165690    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:02.499524 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.499444    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"]
Sep 11 13:10:02.502548 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:10:02.502521    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod817f01aa_7d39_451f_930e_c541dc600881.slice/crio-4dbc4d55148902e724cde90b51f9fee744129ef6c857b2fcc1b4120f87378655 WatchSource:0}: Error finding container 4dbc4d55148902e724cde90b51f9fee744129ef6c857b2fcc1b4120f87378655: Status 404 returned error can't find the container with id 4dbc4d55148902e724cde90b51f9fee744129ef6c857b2fcc1b4120f87378655
Sep 11 13:10:02.630182 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.630147    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts" event={"ID":"76bbdb8f-8477-42e0-82d5-a5f83673e5bd","Type":"ContainerStarted","Data":"4504ee034f79e9c45dd56be2b822cf98cb61928c5cd033d01c16cfda8b3823bc"}
Sep 11 13:10:02.630371 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.630211    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts" event={"ID":"76bbdb8f-8477-42e0-82d5-a5f83673e5bd","Type":"ContainerStarted","Data":"2d48a7b2ca4b248fc0d14382ae330810fbc55fac0d34b311d0b35d93bc1872f0"}
Sep 11 13:10:02.630371 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.630242    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"
Sep 11 13:10:02.631798 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.631758    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc" event={"ID":"817f01aa-7d39-451f-930e-c541dc600881","Type":"ContainerStarted","Data":"2eefdf90982dfa2c2dba385713d53f0494248ea1b9b32f23caa10935234a8e8f"}
Sep 11 13:10:02.631798 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.631802    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc" event={"ID":"817f01aa-7d39-451f-930e-c541dc600881","Type":"ContainerStarted","Data":"4dbc4d55148902e724cde90b51f9fee744129ef6c857b2fcc1b4120f87378655"}
Sep 11 13:10:02.633359 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.633325    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25" event={"ID":"421fd451-267e-489d-a41f-091cecb9f9c2","Type":"ContainerStarted","Data":"e4b7d76b3ddf26cbfe71f22719dad87d390c92f06dce001a0b5aed493fee0711"}
Sep 11 13:10:02.633465 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.633371    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25" event={"ID":"421fd451-267e-489d-a41f-091cecb9f9c2","Type":"ContainerStarted","Data":"768ffd6826ded83296ce640f0e384663e8ee99e63f56722ac1548f4343c952a4"}
Sep 11 13:10:02.633465 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.633412    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"
Sep 11 13:10:02.760436 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.760322    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts" podStartSLOduration=1.7603015549999999 podStartE2EDuration="1.760301555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:10:02.685677404 +0000 UTC m=+872.189541799" watchObservedRunningTime="2026-09-11 13:10:02.760301555 +0000 UTC m=+872.264165949"
Sep 11 13:10:02.760590 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.760440    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25" podStartSLOduration=1.76043175 podStartE2EDuration="1.76043175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:10:02.760413325 +0000 UTC m=+872.264277729" watchObservedRunningTime="2026-09-11 13:10:02.76043175 +0000 UTC m=+872.264296146"
Sep 11 13:10:02.804177 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:02.804124    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc" podStartSLOduration=1.804106352 podStartE2EDuration="1.804106352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:10:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:10:02.801071208 +0000 UTC m=+872.304935602" watchObservedRunningTime="2026-09-11 13:10:02.804106352 +0000 UTC m=+872.307970745"
Sep 11 13:10:07.887530 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:07.887483    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:10:12.166252 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:12.166190    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:12.166833 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:12.166791    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:12.178674 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:12.178644    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:12.698382 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:12.698345    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:10:13.640419 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:13.640389    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"
Sep 11 13:10:13.640812 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:13.640467    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"
Sep 11 13:10:18.720052 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:18.720020    2547 generic.go:356] "Generic (PLEG): container finished" podID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerID="3e34b1211e59d38aecb31eb483c0fbaae98d80ce41115f61cf65ad6887257ad9" exitCode=0
Sep 11 13:10:18.720493 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:18.720091    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq" event={"ID":"2d8599b5-2a55-44a7-9e2a-8802f770a413","Type":"ContainerDied","Data":"3e34b1211e59d38aecb31eb483c0fbaae98d80ce41115f61cf65ad6887257ad9"}
Sep 11 13:10:18.720549 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:18.720492    2547 scope.go:117] "RemoveContainer" containerID="3e34b1211e59d38aecb31eb483c0fbaae98d80ce41115f61cf65ad6887257ad9"
Sep 11 13:10:18.721483 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:18.721456    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:10:18.721599 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:18.721519    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:10:18.721599 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:18.721548    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:10:19.727499 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:19.727467    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq" event={"ID":"2d8599b5-2a55-44a7-9e2a-8802f770a413","Type":"ContainerStarted","Data":"f66fd4f0e904e1f91b9b357160f35e0b269fabf25d1ad5571e1b41c09490ed00"}
Sep 11 13:10:19.987369 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:19.987279    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:10:19.987528 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:19.987504    2547 patch_prober.go:28] interesting pod/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 11 13:10:19.987575 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:19.987554    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq" podUID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 11 13:10:20.987889 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:20.987853    2547 patch_prober.go:28] interesting pod/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 11 13:10:20.988278 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:20.987910    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq" podUID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 11 13:10:21.987633 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:21.987589    2547 patch_prober.go:28] interesting pod/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 11 13:10:21.987846 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:21.987652    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq" podUID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 11 13:10:22.987249 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:22.987209    2547 patch_prober.go:28] interesting pod/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 11 13:10:22.987634 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:22.987280    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq" podUID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 11 13:10:23.059322 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.059225    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"]
Sep 11 13:10:23.059609 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.059511    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25" podUID="421fd451-267e-489d-a41f-091cecb9f9c2" containerName="payload-processing" containerID="cri-o://e4b7d76b3ddf26cbfe71f22719dad87d390c92f06dce001a0b5aed493fee0711" gracePeriod=30
Sep 11 13:10:23.063122 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.063075    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"]
Sep 11 13:10:23.072107 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.072062    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts" podUID="76bbdb8f-8477-42e0-82d5-a5f83673e5bd" containerName="payload-pre-processing" containerID="cri-o://4504ee034f79e9c45dd56be2b822cf98cb61928c5cd033d01c16cfda8b3823bc" gracePeriod=30
Sep 11 13:10:23.427378 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.427338    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"
Sep 11 13:10:23.434828 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.434802    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"
Sep 11 13:10:23.574741 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.574021    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9vsg\" (UniqueName: \"kubernetes.io/projected/421fd451-267e-489d-a41f-091cecb9f9c2-kube-api-access-f9vsg\") pod \"421fd451-267e-489d-a41f-091cecb9f9c2\" (UID: \"421fd451-267e-489d-a41f-091cecb9f9c2\") "
Sep 11 13:10:23.574741 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.574152    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76bbdb8f-8477-42e0-82d5-a5f83673e5bd-plugins-config-volume\") pod \"76bbdb8f-8477-42e0-82d5-a5f83673e5bd\" (UID: \"76bbdb8f-8477-42e0-82d5-a5f83673e5bd\") "
Sep 11 13:10:23.574741 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.574275    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4qv8\" (UniqueName: \"kubernetes.io/projected/76bbdb8f-8477-42e0-82d5-a5f83673e5bd-kube-api-access-j4qv8\") pod \"76bbdb8f-8477-42e0-82d5-a5f83673e5bd\" (UID: \"76bbdb8f-8477-42e0-82d5-a5f83673e5bd\") "
Sep 11 13:10:23.574741 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.574307    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/421fd451-267e-489d-a41f-091cecb9f9c2-plugins-config-volume\") pod \"421fd451-267e-489d-a41f-091cecb9f9c2\" (UID: \"421fd451-267e-489d-a41f-091cecb9f9c2\") "
Sep 11 13:10:23.575123 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.575025    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/421fd451-267e-489d-a41f-091cecb9f9c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "421fd451-267e-489d-a41f-091cecb9f9c2" (UID: "421fd451-267e-489d-a41f-091cecb9f9c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:10:23.575181 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.575124    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76bbdb8f-8477-42e0-82d5-a5f83673e5bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "76bbdb8f-8477-42e0-82d5-a5f83673e5bd" (UID: "76bbdb8f-8477-42e0-82d5-a5f83673e5bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:10:23.580739 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.579539    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76bbdb8f-8477-42e0-82d5-a5f83673e5bd-kube-api-access-j4qv8" (OuterVolumeSpecName: "kube-api-access-j4qv8") pod "76bbdb8f-8477-42e0-82d5-a5f83673e5bd" (UID: "76bbdb8f-8477-42e0-82d5-a5f83673e5bd"). InnerVolumeSpecName "kube-api-access-j4qv8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:10:23.583788 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.582884    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/421fd451-267e-489d-a41f-091cecb9f9c2-kube-api-access-f9vsg" (OuterVolumeSpecName: "kube-api-access-f9vsg") pod "421fd451-267e-489d-a41f-091cecb9f9c2" (UID: "421fd451-267e-489d-a41f-091cecb9f9c2"). InnerVolumeSpecName "kube-api-access-f9vsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:10:23.675855 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.675811    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/76bbdb8f-8477-42e0-82d5-a5f83673e5bd-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:10:23.675855 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.675846    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4qv8\" (UniqueName: \"kubernetes.io/projected/76bbdb8f-8477-42e0-82d5-a5f83673e5bd-kube-api-access-j4qv8\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:10:23.675855 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.675857    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/421fd451-267e-489d-a41f-091cecb9f9c2-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:10:23.675855 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.675866    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9vsg\" (UniqueName: \"kubernetes.io/projected/421fd451-267e-489d-a41f-091cecb9f9c2-kube-api-access-f9vsg\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:10:23.752979 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.752932    2547 generic.go:356] "Generic (PLEG): container finished" podID="76bbdb8f-8477-42e0-82d5-a5f83673e5bd" containerID="4504ee034f79e9c45dd56be2b822cf98cb61928c5cd033d01c16cfda8b3823bc" exitCode=0
Sep 11 13:10:23.753189 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.753085    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts" event={"ID":"76bbdb8f-8477-42e0-82d5-a5f83673e5bd","Type":"ContainerDied","Data":"4504ee034f79e9c45dd56be2b822cf98cb61928c5cd033d01c16cfda8b3823bc"}
Sep 11 13:10:23.753189 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.753140    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts" event={"ID":"76bbdb8f-8477-42e0-82d5-a5f83673e5bd","Type":"ContainerDied","Data":"2d48a7b2ca4b248fc0d14382ae330810fbc55fac0d34b311d0b35d93bc1872f0"}
Sep 11 13:10:23.753189 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.753172    2547 scope.go:117] "RemoveContainer" containerID="4504ee034f79e9c45dd56be2b822cf98cb61928c5cd033d01c16cfda8b3823bc"
Sep 11 13:10:23.753365 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.753340    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"
Sep 11 13:10:23.759220 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.759178    2547 generic.go:356] "Generic (PLEG): container finished" podID="421fd451-267e-489d-a41f-091cecb9f9c2" containerID="e4b7d76b3ddf26cbfe71f22719dad87d390c92f06dce001a0b5aed493fee0711" exitCode=0
Sep 11 13:10:23.759345 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.759291    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25" event={"ID":"421fd451-267e-489d-a41f-091cecb9f9c2","Type":"ContainerDied","Data":"e4b7d76b3ddf26cbfe71f22719dad87d390c92f06dce001a0b5aed493fee0711"}
Sep 11 13:10:23.759345 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.759337    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25" event={"ID":"421fd451-267e-489d-a41f-091cecb9f9c2","Type":"ContainerDied","Data":"768ffd6826ded83296ce640f0e384663e8ee99e63f56722ac1548f4343c952a4"}
Sep 11 13:10:23.759461 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.759447    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"
Sep 11 13:10:23.783779 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.783759    2547 scope.go:117] "RemoveContainer" containerID="4504ee034f79e9c45dd56be2b822cf98cb61928c5cd033d01c16cfda8b3823bc"
Sep 11 13:10:23.784167 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:10:23.784146    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4504ee034f79e9c45dd56be2b822cf98cb61928c5cd033d01c16cfda8b3823bc\": container with ID starting with 4504ee034f79e9c45dd56be2b822cf98cb61928c5cd033d01c16cfda8b3823bc not found: ID does not exist" containerID="4504ee034f79e9c45dd56be2b822cf98cb61928c5cd033d01c16cfda8b3823bc"
Sep 11 13:10:23.784224 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.784177    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4504ee034f79e9c45dd56be2b822cf98cb61928c5cd033d01c16cfda8b3823bc"} err="failed to get container status \"4504ee034f79e9c45dd56be2b822cf98cb61928c5cd033d01c16cfda8b3823bc\": rpc error: code = NotFound desc = could not find container \"4504ee034f79e9c45dd56be2b822cf98cb61928c5cd033d01c16cfda8b3823bc\": container with ID starting with 4504ee034f79e9c45dd56be2b822cf98cb61928c5cd033d01c16cfda8b3823bc not found: ID does not exist"
Sep 11 13:10:23.784224 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.784197    2547 scope.go:117] "RemoveContainer" containerID="e4b7d76b3ddf26cbfe71f22719dad87d390c92f06dce001a0b5aed493fee0711"
Sep 11 13:10:23.791016 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.790990    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"]
Sep 11 13:10:23.793302 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.793282    2547 scope.go:117] "RemoveContainer" containerID="e4b7d76b3ddf26cbfe71f22719dad87d390c92f06dce001a0b5aed493fee0711"
Sep 11 13:10:23.793681 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:10:23.793657    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4b7d76b3ddf26cbfe71f22719dad87d390c92f06dce001a0b5aed493fee0711\": container with ID starting with e4b7d76b3ddf26cbfe71f22719dad87d390c92f06dce001a0b5aed493fee0711 not found: ID does not exist" containerID="e4b7d76b3ddf26cbfe71f22719dad87d390c92f06dce001a0b5aed493fee0711"
Sep 11 13:10:23.793784 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.793687    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4b7d76b3ddf26cbfe71f22719dad87d390c92f06dce001a0b5aed493fee0711"} err="failed to get container status \"e4b7d76b3ddf26cbfe71f22719dad87d390c92f06dce001a0b5aed493fee0711\": rpc error: code = NotFound desc = could not find container \"e4b7d76b3ddf26cbfe71f22719dad87d390c92f06dce001a0b5aed493fee0711\": container with ID starting with e4b7d76b3ddf26cbfe71f22719dad87d390c92f06dce001a0b5aed493fee0711 not found: ID does not exist"
Sep 11 13:10:23.798924 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.798896    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-48769560-6c68755cd9-8tw25"]
Sep 11 13:10:23.811691 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.811654    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"]
Sep 11 13:10:23.817619 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.817587    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-48769560-7565cc9754-kw5ts"]
Sep 11 13:10:23.987727 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.987627    2547 patch_prober.go:28] interesting pod/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body=
Sep 11 13:10:23.987727 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:23.987685    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq" podUID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused"
Sep 11 13:10:24.586995 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:24.586956    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"]
Sep 11 13:10:24.587203 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:24.587171    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq" podUID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerName="istio-proxy" containerID="cri-o://f66fd4f0e904e1f91b9b357160f35e0b269fabf25d1ad5571e1b41c09490ed00" gracePeriod=30
Sep 11 13:10:25.007562 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:25.007476    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="421fd451-267e-489d-a41f-091cecb9f9c2" path="/var/lib/kubelet/pods/421fd451-267e-489d-a41f-091cecb9f9c2/volumes"
Sep 11 13:10:25.007957 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:25.007868    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76bbdb8f-8477-42e0-82d5-a5f83673e5bd" path="/var/lib/kubelet/pods/76bbdb8f-8477-42e0-82d5-a5f83673e5bd/volumes"
Sep 11 13:10:26.594325 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:26.594280    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:10:31.144981 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.144952    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:10:31.254641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.254553    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbdfc\" (UniqueName: \"kubernetes.io/projected/2d8599b5-2a55-44a7-9e2a-8802f770a413-kube-api-access-wbdfc\") pod \"2d8599b5-2a55-44a7-9e2a-8802f770a413\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") "
Sep 11 13:10:31.254641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.254592    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-podinfo\") pod \"2d8599b5-2a55-44a7-9e2a-8802f770a413\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") "
Sep 11 13:10:31.254641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.254631    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d8599b5-2a55-44a7-9e2a-8802f770a413-istiod-ca-cert\") pod \"2d8599b5-2a55-44a7-9e2a-8802f770a413\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") "
Sep 11 13:10:31.254966 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.254653    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-envoy\") pod \"2d8599b5-2a55-44a7-9e2a-8802f770a413\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") "
Sep 11 13:10:31.254966 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.254684    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-credential-socket\") pod \"2d8599b5-2a55-44a7-9e2a-8802f770a413\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") "
Sep 11 13:10:31.254966 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.254839    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-data\") pod \"2d8599b5-2a55-44a7-9e2a-8802f770a413\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") "
Sep 11 13:10:31.254966 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.254893    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-workload-certs\") pod \"2d8599b5-2a55-44a7-9e2a-8802f770a413\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") "
Sep 11 13:10:31.254966 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.254929    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-workload-socket\") pod \"2d8599b5-2a55-44a7-9e2a-8802f770a413\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") "
Sep 11 13:10:31.255296 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.254977    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-token\") pod \"2d8599b5-2a55-44a7-9e2a-8802f770a413\" (UID: \"2d8599b5-2a55-44a7-9e2a-8802f770a413\") "
Sep 11 13:10:31.255296 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.255055    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d8599b5-2a55-44a7-9e2a-8802f770a413" (UID: "2d8599b5-2a55-44a7-9e2a-8802f770a413"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:10:31.255296 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.255150    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d8599b5-2a55-44a7-9e2a-8802f770a413" (UID: "2d8599b5-2a55-44a7-9e2a-8802f770a413"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:10:31.255296 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.255263    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d8599b5-2a55-44a7-9e2a-8802f770a413-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d8599b5-2a55-44a7-9e2a-8802f770a413" (UID: "2d8599b5-2a55-44a7-9e2a-8802f770a413"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:10:31.255296 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.255281    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d8599b5-2a55-44a7-9e2a-8802f770a413" (UID: "2d8599b5-2a55-44a7-9e2a-8802f770a413"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:10:31.255564 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.255379    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d8599b5-2a55-44a7-9e2a-8802f770a413-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:10:31.255564 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.255399    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:10:31.255564 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.255413    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:10:31.255564 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.255426    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:10:31.255564 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.255445    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d8599b5-2a55-44a7-9e2a-8802f770a413" (UID: "2d8599b5-2a55-44a7-9e2a-8802f770a413"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:10:31.256879 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.256851    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d8599b5-2a55-44a7-9e2a-8802f770a413-kube-api-access-wbdfc" (OuterVolumeSpecName: "kube-api-access-wbdfc") pod "2d8599b5-2a55-44a7-9e2a-8802f770a413" (UID: "2d8599b5-2a55-44a7-9e2a-8802f770a413"). InnerVolumeSpecName "kube-api-access-wbdfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:10:31.257027 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.257005    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d8599b5-2a55-44a7-9e2a-8802f770a413" (UID: "2d8599b5-2a55-44a7-9e2a-8802f770a413"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:10:31.257072 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.257023    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d8599b5-2a55-44a7-9e2a-8802f770a413" (UID: "2d8599b5-2a55-44a7-9e2a-8802f770a413"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:10:31.257185 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.257167    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d8599b5-2a55-44a7-9e2a-8802f770a413" (UID: "2d8599b5-2a55-44a7-9e2a-8802f770a413"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:10:31.356471 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.356438    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbdfc\" (UniqueName: \"kubernetes.io/projected/2d8599b5-2a55-44a7-9e2a-8802f770a413-kube-api-access-wbdfc\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:10:31.356471 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.356464    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:10:31.356471 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.356475    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:10:31.356707 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.356485    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:10:31.356707 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.356492    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d8599b5-2a55-44a7-9e2a-8802f770a413-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:10:31.833476 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.833440    2547 generic.go:356] "Generic (PLEG): container finished" podID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerID="f66fd4f0e904e1f91b9b357160f35e0b269fabf25d1ad5571e1b41c09490ed00" exitCode=0
Sep 11 13:10:31.833655 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.833485    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"
Sep 11 13:10:31.833655 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.833514    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq" event={"ID":"2d8599b5-2a55-44a7-9e2a-8802f770a413","Type":"ContainerDied","Data":"f66fd4f0e904e1f91b9b357160f35e0b269fabf25d1ad5571e1b41c09490ed00"}
Sep 11 13:10:31.833655 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.833562    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq" event={"ID":"2d8599b5-2a55-44a7-9e2a-8802f770a413","Type":"ContainerDied","Data":"73f976df35a1635518b509a795771b84066f183b7c7f1996bb16bccbd84d6907"}
Sep 11 13:10:31.833655 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.833588    2547 scope.go:117] "RemoveContainer" containerID="f66fd4f0e904e1f91b9b357160f35e0b269fabf25d1ad5571e1b41c09490ed00"
Sep 11 13:10:31.842796 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.842781    2547 scope.go:117] "RemoveContainer" containerID="3e34b1211e59d38aecb31eb483c0fbaae98d80ce41115f61cf65ad6887257ad9"
Sep 11 13:10:31.850707 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.850691    2547 scope.go:117] "RemoveContainer" containerID="f66fd4f0e904e1f91b9b357160f35e0b269fabf25d1ad5571e1b41c09490ed00"
Sep 11 13:10:31.851037 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:10:31.851018    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f66fd4f0e904e1f91b9b357160f35e0b269fabf25d1ad5571e1b41c09490ed00\": container with ID starting with f66fd4f0e904e1f91b9b357160f35e0b269fabf25d1ad5571e1b41c09490ed00 not found: ID does not exist" containerID="f66fd4f0e904e1f91b9b357160f35e0b269fabf25d1ad5571e1b41c09490ed00"
Sep 11 13:10:31.851109 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.851044    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f66fd4f0e904e1f91b9b357160f35e0b269fabf25d1ad5571e1b41c09490ed00"} err="failed to get container status \"f66fd4f0e904e1f91b9b357160f35e0b269fabf25d1ad5571e1b41c09490ed00\": rpc error: code = NotFound desc = could not find container \"f66fd4f0e904e1f91b9b357160f35e0b269fabf25d1ad5571e1b41c09490ed00\": container with ID starting with f66fd4f0e904e1f91b9b357160f35e0b269fabf25d1ad5571e1b41c09490ed00 not found: ID does not exist"
Sep 11 13:10:31.851109 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.851061    2547 scope.go:117] "RemoveContainer" containerID="3e34b1211e59d38aecb31eb483c0fbaae98d80ce41115f61cf65ad6887257ad9"
Sep 11 13:10:31.851306 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:10:31.851286    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e34b1211e59d38aecb31eb483c0fbaae98d80ce41115f61cf65ad6887257ad9\": container with ID starting with 3e34b1211e59d38aecb31eb483c0fbaae98d80ce41115f61cf65ad6887257ad9 not found: ID does not exist" containerID="3e34b1211e59d38aecb31eb483c0fbaae98d80ce41115f61cf65ad6887257ad9"
Sep 11 13:10:31.851350 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.851311    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e34b1211e59d38aecb31eb483c0fbaae98d80ce41115f61cf65ad6887257ad9"} err="failed to get container status \"3e34b1211e59d38aecb31eb483c0fbaae98d80ce41115f61cf65ad6887257ad9\": rpc error: code = NotFound desc = could not find container \"3e34b1211e59d38aecb31eb483c0fbaae98d80ce41115f61cf65ad6887257ad9\": container with ID starting with 3e34b1211e59d38aecb31eb483c0fbaae98d80ce41115f61cf65ad6887257ad9 not found: ID does not exist"
Sep 11 13:10:31.869056 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.869029    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"]
Sep 11 13:10:31.880388 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:31.880364    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-48769560-openshift-default-5d556f484b-jkrsq"]
Sep 11 13:10:33.006782 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:33.006749    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d8599b5-2a55-44a7-9e2a-8802f770a413" path="/var/lib/kubelet/pods/2d8599b5-2a55-44a7-9e2a-8802f770a413/volumes"
Sep 11 13:10:33.896755 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:33.894234    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:10:34.705854 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.705811    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"]
Sep 11 13:10:34.706231 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.706217    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerName="istio-proxy"
Sep 11 13:10:34.706290 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.706234    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerName="istio-proxy"
Sep 11 13:10:34.706290 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.706251    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76bbdb8f-8477-42e0-82d5-a5f83673e5bd" containerName="payload-pre-processing"
Sep 11 13:10:34.706290 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.706257    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="76bbdb8f-8477-42e0-82d5-a5f83673e5bd" containerName="payload-pre-processing"
Sep 11 13:10:34.706290 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.706270    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerName="istio-proxy"
Sep 11 13:10:34.706290 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.706280    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerName="istio-proxy"
Sep 11 13:10:34.706451 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.706292    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="421fd451-267e-489d-a41f-091cecb9f9c2" containerName="payload-processing"
Sep 11 13:10:34.706451 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.706299    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="421fd451-267e-489d-a41f-091cecb9f9c2" containerName="payload-processing"
Sep 11 13:10:34.706451 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.706346    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="76bbdb8f-8477-42e0-82d5-a5f83673e5bd" containerName="payload-pre-processing"
Sep 11 13:10:34.706451 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.706356    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerName="istio-proxy"
Sep 11 13:10:34.706451 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.706368    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d8599b5-2a55-44a7-9e2a-8802f770a413" containerName="istio-proxy"
Sep 11 13:10:34.706451 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.706375    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="421fd451-267e-489d-a41f-091cecb9f9c2" containerName="payload-processing"
Sep 11 13:10:34.710890 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.710873    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"
Sep 11 13:10:34.715609 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.715586    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-a30ab725\""
Sep 11 13:10:34.715740 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.715641    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-a30ab725-dockercfg-dxqz6\""
Sep 11 13:10:34.746629 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.746595    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"]
Sep 11 13:10:34.782493 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.782454    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjz88\" (UniqueName: \"kubernetes.io/projected/1e23ca80-e67a-40aa-be16-1b4fce92c3e8-kube-api-access-jjz88\") pod \"payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr\" (UID: \"1e23ca80-e67a-40aa-be16-1b4fce92c3e8\") " pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"
Sep 11 13:10:34.782665 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.782528    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e23ca80-e67a-40aa-be16-1b4fce92c3e8-plugins-config-volume\") pod \"payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr\" (UID: \"1e23ca80-e67a-40aa-be16-1b4fce92c3e8\") " pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"
Sep 11 13:10:34.883211 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.883167    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjz88\" (UniqueName: \"kubernetes.io/projected/1e23ca80-e67a-40aa-be16-1b4fce92c3e8-kube-api-access-jjz88\") pod \"payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr\" (UID: \"1e23ca80-e67a-40aa-be16-1b4fce92c3e8\") " pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"
Sep 11 13:10:34.883370 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.883265    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e23ca80-e67a-40aa-be16-1b4fce92c3e8-plugins-config-volume\") pod \"payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr\" (UID: \"1e23ca80-e67a-40aa-be16-1b4fce92c3e8\") " pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"
Sep 11 13:10:34.884000 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.883982    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e23ca80-e67a-40aa-be16-1b4fce92c3e8-plugins-config-volume\") pod \"payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr\" (UID: \"1e23ca80-e67a-40aa-be16-1b4fce92c3e8\") " pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"
Sep 11 13:10:34.893695 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:34.893667    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjz88\" (UniqueName: \"kubernetes.io/projected/1e23ca80-e67a-40aa-be16-1b4fce92c3e8-kube-api-access-jjz88\") pod \"payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr\" (UID: \"1e23ca80-e67a-40aa-be16-1b4fce92c3e8\") " pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"
Sep 11 13:10:35.021047 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:35.021018    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"
Sep 11 13:10:35.305048 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:35.305015    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"]
Sep 11 13:10:35.307994 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:10:35.307961    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e23ca80_e67a_40aa_be16_1b4fce92c3e8.slice/crio-5a69e772b908ee565c40d41104199c680c7a3ec65f43c97ba014a3348e6ab794 WatchSource:0}: Error finding container 5a69e772b908ee565c40d41104199c680c7a3ec65f43c97ba014a3348e6ab794: Status 404 returned error can't find the container with id 5a69e772b908ee565c40d41104199c680c7a3ec65f43c97ba014a3348e6ab794
Sep 11 13:10:35.856600 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:35.856566    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr" event={"ID":"1e23ca80-e67a-40aa-be16-1b4fce92c3e8","Type":"ContainerStarted","Data":"99eb04da98431fef2f230d8e0209b4b0065c2c4d7c1494a30ce9511ca0c70e42"}
Sep 11 13:10:35.857109 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:35.856620    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"
Sep 11 13:10:35.857109 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:35.856636    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr" event={"ID":"1e23ca80-e67a-40aa-be16-1b4fce92c3e8","Type":"ContainerStarted","Data":"5a69e772b908ee565c40d41104199c680c7a3ec65f43c97ba014a3348e6ab794"}
Sep 11 13:10:35.894821 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:35.894763    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr" podStartSLOduration=1.894712304 podStartE2EDuration="1.894712304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:10:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:10:35.894229348 +0000 UTC m=+905.398093742" watchObservedRunningTime="2026-09-11 13:10:35.894712304 +0000 UTC m=+905.398606352"
Sep 11 13:10:46.864413 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:46.864382    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"
Sep 11 13:10:54.623814 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:10:54.623772    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:11:00.491966 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:00.491932    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"]
Sep 11 13:11:00.492359 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:00.492188    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy" containerID="cri-o://4bc961f10bed047bcf11621d61a614929818ae1ac2a216e5046a399a4d4e70fd" gracePeriod=30
Sep 11 13:11:01.309330 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.309298    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"]
Sep 11 13:11:01.312858 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.312833    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.315150 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.315128    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-ecc2b9-openshift-default-dockercfg-5qcz8\""
Sep 11 13:11:01.334002 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.333974    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"]
Sep 11 13:11:01.430405 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.430370    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8pqp\" (UniqueName: \"kubernetes.io/projected/9d67690b-0191-41b2-bb5d-a57addecc6a9-kube-api-access-m8pqp\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.430405 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.430418    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d67690b-0191-41b2-bb5d-a57addecc6a9-istiod-ca-cert\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.430693 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.430451    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-workload-certs\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.430693 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.430478    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-podinfo\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.430693 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.430521    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-token\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.430693 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.430602    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-envoy\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.430693 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.430641    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-workload-socket\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.430982 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.430739    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-credential-socket\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.430982 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.430765    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-data\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.531661 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.531626    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-workload-socket\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.532163 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.531687    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-credential-socket\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.532163 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.531738    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-data\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.532163 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.531807    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8pqp\" (UniqueName: \"kubernetes.io/projected/9d67690b-0191-41b2-bb5d-a57addecc6a9-kube-api-access-m8pqp\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.532163 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.531841    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d67690b-0191-41b2-bb5d-a57addecc6a9-istiod-ca-cert\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.532163 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.531864    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-workload-certs\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.532163 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.531893    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-podinfo\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.532163 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.532012    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-token\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.532163 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.532100    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-envoy\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.532163 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.532113    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-workload-socket\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.532612 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.532461    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-data\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.532612 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.532459    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-credential-socket\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.532612 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.532525    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d67690b-0191-41b2-bb5d-a57addecc6a9-istiod-ca-cert\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.532612 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.532533    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-workload-certs\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.534309 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.534288    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-envoy\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.534400 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.534352    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-podinfo\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.540762 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.540735    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-token\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.540907 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.540892    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8pqp\" (UniqueName: \"kubernetes.io/projected/9d67690b-0191-41b2-bb5d-a57addecc6a9-kube-api-access-m8pqp\") pod \"e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") " pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.623730 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.623632    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:01.939330 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.939303    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"]
Sep 11 13:11:01.941386 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:11:01.941345    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d67690b_0191_41b2_bb5d_a57addecc6a9.slice/crio-c619bd764276ccba112d37fbf89110c469433143c1eb3668cbceae01ba092b3a WatchSource:0}: Error finding container c619bd764276ccba112d37fbf89110c469433143c1eb3668cbceae01ba092b3a: Status 404 returned error can't find the container with id c619bd764276ccba112d37fbf89110c469433143c1eb3668cbceae01ba092b3a
Sep 11 13:11:01.943872 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.943838    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:11:01.943943 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.943906    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:11:01.943943 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.943934    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:11:01.986435 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:01.986402    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" event={"ID":"9d67690b-0191-41b2-bb5d-a57addecc6a9","Type":"ContainerStarted","Data":"c619bd764276ccba112d37fbf89110c469433143c1eb3668cbceae01ba092b3a"}
Sep 11 13:11:02.992675 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:02.992639    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" event={"ID":"9d67690b-0191-41b2-bb5d-a57addecc6a9","Type":"ContainerStarted","Data":"5d887c87e08027f20beb800c0c9b34d0b2240a79701959c7b4e582e56f785e80"}
Sep 11 13:11:03.029575 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:03.029515    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" podStartSLOduration=2.029498217 podStartE2EDuration="2.029498217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:11:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:11:03.02648913 +0000 UTC m=+932.530353525" watchObservedRunningTime="2026-09-11 13:11:03.029498217 +0000 UTC m=+932.533362609"
Sep 11 13:11:03.396560 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:03.396519    2547 patch_prober.go:28] interesting pod/e2e-autores-efc023-openshift-default-586b67554d-jxb5m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 13:11:03.396787 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:03.396600    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 13:11:03.623800 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:03.623760    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:03.629593 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:03.629566    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:03.997705 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:03.997676    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:03.998703 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:03.998688    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:05.751148 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.751120    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:11:05.883369 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.883333    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/269008b9-49c9-4163-b666-1f75b18bb8b8-istiod-ca-cert\") pod \"269008b9-49c9-4163-b666-1f75b18bb8b8\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") "
Sep 11 13:11:05.883576 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.883386    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pbzzl\" (UniqueName: \"kubernetes.io/projected/269008b9-49c9-4163-b666-1f75b18bb8b8-kube-api-access-pbzzl\") pod \"269008b9-49c9-4163-b666-1f75b18bb8b8\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") "
Sep 11 13:11:05.883576 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.883466    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-credential-socket\") pod \"269008b9-49c9-4163-b666-1f75b18bb8b8\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") "
Sep 11 13:11:05.883576 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.883524    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-data\") pod \"269008b9-49c9-4163-b666-1f75b18bb8b8\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") "
Sep 11 13:11:05.883576 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.883547    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-workload-certs\") pod \"269008b9-49c9-4163-b666-1f75b18bb8b8\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") "
Sep 11 13:11:05.883863 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.883595    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-workload-socket\") pod \"269008b9-49c9-4163-b666-1f75b18bb8b8\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") "
Sep 11 13:11:05.883863 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.883645    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-token\") pod \"269008b9-49c9-4163-b666-1f75b18bb8b8\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") "
Sep 11 13:11:05.883863 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.883669    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-podinfo\") pod \"269008b9-49c9-4163-b666-1f75b18bb8b8\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") "
Sep 11 13:11:05.883863 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.883695    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-envoy\") pod \"269008b9-49c9-4163-b666-1f75b18bb8b8\" (UID: \"269008b9-49c9-4163-b666-1f75b18bb8b8\") "
Sep 11 13:11:05.884090 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.883828    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/269008b9-49c9-4163-b666-1f75b18bb8b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "269008b9-49c9-4163-b666-1f75b18bb8b8" (UID: "269008b9-49c9-4163-b666-1f75b18bb8b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:11:05.884090 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.883929    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "269008b9-49c9-4163-b666-1f75b18bb8b8" (UID: "269008b9-49c9-4163-b666-1f75b18bb8b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:05.884090 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.884029    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "269008b9-49c9-4163-b666-1f75b18bb8b8" (UID: "269008b9-49c9-4163-b666-1f75b18bb8b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:05.884277 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.884116    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:05.884277 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.884135    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/269008b9-49c9-4163-b666-1f75b18bb8b8-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:05.884277 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.884150    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:05.884277 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.884229    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "269008b9-49c9-4163-b666-1f75b18bb8b8" (UID: "269008b9-49c9-4163-b666-1f75b18bb8b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:05.884277 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.884244    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "269008b9-49c9-4163-b666-1f75b18bb8b8" (UID: "269008b9-49c9-4163-b666-1f75b18bb8b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:05.886561 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.886531    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "269008b9-49c9-4163-b666-1f75b18bb8b8" (UID: "269008b9-49c9-4163-b666-1f75b18bb8b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:05.886837 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.886806    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "269008b9-49c9-4163-b666-1f75b18bb8b8" (UID: "269008b9-49c9-4163-b666-1f75b18bb8b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:05.886946 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.886854    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/269008b9-49c9-4163-b666-1f75b18bb8b8-kube-api-access-pbzzl" (OuterVolumeSpecName: "kube-api-access-pbzzl") pod "269008b9-49c9-4163-b666-1f75b18bb8b8" (UID: "269008b9-49c9-4163-b666-1f75b18bb8b8"). InnerVolumeSpecName "kube-api-access-pbzzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:05.887156 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.887133    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "269008b9-49c9-4163-b666-1f75b18bb8b8" (UID: "269008b9-49c9-4163-b666-1f75b18bb8b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:11:05.985774 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.985709    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:05.985774 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.985769    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:05.985774 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.985783    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:05.986098 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.985798    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pbzzl\" (UniqueName: \"kubernetes.io/projected/269008b9-49c9-4163-b666-1f75b18bb8b8-kube-api-access-pbzzl\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:05.986098 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.985811    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:05.986098 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:05.985822    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/269008b9-49c9-4163-b666-1f75b18bb8b8-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:06.011499 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:06.011462    2547 generic.go:356] "Generic (PLEG): container finished" podID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerID="4bc961f10bed047bcf11621d61a614929818ae1ac2a216e5046a399a4d4e70fd" exitCode=0
Sep 11 13:11:06.011672 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:06.011522    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"
Sep 11 13:11:06.011672 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:06.011544    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" event={"ID":"269008b9-49c9-4163-b666-1f75b18bb8b8","Type":"ContainerDied","Data":"4bc961f10bed047bcf11621d61a614929818ae1ac2a216e5046a399a4d4e70fd"}
Sep 11 13:11:06.011672 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:06.011592    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m" event={"ID":"269008b9-49c9-4163-b666-1f75b18bb8b8","Type":"ContainerDied","Data":"038516d42a6da1b0c57a667abadde2cd671b2a85c2cf32634ac91fe7f1d0cce8"}
Sep 11 13:11:06.011672 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:06.011614    2547 scope.go:117] "RemoveContainer" containerID="4bc961f10bed047bcf11621d61a614929818ae1ac2a216e5046a399a4d4e70fd"
Sep 11 13:11:06.022406 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:06.022121    2547 scope.go:117] "RemoveContainer" containerID="53ba30d836facf6664661308daa1e41fc252d06c2b03cb9859de9eb71a8b53a7"
Sep 11 13:11:06.041143 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:06.041013    2547 scope.go:117] "RemoveContainer" containerID="4bc961f10bed047bcf11621d61a614929818ae1ac2a216e5046a399a4d4e70fd"
Sep 11 13:11:06.041771 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:11:06.041597    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc961f10bed047bcf11621d61a614929818ae1ac2a216e5046a399a4d4e70fd\": container with ID starting with 4bc961f10bed047bcf11621d61a614929818ae1ac2a216e5046a399a4d4e70fd not found: ID does not exist" containerID="4bc961f10bed047bcf11621d61a614929818ae1ac2a216e5046a399a4d4e70fd"
Sep 11 13:11:06.041771 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:06.041638    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc961f10bed047bcf11621d61a614929818ae1ac2a216e5046a399a4d4e70fd"} err="failed to get container status \"4bc961f10bed047bcf11621d61a614929818ae1ac2a216e5046a399a4d4e70fd\": rpc error: code = NotFound desc = could not find container \"4bc961f10bed047bcf11621d61a614929818ae1ac2a216e5046a399a4d4e70fd\": container with ID starting with 4bc961f10bed047bcf11621d61a614929818ae1ac2a216e5046a399a4d4e70fd not found: ID does not exist"
Sep 11 13:11:06.041771 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:06.041664    2547 scope.go:117] "RemoveContainer" containerID="53ba30d836facf6664661308daa1e41fc252d06c2b03cb9859de9eb71a8b53a7"
Sep 11 13:11:06.042761 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:11:06.042220    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53ba30d836facf6664661308daa1e41fc252d06c2b03cb9859de9eb71a8b53a7\": container with ID starting with 53ba30d836facf6664661308daa1e41fc252d06c2b03cb9859de9eb71a8b53a7 not found: ID does not exist" containerID="53ba30d836facf6664661308daa1e41fc252d06c2b03cb9859de9eb71a8b53a7"
Sep 11 13:11:06.042761 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:06.042252    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53ba30d836facf6664661308daa1e41fc252d06c2b03cb9859de9eb71a8b53a7"} err="failed to get container status \"53ba30d836facf6664661308daa1e41fc252d06c2b03cb9859de9eb71a8b53a7\": rpc error: code = NotFound desc = could not find container \"53ba30d836facf6664661308daa1e41fc252d06c2b03cb9859de9eb71a8b53a7\": container with ID starting with 53ba30d836facf6664661308daa1e41fc252d06c2b03cb9859de9eb71a8b53a7 not found: ID does not exist"
Sep 11 13:11:06.053926 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:06.053893    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"]
Sep 11 13:11:06.062607 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:06.062578    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-efc023-openshift-default-586b67554d-jxb5m"]
Sep 11 13:11:07.007733 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:07.007676    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" path="/var/lib/kubelet/pods/269008b9-49c9-4163-b666-1f75b18bb8b8/volumes"
Sep 11 13:11:12.589985 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:12.589950    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"]
Sep 11 13:11:12.590473 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:12.590389    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr" podUID="1e23ca80-e67a-40aa-be16-1b4fce92c3e8" containerName="payload-processing" containerID="cri-o://99eb04da98431fef2f230d8e0209b4b0065c2c4d7c1494a30ce9511ca0c70e42" gracePeriod=30
Sep 11 13:11:12.848455 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:12.848397    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"
Sep 11 13:11:12.951400 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:12.951363    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jjz88\" (UniqueName: \"kubernetes.io/projected/1e23ca80-e67a-40aa-be16-1b4fce92c3e8-kube-api-access-jjz88\") pod \"1e23ca80-e67a-40aa-be16-1b4fce92c3e8\" (UID: \"1e23ca80-e67a-40aa-be16-1b4fce92c3e8\") "
Sep 11 13:11:12.951586 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:12.951431    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e23ca80-e67a-40aa-be16-1b4fce92c3e8-plugins-config-volume\") pod \"1e23ca80-e67a-40aa-be16-1b4fce92c3e8\" (UID: \"1e23ca80-e67a-40aa-be16-1b4fce92c3e8\") "
Sep 11 13:11:12.951801 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:12.951779    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e23ca80-e67a-40aa-be16-1b4fce92c3e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e23ca80-e67a-40aa-be16-1b4fce92c3e8" (UID: "1e23ca80-e67a-40aa-be16-1b4fce92c3e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:11:12.953629 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:12.953603    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e23ca80-e67a-40aa-be16-1b4fce92c3e8-kube-api-access-jjz88" (OuterVolumeSpecName: "kube-api-access-jjz88") pod "1e23ca80-e67a-40aa-be16-1b4fce92c3e8" (UID: "1e23ca80-e67a-40aa-be16-1b4fce92c3e8"). InnerVolumeSpecName "kube-api-access-jjz88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:13.052097 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:13.052064    2547 generic.go:356] "Generic (PLEG): container finished" podID="1e23ca80-e67a-40aa-be16-1b4fce92c3e8" containerID="99eb04da98431fef2f230d8e0209b4b0065c2c4d7c1494a30ce9511ca0c70e42" exitCode=0
Sep 11 13:11:13.052258 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:13.052112    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr" event={"ID":"1e23ca80-e67a-40aa-be16-1b4fce92c3e8","Type":"ContainerDied","Data":"99eb04da98431fef2f230d8e0209b4b0065c2c4d7c1494a30ce9511ca0c70e42"}
Sep 11 13:11:13.052258 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:13.052115    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"
Sep 11 13:11:13.052258 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:13.052153    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr" event={"ID":"1e23ca80-e67a-40aa-be16-1b4fce92c3e8","Type":"ContainerDied","Data":"5a69e772b908ee565c40d41104199c680c7a3ec65f43c97ba014a3348e6ab794"}
Sep 11 13:11:13.052258 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:13.052174    2547 scope.go:117] "RemoveContainer" containerID="99eb04da98431fef2f230d8e0209b4b0065c2c4d7c1494a30ce9511ca0c70e42"
Sep 11 13:11:13.052258 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:13.052113    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjz88\" (UniqueName: \"kubernetes.io/projected/1e23ca80-e67a-40aa-be16-1b4fce92c3e8-kube-api-access-jjz88\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:13.052258 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:13.052225    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e23ca80-e67a-40aa-be16-1b4fce92c3e8-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:13.060491 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:13.060469    2547 scope.go:117] "RemoveContainer" containerID="99eb04da98431fef2f230d8e0209b4b0065c2c4d7c1494a30ce9511ca0c70e42"
Sep 11 13:11:13.060770 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:11:13.060751    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99eb04da98431fef2f230d8e0209b4b0065c2c4d7c1494a30ce9511ca0c70e42\": container with ID starting with 99eb04da98431fef2f230d8e0209b4b0065c2c4d7c1494a30ce9511ca0c70e42 not found: ID does not exist" containerID="99eb04da98431fef2f230d8e0209b4b0065c2c4d7c1494a30ce9511ca0c70e42"
Sep 11 13:11:13.060866 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:13.060776    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99eb04da98431fef2f230d8e0209b4b0065c2c4d7c1494a30ce9511ca0c70e42"} err="failed to get container status \"99eb04da98431fef2f230d8e0209b4b0065c2c4d7c1494a30ce9511ca0c70e42\": rpc error: code = NotFound desc = could not find container \"99eb04da98431fef2f230d8e0209b4b0065c2c4d7c1494a30ce9511ca0c70e42\": container with ID starting with 99eb04da98431fef2f230d8e0209b4b0065c2c4d7c1494a30ce9511ca0c70e42 not found: ID does not exist"
Sep 11 13:11:13.076464 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:13.076434    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"]
Sep 11 13:11:13.082594 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:13.082569    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a30ab725-6cbd9b4577-vw2cr"]
Sep 11 13:11:13.956957 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:13.956916    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:11:15.007390 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:15.007336    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e23ca80-e67a-40aa-be16-1b4fce92c3e8" path="/var/lib/kubelet/pods/1e23ca80-e67a-40aa-be16-1b4fce92c3e8/volumes"
Sep 11 13:11:25.114921 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:25.114883    2547 generic.go:356] "Generic (PLEG): container finished" podID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerID="5d887c87e08027f20beb800c0c9b34d0b2240a79701959c7b4e582e56f785e80" exitCode=0
Sep 11 13:11:25.115348 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:25.114935    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" event={"ID":"9d67690b-0191-41b2-bb5d-a57addecc6a9","Type":"ContainerDied","Data":"5d887c87e08027f20beb800c0c9b34d0b2240a79701959c7b4e582e56f785e80"}
Sep 11 13:11:25.115348 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:25.115314    2547 scope.go:117] "RemoveContainer" containerID="5d887c87e08027f20beb800c0c9b34d0b2240a79701959c7b4e582e56f785e80"
Sep 11 13:11:25.116401 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:25.116370    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:11:25.116504 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:25.116437    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:11:25.116504 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:25.116467    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:11:26.121601 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:26.121565    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" event={"ID":"9d67690b-0191-41b2-bb5d-a57addecc6a9","Type":"ContainerStarted","Data":"675f5331cb615a6aac2741db3cdb1b6f9a8ce203ff46116a8a30add7b3ec6a58"}
Sep 11 13:11:26.623935 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:26.623897    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:26.624251 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:26.624231    2547 patch_prober.go:28] interesting pod/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 11 13:11:26.624320 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:26.624274    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 11 13:11:27.619042 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.619007    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"]
Sep 11 13:11:27.619412 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.619376    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy"
Sep 11 13:11:27.619412 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.619389    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy"
Sep 11 13:11:27.619484 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.619416    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e23ca80-e67a-40aa-be16-1b4fce92c3e8" containerName="payload-processing"
Sep 11 13:11:27.619484 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.619425    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e23ca80-e67a-40aa-be16-1b4fce92c3e8" containerName="payload-processing"
Sep 11 13:11:27.619484 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.619480    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy"
Sep 11 13:11:27.619577 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.619488    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy"
Sep 11 13:11:27.619577 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.619499    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e23ca80-e67a-40aa-be16-1b4fce92c3e8" containerName="payload-processing"
Sep 11 13:11:27.622417 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.622399    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.624895 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.624868    2547 patch_prober.go:28] interesting pod/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 11 13:11:27.625009 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.624932    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 11 13:11:27.626621 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.626603    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-ecc2b9\"/\"explicit-model-ecc2b9-kserve-self-signed-certs\""
Sep 11 13:11:27.627368 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.627350    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-ecc2b9\"/\"default-dockercfg-w8gd5\""
Sep 11 13:11:27.628188 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.628169    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-ecc2b9\"/\"openshift-service-ca.crt\""
Sep 11 13:11:27.628292 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.628216    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-ecc2b9\"/\"kube-root-ca.crt\""
Sep 11 13:11:27.656784 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.656747    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"]
Sep 11 13:11:27.678443 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.678407    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-tmp-dir\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.678443 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.678446    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lgdf\" (UniqueName: \"kubernetes.io/projected/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-kube-api-access-9lgdf\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.678688 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.678470    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-dshm\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.678688 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.678493    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-model-cache\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.678688 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.678616    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-home\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.678688 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.678656    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-tls-certs\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.779654 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.779617    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-tmp-dir\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.780318 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.780295    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lgdf\" (UniqueName: \"kubernetes.io/projected/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-kube-api-access-9lgdf\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.780853 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.780832    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-dshm\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.781350 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.781331    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-model-cache\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.781608 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.781592    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-home\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.781739 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.781705    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-tls-certs\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.782179 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.782157    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-home\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.782339 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.781956    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-model-cache\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.782437 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.780240    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-tmp-dir\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.786749 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.786672    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-dshm\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.788545 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.788517    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-tls-certs\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.793305 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.793278    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lgdf\" (UniqueName: \"kubernetes.io/projected/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-kube-api-access-9lgdf\") pod \"explicit-model-ecc2b9-kserve-9fddf569-zpg7d\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") " pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:27.931094 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:27.931003    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:28.230490 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:28.230459    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"]
Sep 11 13:11:28.232299 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:11:28.232272    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf0cdacd_f466_4ce7_b89e_89b6091cd2f1.slice/crio-f22950cf7cbedc76f200f72091dfd0f6da6ead67b6c3a6a726a32a52fc1ac371 WatchSource:0}: Error finding container f22950cf7cbedc76f200f72091dfd0f6da6ead67b6c3a6a726a32a52fc1ac371: Status 404 returned error can't find the container with id f22950cf7cbedc76f200f72091dfd0f6da6ead67b6c3a6a726a32a52fc1ac371
Sep 11 13:11:28.624303 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:28.624263    2547 patch_prober.go:28] interesting pod/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 11 13:11:28.624744 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:28.624320    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 11 13:11:29.137899 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:29.137865    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d" event={"ID":"df0cdacd-f466-4ce7-b89e-89b6091cd2f1","Type":"ContainerStarted","Data":"b67175e9c89ff4a57aa5c3d032f4d1629a4b60fc6855cc39e4a9b3a27e313e77"}
Sep 11 13:11:29.138121 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:29.137917    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d" event={"ID":"df0cdacd-f466-4ce7-b89e-89b6091cd2f1","Type":"ContainerStarted","Data":"f22950cf7cbedc76f200f72091dfd0f6da6ead67b6c3a6a726a32a52fc1ac371"}
Sep 11 13:11:29.625058 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:29.625020    2547 patch_prober.go:28] interesting pod/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 11 13:11:29.625478 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:29.625080    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 11 13:11:29.738389 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:29.738333    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d" podStartSLOduration=2.738315064 podStartE2EDuration="2.738315064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:11:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:11:29.160542003 +0000 UTC m=+958.664406397" watchObservedRunningTime="2026-09-11 13:11:29.738315064 +0000 UTC m=+959.242179465"
Sep 11 13:11:29.739769 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:29.739745    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:11:30.624039 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:30.624001    2547 patch_prober.go:28] interesting pod/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 11 13:11:30.624231 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:30.624061    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 11 13:11:31.624576 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:31.624537    2547 patch_prober.go:28] interesting pod/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused" start-of-body=
Sep 11 13:11:31.625007 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:31.624611    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.42:15021/healthz/ready\": dial tcp 10.132.0.42:15021: connect: connection refused"
Sep 11 13:11:32.628836 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:32.628803    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:32.629205 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:32.629087    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:32.629730 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:32.629704    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:11:35.006847 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:35.006818    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"]
Sep 11 13:11:37.931808 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:37.931771    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:50.025802 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.025744    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d" podUID="df0cdacd-f466-4ce7-b89e-89b6091cd2f1" containerName="main" containerID="cri-o://b67175e9c89ff4a57aa5c3d032f4d1629a4b60fc6855cc39e4a9b3a27e313e77" gracePeriod=45
Sep 11 13:11:50.244222 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.244189    2547 generic.go:356] "Generic (PLEG): container finished" podID="df0cdacd-f466-4ce7-b89e-89b6091cd2f1" containerID="b67175e9c89ff4a57aa5c3d032f4d1629a4b60fc6855cc39e4a9b3a27e313e77" exitCode=0
Sep 11 13:11:50.244389 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.244271    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d" event={"ID":"df0cdacd-f466-4ce7-b89e-89b6091cd2f1","Type":"ContainerDied","Data":"b67175e9c89ff4a57aa5c3d032f4d1629a4b60fc6855cc39e4a9b3a27e313e77"}
Sep 11 13:11:50.279358 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.279299    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:50.394867 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.394835    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-tmp-dir\") pod \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") "
Sep 11 13:11:50.394867 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.394874    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-model-cache\") pod \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") "
Sep 11 13:11:50.395138 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.394903    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-home\") pod \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") "
Sep 11 13:11:50.395138 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.394939    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lgdf\" (UniqueName: \"kubernetes.io/projected/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-kube-api-access-9lgdf\") pod \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") "
Sep 11 13:11:50.395138 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.394954    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-dshm\") pod \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") "
Sep 11 13:11:50.395138 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.394974    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-tls-certs\") pod \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\" (UID: \"df0cdacd-f466-4ce7-b89e-89b6091cd2f1\") "
Sep 11 13:11:50.395351 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.395147    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "df0cdacd-f466-4ce7-b89e-89b6091cd2f1" (UID: "df0cdacd-f466-4ce7-b89e-89b6091cd2f1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:50.395351 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.395179    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-model-cache" (OuterVolumeSpecName: "model-cache") pod "df0cdacd-f466-4ce7-b89e-89b6091cd2f1" (UID: "df0cdacd-f466-4ce7-b89e-89b6091cd2f1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:50.395351 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.395289    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-home" (OuterVolumeSpecName: "home") pod "df0cdacd-f466-4ce7-b89e-89b6091cd2f1" (UID: "df0cdacd-f466-4ce7-b89e-89b6091cd2f1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:50.395480 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.395357    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-tmp-dir\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:50.395480 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.395378    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-model-cache\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:50.397248 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.397227    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-kube-api-access-9lgdf" (OuterVolumeSpecName: "kube-api-access-9lgdf") pod "df0cdacd-f466-4ce7-b89e-89b6091cd2f1" (UID: "df0cdacd-f466-4ce7-b89e-89b6091cd2f1"). InnerVolumeSpecName "kube-api-access-9lgdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:11:50.397248 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.397232    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-dshm" (OuterVolumeSpecName: "dshm") pod "df0cdacd-f466-4ce7-b89e-89b6091cd2f1" (UID: "df0cdacd-f466-4ce7-b89e-89b6091cd2f1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:11:50.397368 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.397276    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "df0cdacd-f466-4ce7-b89e-89b6091cd2f1" (UID: "df0cdacd-f466-4ce7-b89e-89b6091cd2f1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:11:50.496686 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.496650    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lgdf\" (UniqueName: \"kubernetes.io/projected/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-kube-api-access-9lgdf\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:50.496686 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.496680    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-dshm\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:50.496686 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.496690    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-tls-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:50.496686 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:50.496699    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/df0cdacd-f466-4ce7-b89e-89b6091cd2f1-home\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:11:51.236190 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:51.236159    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:11:51.251131 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:51.251098    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d" event={"ID":"df0cdacd-f466-4ce7-b89e-89b6091cd2f1","Type":"ContainerDied","Data":"f22950cf7cbedc76f200f72091dfd0f6da6ead67b6c3a6a726a32a52fc1ac371"}
Sep 11 13:11:51.251312 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:51.251108    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"
Sep 11 13:11:51.251312 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:51.251144    2547 scope.go:117] "RemoveContainer" containerID="b67175e9c89ff4a57aa5c3d032f4d1629a4b60fc6855cc39e4a9b3a27e313e77"
Sep 11 13:11:51.271751 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:51.271697    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"]
Sep 11 13:11:51.277175 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:51.277143    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-ecc2b9/explicit-model-ecc2b9-kserve-9fddf569-zpg7d"]
Sep 11 13:11:53.007454 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:53.007411    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df0cdacd-f466-4ce7-b89e-89b6091cd2f1" path="/var/lib/kubelet/pods/df0cdacd-f466-4ce7-b89e-89b6091cd2f1/volumes"
Sep 11 13:11:55.940073 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:55.940034    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"]
Sep 11 13:11:55.940554 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:55.940298    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerName="istio-proxy" containerID="cri-o://675f5331cb615a6aac2741db3cdb1b6f9a8ce203ff46116a8a30add7b3ec6a58" gracePeriod=30
Sep 11 13:11:56.709008 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.708970    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"]
Sep 11 13:11:56.709326 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.709313    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy"
Sep 11 13:11:56.709376 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.709326    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="269008b9-49c9-4163-b666-1f75b18bb8b8" containerName="istio-proxy"
Sep 11 13:11:56.709376 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.709342    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df0cdacd-f466-4ce7-b89e-89b6091cd2f1" containerName="main"
Sep 11 13:11:56.709376 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.709348    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="df0cdacd-f466-4ce7-b89e-89b6091cd2f1" containerName="main"
Sep 11 13:11:56.709478 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.709407    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="df0cdacd-f466-4ce7-b89e-89b6091cd2f1" containerName="main"
Sep 11 13:11:56.713356 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.713339    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.716061 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.716035    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-4e381b-openshift-default-dockercfg-x8tvs\""
Sep 11 13:11:56.736011 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.735983    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"]
Sep 11 13:11:56.859935 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.859889    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-credential-socket\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.860117 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.859949    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-workload-certs\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.860117 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.860050    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-data\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.860117 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.860084    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsbkg\" (UniqueName: \"kubernetes.io/projected/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-kube-api-access-lsbkg\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.860242 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.860126    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istiod-ca-cert\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.860242 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.860147    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-envoy\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.860242 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.860202    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-token\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.860242 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.860233    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-podinfo\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.860436 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.860283    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-workload-socket\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.961125 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.961033    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-token\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.961125 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.961074    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-podinfo\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.961125 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.961102    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-workload-socket\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.961669 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.961140    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-credential-socket\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.961669 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.961171    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-workload-certs\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.961669 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.961201    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-data\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.961669 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.961218    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsbkg\" (UniqueName: \"kubernetes.io/projected/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-kube-api-access-lsbkg\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.961669 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.961256    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istiod-ca-cert\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.961669 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.961285    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-envoy\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.961669 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.961647    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-credential-socket\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.962006 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.961752    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-data\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.962006 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.961819    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-workload-certs\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.962006 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.961873    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-workload-socket\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.962107 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.962054    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istiod-ca-cert\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.963484 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.963462    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-envoy\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.963677 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.963655    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-podinfo\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.972421 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.972390    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsbkg\" (UniqueName: \"kubernetes.io/projected/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-kube-api-access-lsbkg\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:56.972533 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:56.972420    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-token\") pod \"e2e-noten-4e381b-openshift-default-696b967b7d-dggnb\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") " pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:57.023637 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:57.023605    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:57.312597 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:57.312573    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"]
Sep 11 13:11:57.315044 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:11:57.315013    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ea4cd71_bfd2_4539_b7f6_3aed43368e0f.slice/crio-4fb6ef10ef51c8dee391e61b2263eafcaf5807a3f7edefd95c44ec5b3761b398 WatchSource:0}: Error finding container 4fb6ef10ef51c8dee391e61b2263eafcaf5807a3f7edefd95c44ec5b3761b398: Status 404 returned error can't find the container with id 4fb6ef10ef51c8dee391e61b2263eafcaf5807a3f7edefd95c44ec5b3761b398
Sep 11 13:11:57.317176 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:57.317145    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:11:57.317270 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:57.317210    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:11:57.317270 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:57.317236    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:11:58.293530 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:58.293492    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb" event={"ID":"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f","Type":"ContainerStarted","Data":"732f0370b53ada938fa48f5e0de8b20e05da2557729cb846caeacd9994927445"}
Sep 11 13:11:58.293940 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:58.293550    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb" event={"ID":"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f","Type":"ContainerStarted","Data":"4fb6ef10ef51c8dee391e61b2263eafcaf5807a3f7edefd95c44ec5b3761b398"}
Sep 11 13:11:59.024422 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:59.024388    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:59.029468 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:59.029442    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:59.078833 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:59.078782    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb" podStartSLOduration=3.078760122 podStartE2EDuration="3.078760122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:11:58.351158179 +0000 UTC m=+987.855022574" watchObservedRunningTime="2026-09-11 13:11:59.078760122 +0000 UTC m=+988.582624505"
Sep 11 13:11:59.298830 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:59.298748    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:11:59.299820 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:11:59.299800    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:12:01.197550 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.197527    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:12:01.304417 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.304379    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-envoy\") pod \"9d67690b-0191-41b2-bb5d-a57addecc6a9\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") "
Sep 11 13:12:01.304628 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.304424    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-podinfo\") pod \"9d67690b-0191-41b2-bb5d-a57addecc6a9\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") "
Sep 11 13:12:01.304628 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.304458    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d67690b-0191-41b2-bb5d-a57addecc6a9-istiod-ca-cert\") pod \"9d67690b-0191-41b2-bb5d-a57addecc6a9\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") "
Sep 11 13:12:01.304628 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.304507    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-data\") pod \"9d67690b-0191-41b2-bb5d-a57addecc6a9\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") "
Sep 11 13:12:01.304628 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.304540    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-token\") pod \"9d67690b-0191-41b2-bb5d-a57addecc6a9\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") "
Sep 11 13:12:01.304628 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.304594    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8pqp\" (UniqueName: \"kubernetes.io/projected/9d67690b-0191-41b2-bb5d-a57addecc6a9-kube-api-access-m8pqp\") pod \"9d67690b-0191-41b2-bb5d-a57addecc6a9\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") "
Sep 11 13:12:01.304628 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.304620    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-workload-socket\") pod \"9d67690b-0191-41b2-bb5d-a57addecc6a9\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") "
Sep 11 13:12:01.304996 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.304659    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-credential-socket\") pod \"9d67690b-0191-41b2-bb5d-a57addecc6a9\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") "
Sep 11 13:12:01.304996 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.304687    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-workload-certs\") pod \"9d67690b-0191-41b2-bb5d-a57addecc6a9\" (UID: \"9d67690b-0191-41b2-bb5d-a57addecc6a9\") "
Sep 11 13:12:01.305242 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.305215    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d67690b-0191-41b2-bb5d-a57addecc6a9" (UID: "9d67690b-0191-41b2-bb5d-a57addecc6a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:01.305499 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.305472    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d67690b-0191-41b2-bb5d-a57addecc6a9" (UID: "9d67690b-0191-41b2-bb5d-a57addecc6a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:01.305590 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.305516    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d67690b-0191-41b2-bb5d-a57addecc6a9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d67690b-0191-41b2-bb5d-a57addecc6a9" (UID: "9d67690b-0191-41b2-bb5d-a57addecc6a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:12:01.305866 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.305815    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d67690b-0191-41b2-bb5d-a57addecc6a9" (UID: "9d67690b-0191-41b2-bb5d-a57addecc6a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:01.305866 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.305845    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d67690b-0191-41b2-bb5d-a57addecc6a9" (UID: "9d67690b-0191-41b2-bb5d-a57addecc6a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:01.306851 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.306826    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d67690b-0191-41b2-bb5d-a57addecc6a9" (UID: "9d67690b-0191-41b2-bb5d-a57addecc6a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:01.306965 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.306859    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d67690b-0191-41b2-bb5d-a57addecc6a9" (UID: "9d67690b-0191-41b2-bb5d-a57addecc6a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:12:01.307789 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.307759    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d67690b-0191-41b2-bb5d-a57addecc6a9" (UID: "9d67690b-0191-41b2-bb5d-a57addecc6a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:01.307918 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.307894    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d67690b-0191-41b2-bb5d-a57addecc6a9-kube-api-access-m8pqp" (OuterVolumeSpecName: "kube-api-access-m8pqp") pod "9d67690b-0191-41b2-bb5d-a57addecc6a9" (UID: "9d67690b-0191-41b2-bb5d-a57addecc6a9"). InnerVolumeSpecName "kube-api-access-m8pqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:01.311658 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.311631    2547 generic.go:356] "Generic (PLEG): container finished" podID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerID="675f5331cb615a6aac2741db3cdb1b6f9a8ce203ff46116a8a30add7b3ec6a58" exitCode=0
Sep 11 13:12:01.311865 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.311678    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"
Sep 11 13:12:01.311865 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.311733    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" event={"ID":"9d67690b-0191-41b2-bb5d-a57addecc6a9","Type":"ContainerDied","Data":"675f5331cb615a6aac2741db3cdb1b6f9a8ce203ff46116a8a30add7b3ec6a58"}
Sep 11 13:12:01.311865 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.311785    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288" event={"ID":"9d67690b-0191-41b2-bb5d-a57addecc6a9","Type":"ContainerDied","Data":"c619bd764276ccba112d37fbf89110c469433143c1eb3668cbceae01ba092b3a"}
Sep 11 13:12:01.311865 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.311809    2547 scope.go:117] "RemoveContainer" containerID="675f5331cb615a6aac2741db3cdb1b6f9a8ce203ff46116a8a30add7b3ec6a58"
Sep 11 13:12:01.326877 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.326858    2547 scope.go:117] "RemoveContainer" containerID="5d887c87e08027f20beb800c0c9b34d0b2240a79701959c7b4e582e56f785e80"
Sep 11 13:12:01.335229 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.335192    2547 scope.go:117] "RemoveContainer" containerID="675f5331cb615a6aac2741db3cdb1b6f9a8ce203ff46116a8a30add7b3ec6a58"
Sep 11 13:12:01.337096 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:12:01.337066    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"675f5331cb615a6aac2741db3cdb1b6f9a8ce203ff46116a8a30add7b3ec6a58\": container with ID starting with 675f5331cb615a6aac2741db3cdb1b6f9a8ce203ff46116a8a30add7b3ec6a58 not found: ID does not exist" containerID="675f5331cb615a6aac2741db3cdb1b6f9a8ce203ff46116a8a30add7b3ec6a58"
Sep 11 13:12:01.337203 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.337109    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675f5331cb615a6aac2741db3cdb1b6f9a8ce203ff46116a8a30add7b3ec6a58"} err="failed to get container status \"675f5331cb615a6aac2741db3cdb1b6f9a8ce203ff46116a8a30add7b3ec6a58\": rpc error: code = NotFound desc = could not find container \"675f5331cb615a6aac2741db3cdb1b6f9a8ce203ff46116a8a30add7b3ec6a58\": container with ID starting with 675f5331cb615a6aac2741db3cdb1b6f9a8ce203ff46116a8a30add7b3ec6a58 not found: ID does not exist"
Sep 11 13:12:01.337203 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.337137    2547 scope.go:117] "RemoveContainer" containerID="5d887c87e08027f20beb800c0c9b34d0b2240a79701959c7b4e582e56f785e80"
Sep 11 13:12:01.337440 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:12:01.337410    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d887c87e08027f20beb800c0c9b34d0b2240a79701959c7b4e582e56f785e80\": container with ID starting with 5d887c87e08027f20beb800c0c9b34d0b2240a79701959c7b4e582e56f785e80 not found: ID does not exist" containerID="5d887c87e08027f20beb800c0c9b34d0b2240a79701959c7b4e582e56f785e80"
Sep 11 13:12:01.337534 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.337449    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d887c87e08027f20beb800c0c9b34d0b2240a79701959c7b4e582e56f785e80"} err="failed to get container status \"5d887c87e08027f20beb800c0c9b34d0b2240a79701959c7b4e582e56f785e80\": rpc error: code = NotFound desc = could not find container \"5d887c87e08027f20beb800c0c9b34d0b2240a79701959c7b4e582e56f785e80\": container with ID starting with 5d887c87e08027f20beb800c0c9b34d0b2240a79701959c7b4e582e56f785e80 not found: ID does not exist"
Sep 11 13:12:01.348535 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.348509    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"]
Sep 11 13:12:01.359273 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.359231    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-ecc2b9-openshift-default-66b78f6bc6-xh288"]
Sep 11 13:12:01.406404 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.406236    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:01.406404 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.406273    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:01.406404 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.406288    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8pqp\" (UniqueName: \"kubernetes.io/projected/9d67690b-0191-41b2-bb5d-a57addecc6a9-kube-api-access-m8pqp\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:01.406404 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.406305    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:01.406404 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.406322    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:01.406404 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.406336    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:01.406404 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.406349    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:01.406404 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.406362    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d67690b-0191-41b2-bb5d-a57addecc6a9-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:01.406404 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:01.406375    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d67690b-0191-41b2-bb5d-a57addecc6a9-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:03.007912 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:03.007872    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" path="/var/lib/kubelet/pods/9d67690b-0191-41b2-bb5d-a57addecc6a9/volumes"
Sep 11 13:12:07.581346 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:07.581311    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:12:17.665176 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:17.665141    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"]
Sep 11 13:12:17.665657 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:17.665339    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb" podUID="0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" containerName="istio-proxy" containerID="cri-o://732f0370b53ada938fa48f5e0de8b20e05da2557729cb846caeacd9994927445" gracePeriod=30
Sep 11 13:12:22.916225 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:22.916197    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:12:23.005430 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005329    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-workload-socket\") pod \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") "
Sep 11 13:12:23.005430 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005370    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-envoy\") pod \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") "
Sep 11 13:12:23.005430 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005405    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istiod-ca-cert\") pod \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") "
Sep 11 13:12:23.005739 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005453    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-token\") pod \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") "
Sep 11 13:12:23.005739 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005475    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-podinfo\") pod \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") "
Sep 11 13:12:23.005739 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005499    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-credential-socket\") pod \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") "
Sep 11 13:12:23.005739 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005556    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-data\") pod \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") "
Sep 11 13:12:23.005739 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005579    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-workload-certs\") pod \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") "
Sep 11 13:12:23.005739 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005624    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsbkg\" (UniqueName: \"kubernetes.io/projected/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-kube-api-access-lsbkg\") pod \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\" (UID: \"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f\") "
Sep 11 13:12:23.005739 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005653    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" (UID: "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:23.006098 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005897    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" (UID: "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:23.006098 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005952    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" (UID: "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:12:23.006098 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005981    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:23.006098 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.005999    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:23.006364 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.006207    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" (UID: "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:23.006429 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.006379    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" (UID: "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:23.008572 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.008544    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" (UID: "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:23.008885 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.008862    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" (UID: "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:12:23.009057 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.009034    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-kube-api-access-lsbkg" (OuterVolumeSpecName: "kube-api-access-lsbkg") pod "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" (UID: "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f"). InnerVolumeSpecName "kube-api-access-lsbkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:23.009179 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.009159    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" (UID: "0ea4cd71-bfd2-4539-b7f6-3aed43368e0f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:23.106940 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.106905    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:23.106940 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.106936    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:23.107157 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.106953    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsbkg\" (UniqueName: \"kubernetes.io/projected/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-kube-api-access-lsbkg\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:23.107157 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.106964    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:23.107157 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.106972    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:23.107157 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.106980    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:23.107157 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.106987    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:23.420856 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.420822    2547 generic.go:356] "Generic (PLEG): container finished" podID="0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" containerID="732f0370b53ada938fa48f5e0de8b20e05da2557729cb846caeacd9994927445" exitCode=0
Sep 11 13:12:23.421035 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.420867    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"
Sep 11 13:12:23.421035 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.420905    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb" event={"ID":"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f","Type":"ContainerDied","Data":"732f0370b53ada938fa48f5e0de8b20e05da2557729cb846caeacd9994927445"}
Sep 11 13:12:23.421035 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.420959    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb" event={"ID":"0ea4cd71-bfd2-4539-b7f6-3aed43368e0f","Type":"ContainerDied","Data":"4fb6ef10ef51c8dee391e61b2263eafcaf5807a3f7edefd95c44ec5b3761b398"}
Sep 11 13:12:23.421035 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.420981    2547 scope.go:117] "RemoveContainer" containerID="732f0370b53ada938fa48f5e0de8b20e05da2557729cb846caeacd9994927445"
Sep 11 13:12:23.430266 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.430246    2547 scope.go:117] "RemoveContainer" containerID="732f0370b53ada938fa48f5e0de8b20e05da2557729cb846caeacd9994927445"
Sep 11 13:12:23.430554 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:12:23.430535    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"732f0370b53ada938fa48f5e0de8b20e05da2557729cb846caeacd9994927445\": container with ID starting with 732f0370b53ada938fa48f5e0de8b20e05da2557729cb846caeacd9994927445 not found: ID does not exist" containerID="732f0370b53ada938fa48f5e0de8b20e05da2557729cb846caeacd9994927445"
Sep 11 13:12:23.430627 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.430563    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"732f0370b53ada938fa48f5e0de8b20e05da2557729cb846caeacd9994927445"} err="failed to get container status \"732f0370b53ada938fa48f5e0de8b20e05da2557729cb846caeacd9994927445\": rpc error: code = NotFound desc = could not find container \"732f0370b53ada938fa48f5e0de8b20e05da2557729cb846caeacd9994927445\": container with ID starting with 732f0370b53ada938fa48f5e0de8b20e05da2557729cb846caeacd9994927445 not found: ID does not exist"
Sep 11 13:12:23.443164 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.443129    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"]
Sep 11 13:12:23.450441 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:23.450409    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-4e381b-openshift-default-696b967b7d-dggnb"]
Sep 11 13:12:25.007098 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:25.007063    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" path="/var/lib/kubelet/pods/0ea4cd71-bfd2-4539-b7f6-3aed43368e0f/volumes"
Sep 11 13:12:32.264455 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:32.264414    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"]
Sep 11 13:12:33.438790 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.438749    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn"]
Sep 11 13:12:33.439287 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.439241    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" containerName="istio-proxy"
Sep 11 13:12:33.439287 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.439259    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" containerName="istio-proxy"
Sep 11 13:12:33.439287 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.439285    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerName="istio-proxy"
Sep 11 13:12:33.439462 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.439294    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerName="istio-proxy"
Sep 11 13:12:33.439462 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.439306    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerName="istio-proxy"
Sep 11 13:12:33.439462 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.439315    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerName="istio-proxy"
Sep 11 13:12:33.439462 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.439403    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerName="istio-proxy"
Sep 11 13:12:33.439462 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.439415    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ea4cd71-bfd2-4539-b7f6-3aed43368e0f" containerName="istio-proxy"
Sep 11 13:12:33.444009 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.443984    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn"
Sep 11 13:12:33.447574 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.447544    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:12:33.447708 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.447633    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:12:33.450664 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.450637    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn"]
Sep 11 13:12:33.604270 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.604218    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/792821ed-469e-4ac9-aafe-1a9e59e4abea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn\" (UID: \"792821ed-469e-4ac9-aafe-1a9e59e4abea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn"
Sep 11 13:12:33.705789 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.705663    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/792821ed-469e-4ac9-aafe-1a9e59e4abea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn\" (UID: \"792821ed-469e-4ac9-aafe-1a9e59e4abea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn"
Sep 11 13:12:33.706309 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.706287    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/792821ed-469e-4ac9-aafe-1a9e59e4abea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn\" (UID: \"792821ed-469e-4ac9-aafe-1a9e59e4abea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn"
Sep 11 13:12:33.755842 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:33.755801    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn"
Sep 11 13:12:34.041137 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:34.041106    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn"]
Sep 11 13:12:34.042855 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:12:34.042827    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod792821ed_469e_4ac9_aafe_1a9e59e4abea.slice/crio-a774417ceef9dc6c69d7b4e3b5b21be8a77c1ab04f44d2762b03f79a4b0c59b2 WatchSource:0}: Error finding container a774417ceef9dc6c69d7b4e3b5b21be8a77c1ab04f44d2762b03f79a4b0c59b2: Status 404 returned error can't find the container with id a774417ceef9dc6c69d7b4e3b5b21be8a77c1ab04f44d2762b03f79a4b0c59b2
Sep 11 13:12:34.478038 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:34.478001    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn" event={"ID":"792821ed-469e-4ac9-aafe-1a9e59e4abea","Type":"ContainerStarted","Data":"473d9b6b746e164a96cf0cbb31b215c23b44a9ba257ebdc0ee4b6420cf78bfcc"}
Sep 11 13:12:34.478431 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:34.478053    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn" event={"ID":"792821ed-469e-4ac9-aafe-1a9e59e4abea","Type":"ContainerStarted","Data":"a774417ceef9dc6c69d7b4e3b5b21be8a77c1ab04f44d2762b03f79a4b0c59b2"}
Sep 11 13:12:34.512887 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:34.512832    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn" podStartSLOduration=1.512817054 podStartE2EDuration="1.512817054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:12:34.51132792 +0000 UTC m=+1024.015192313" watchObservedRunningTime="2026-09-11 13:12:34.512817054 +0000 UTC m=+1024.016681446"
Sep 11 13:12:35.485160 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:35.485123    2547 generic.go:356] "Generic (PLEG): container finished" podID="792821ed-469e-4ac9-aafe-1a9e59e4abea" containerID="473d9b6b746e164a96cf0cbb31b215c23b44a9ba257ebdc0ee4b6420cf78bfcc" exitCode=0
Sep 11 13:12:35.485544 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:35.485205    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn" event={"ID":"792821ed-469e-4ac9-aafe-1a9e59e4abea","Type":"ContainerDied","Data":"473d9b6b746e164a96cf0cbb31b215c23b44a9ba257ebdc0ee4b6420cf78bfcc"}
Sep 11 13:12:36.351658 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:36.351617    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:12:36.616084 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:36.616056    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn"
Sep 11 13:12:36.732131 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:36.732091    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/792821ed-469e-4ac9-aafe-1a9e59e4abea-maas-api-service-ca\") pod \"792821ed-469e-4ac9-aafe-1a9e59e4abea\" (UID: \"792821ed-469e-4ac9-aafe-1a9e59e4abea\") "
Sep 11 13:12:36.732533 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:36.732505    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/792821ed-469e-4ac9-aafe-1a9e59e4abea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "792821ed-469e-4ac9-aafe-1a9e59e4abea" (UID: "792821ed-469e-4ac9-aafe-1a9e59e4abea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:12:36.833137 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:36.833093    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/792821ed-469e-4ac9-aafe-1a9e59e4abea-maas-api-service-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:37.496501 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:37.496470    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn"
Sep 11 13:12:37.496501 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:37.496487    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn" event={"ID":"792821ed-469e-4ac9-aafe-1a9e59e4abea","Type":"ContainerDied","Data":"a774417ceef9dc6c69d7b4e3b5b21be8a77c1ab04f44d2762b03f79a4b0c59b2"}
Sep 11 13:12:37.496754 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:37.496541    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a774417ceef9dc6c69d7b4e3b5b21be8a77c1ab04f44d2762b03f79a4b0c59b2"
Sep 11 13:12:44.608880 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:44.608844    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"]
Sep 11 13:12:44.609358 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:44.609109    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5" podUID="c0d59ba9-257e-4488-85dc-5c5b2bfce8d2" containerName="payload-pre-processing" containerID="cri-o://72d261cf7077a32415afa2d3313fb6fd696ca1d50cd8ad8c4f83f62660a0e198" gracePeriod=30
Sep 11 13:12:44.867809 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:44.867745    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"
Sep 11 13:12:45.012303 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.012268    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0d59ba9-257e-4488-85dc-5c5b2bfce8d2-plugins-config-volume\") pod \"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2\" (UID: \"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2\") "
Sep 11 13:12:45.012451 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.012339    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss4ch\" (UniqueName: \"kubernetes.io/projected/c0d59ba9-257e-4488-85dc-5c5b2bfce8d2-kube-api-access-ss4ch\") pod \"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2\" (UID: \"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2\") "
Sep 11 13:12:45.012739 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.012692    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0d59ba9-257e-4488-85dc-5c5b2bfce8d2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c0d59ba9-257e-4488-85dc-5c5b2bfce8d2" (UID: "c0d59ba9-257e-4488-85dc-5c5b2bfce8d2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:12:45.014603 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.014570    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0d59ba9-257e-4488-85dc-5c5b2bfce8d2-kube-api-access-ss4ch" (OuterVolumeSpecName: "kube-api-access-ss4ch") pod "c0d59ba9-257e-4488-85dc-5c5b2bfce8d2" (UID: "c0d59ba9-257e-4488-85dc-5c5b2bfce8d2"). InnerVolumeSpecName "kube-api-access-ss4ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:45.046515 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.046480    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn"]
Sep 11 13:12:45.048121 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.048094    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-528ff6-m57tn"]
Sep 11 13:12:45.113663 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.113622    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c0d59ba9-257e-4488-85dc-5c5b2bfce8d2-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:45.113663 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.113654    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss4ch\" (UniqueName: \"kubernetes.io/projected/c0d59ba9-257e-4488-85dc-5c5b2bfce8d2-kube-api-access-ss4ch\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:45.534025 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.533987    2547 generic.go:356] "Generic (PLEG): container finished" podID="c0d59ba9-257e-4488-85dc-5c5b2bfce8d2" containerID="72d261cf7077a32415afa2d3313fb6fd696ca1d50cd8ad8c4f83f62660a0e198" exitCode=0
Sep 11 13:12:45.534193 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.534033    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"
Sep 11 13:12:45.534193 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.534075    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5" event={"ID":"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2","Type":"ContainerDied","Data":"72d261cf7077a32415afa2d3313fb6fd696ca1d50cd8ad8c4f83f62660a0e198"}
Sep 11 13:12:45.534193 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.534122    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5" event={"ID":"c0d59ba9-257e-4488-85dc-5c5b2bfce8d2","Type":"ContainerDied","Data":"3e99a5a44f535b6a57bf3d987457527f50315cf74193575996d82420bb7be220"}
Sep 11 13:12:45.534193 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.534144    2547 scope.go:117] "RemoveContainer" containerID="72d261cf7077a32415afa2d3313fb6fd696ca1d50cd8ad8c4f83f62660a0e198"
Sep 11 13:12:45.542966 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.542950    2547 scope.go:117] "RemoveContainer" containerID="72d261cf7077a32415afa2d3313fb6fd696ca1d50cd8ad8c4f83f62660a0e198"
Sep 11 13:12:45.543253 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:12:45.543235    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d261cf7077a32415afa2d3313fb6fd696ca1d50cd8ad8c4f83f62660a0e198\": container with ID starting with 72d261cf7077a32415afa2d3313fb6fd696ca1d50cd8ad8c4f83f62660a0e198 not found: ID does not exist" containerID="72d261cf7077a32415afa2d3313fb6fd696ca1d50cd8ad8c4f83f62660a0e198"
Sep 11 13:12:45.543303 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.543262    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d261cf7077a32415afa2d3313fb6fd696ca1d50cd8ad8c4f83f62660a0e198"} err="failed to get container status \"72d261cf7077a32415afa2d3313fb6fd696ca1d50cd8ad8c4f83f62660a0e198\": rpc error: code = NotFound desc = could not find container \"72d261cf7077a32415afa2d3313fb6fd696ca1d50cd8ad8c4f83f62660a0e198\": container with ID starting with 72d261cf7077a32415afa2d3313fb6fd696ca1d50cd8ad8c4f83f62660a0e198 not found: ID does not exist"
Sep 11 13:12:45.587487 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.587442    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"]
Sep 11 13:12:45.612323 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:45.612287    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-528ff6-78456df4fd-qmmh5"]
Sep 11 13:12:47.006209 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.006178    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="792821ed-469e-4ac9-aafe-1a9e59e4abea" path="/var/lib/kubelet/pods/792821ed-469e-4ac9-aafe-1a9e59e4abea/volumes"
Sep 11 13:12:47.006661 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.006533    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0d59ba9-257e-4488-85dc-5c5b2bfce8d2" path="/var/lib/kubelet/pods/c0d59ba9-257e-4488-85dc-5c5b2bfce8d2/volumes"
Sep 11 13:12:47.283251 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.283213    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc" podUID="817f01aa-7d39-451f-930e-c541dc600881" containerName="main" containerID="cri-o://2eefdf90982dfa2c2dba385713d53f0494248ea1b9b32f23caa10935234a8e8f" gracePeriod=45
Sep 11 13:12:47.537837 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.537778    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:12:47.547779 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.547748    2547 generic.go:356] "Generic (PLEG): container finished" podID="817f01aa-7d39-451f-930e-c541dc600881" containerID="2eefdf90982dfa2c2dba385713d53f0494248ea1b9b32f23caa10935234a8e8f" exitCode=0
Sep 11 13:12:47.547898 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.547792    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"
Sep 11 13:12:47.547898 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.547794    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc" event={"ID":"817f01aa-7d39-451f-930e-c541dc600881","Type":"ContainerDied","Data":"2eefdf90982dfa2c2dba385713d53f0494248ea1b9b32f23caa10935234a8e8f"}
Sep 11 13:12:47.547971 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.547910    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc" event={"ID":"817f01aa-7d39-451f-930e-c541dc600881","Type":"ContainerDied","Data":"4dbc4d55148902e724cde90b51f9fee744129ef6c857b2fcc1b4120f87378655"}
Sep 11 13:12:47.547971 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.547932    2547 scope.go:117] "RemoveContainer" containerID="2eefdf90982dfa2c2dba385713d53f0494248ea1b9b32f23caa10935234a8e8f"
Sep 11 13:12:47.557821 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.557795    2547 scope.go:117] "RemoveContainer" containerID="2eefdf90982dfa2c2dba385713d53f0494248ea1b9b32f23caa10935234a8e8f"
Sep 11 13:12:47.558172 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:12:47.558149    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2eefdf90982dfa2c2dba385713d53f0494248ea1b9b32f23caa10935234a8e8f\": container with ID starting with 2eefdf90982dfa2c2dba385713d53f0494248ea1b9b32f23caa10935234a8e8f not found: ID does not exist" containerID="2eefdf90982dfa2c2dba385713d53f0494248ea1b9b32f23caa10935234a8e8f"
Sep 11 13:12:47.558242 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.558181    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2eefdf90982dfa2c2dba385713d53f0494248ea1b9b32f23caa10935234a8e8f"} err="failed to get container status \"2eefdf90982dfa2c2dba385713d53f0494248ea1b9b32f23caa10935234a8e8f\": rpc error: code = NotFound desc = could not find container \"2eefdf90982dfa2c2dba385713d53f0494248ea1b9b32f23caa10935234a8e8f\": container with ID starting with 2eefdf90982dfa2c2dba385713d53f0494248ea1b9b32f23caa10935234a8e8f not found: ID does not exist"
Sep 11 13:12:47.635828 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.635794    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-dshm\") pod \"817f01aa-7d39-451f-930e-c541dc600881\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") "
Sep 11 13:12:47.636036 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.635839    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-model-cache\") pod \"817f01aa-7d39-451f-930e-c541dc600881\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") "
Sep 11 13:12:47.636036 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.635874    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/817f01aa-7d39-451f-930e-c541dc600881-tls-certs\") pod \"817f01aa-7d39-451f-930e-c541dc600881\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") "
Sep 11 13:12:47.636036 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.635897    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-tmp-dir\") pod \"817f01aa-7d39-451f-930e-c541dc600881\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") "
Sep 11 13:12:47.636036 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.635926    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-home\") pod \"817f01aa-7d39-451f-930e-c541dc600881\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") "
Sep 11 13:12:47.636036 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.636006    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v4kn\" (UniqueName: \"kubernetes.io/projected/817f01aa-7d39-451f-930e-c541dc600881-kube-api-access-7v4kn\") pod \"817f01aa-7d39-451f-930e-c541dc600881\" (UID: \"817f01aa-7d39-451f-930e-c541dc600881\") "
Sep 11 13:12:47.636291 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.636103    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-model-cache" (OuterVolumeSpecName: "model-cache") pod "817f01aa-7d39-451f-930e-c541dc600881" (UID: "817f01aa-7d39-451f-930e-c541dc600881"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:47.636291 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.636195    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "817f01aa-7d39-451f-930e-c541dc600881" (UID: "817f01aa-7d39-451f-930e-c541dc600881"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:47.636291 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.636258    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-home" (OuterVolumeSpecName: "home") pod "817f01aa-7d39-451f-930e-c541dc600881" (UID: "817f01aa-7d39-451f-930e-c541dc600881"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:47.636445 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.636343    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-model-cache\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:47.636445 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.636376    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-tmp-dir\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:47.636445 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.636385    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-home\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:47.638205 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.638181    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/817f01aa-7d39-451f-930e-c541dc600881-kube-api-access-7v4kn" (OuterVolumeSpecName: "kube-api-access-7v4kn") pod "817f01aa-7d39-451f-930e-c541dc600881" (UID: "817f01aa-7d39-451f-930e-c541dc600881"). InnerVolumeSpecName "kube-api-access-7v4kn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:47.638205 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.638195    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/817f01aa-7d39-451f-930e-c541dc600881-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "817f01aa-7d39-451f-930e-c541dc600881" (UID: "817f01aa-7d39-451f-930e-c541dc600881"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:12:47.638335 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.638186    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-dshm" (OuterVolumeSpecName: "dshm") pod "817f01aa-7d39-451f-930e-c541dc600881" (UID: "817f01aa-7d39-451f-930e-c541dc600881"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:47.737848 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.737807    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v4kn\" (UniqueName: \"kubernetes.io/projected/817f01aa-7d39-451f-930e-c541dc600881-kube-api-access-7v4kn\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:47.737848 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.737840    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/817f01aa-7d39-451f-930e-c541dc600881-dshm\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:47.737848 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.737850    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/817f01aa-7d39-451f-930e-c541dc600881-tls-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:47.882636 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.882604    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"]
Sep 11 13:12:47.885451 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:47.885425    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-528ff6/test-model-528ff6-kserve-d77469d59-kpsnc"]
Sep 11 13:12:48.467633 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:48.467592    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:12:49.006282 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:49.006246    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="817f01aa-7d39-451f-930e-c541dc600881" path="/var/lib/kubelet/pods/817f01aa-7d39-451f-930e-c541dc600881/volumes"
Sep 11 13:12:54.542746 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:54.542695    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"]
Sep 11 13:12:54.543264 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:54.542996    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy" containerID="cri-o://f510f5c25ab7c280150f9155d55e35f5f65df32688e3677c83400b92f5a25e31" gracePeriod=30
Sep 11 13:12:55.309338 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:55.309308    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:12:59.790675 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.790651    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:12:59.847613 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.847529    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkx6k\" (UniqueName: \"kubernetes.io/projected/90478a56-0c65-4f7d-9d39-95a7720e8622-kube-api-access-gkx6k\") pod \"90478a56-0c65-4f7d-9d39-95a7720e8622\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") "
Sep 11 13:12:59.847613 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.847585    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-workload-certs\") pod \"90478a56-0c65-4f7d-9d39-95a7720e8622\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") "
Sep 11 13:12:59.847851 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.847636    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90478a56-0c65-4f7d-9d39-95a7720e8622-istiod-ca-cert\") pod \"90478a56-0c65-4f7d-9d39-95a7720e8622\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") "
Sep 11 13:12:59.847851 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.847674    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-workload-socket\") pod \"90478a56-0c65-4f7d-9d39-95a7720e8622\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") "
Sep 11 13:12:59.847851 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.847740    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-data\") pod \"90478a56-0c65-4f7d-9d39-95a7720e8622\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") "
Sep 11 13:12:59.847851 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.847769    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-token\") pod \"90478a56-0c65-4f7d-9d39-95a7720e8622\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") "
Sep 11 13:12:59.847851 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.847810    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-envoy\") pod \"90478a56-0c65-4f7d-9d39-95a7720e8622\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") "
Sep 11 13:12:59.847851 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.847841    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-podinfo\") pod \"90478a56-0c65-4f7d-9d39-95a7720e8622\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") "
Sep 11 13:12:59.848167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.847886    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-credential-socket\") pod \"90478a56-0c65-4f7d-9d39-95a7720e8622\" (UID: \"90478a56-0c65-4f7d-9d39-95a7720e8622\") "
Sep 11 13:12:59.848167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.848021    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "90478a56-0c65-4f7d-9d39-95a7720e8622" (UID: "90478a56-0c65-4f7d-9d39-95a7720e8622"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:59.848167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.848031    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-data" (OuterVolumeSpecName: "istio-data") pod "90478a56-0c65-4f7d-9d39-95a7720e8622" (UID: "90478a56-0c65-4f7d-9d39-95a7720e8622"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:59.848167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.848094    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90478a56-0c65-4f7d-9d39-95a7720e8622-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "90478a56-0c65-4f7d-9d39-95a7720e8622" (UID: "90478a56-0c65-4f7d-9d39-95a7720e8622"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:12:59.848382 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.848193    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "90478a56-0c65-4f7d-9d39-95a7720e8622" (UID: "90478a56-0c65-4f7d-9d39-95a7720e8622"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:59.848382 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.848230    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "90478a56-0c65-4f7d-9d39-95a7720e8622" (UID: "90478a56-0c65-4f7d-9d39-95a7720e8622"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:59.848382 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.848336    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:59.848382 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.848354    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/90478a56-0c65-4f7d-9d39-95a7720e8622-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:59.848382 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.848368    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:59.848382 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.848386    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:59.848696 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.848403    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:59.850106 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.850073    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "90478a56-0c65-4f7d-9d39-95a7720e8622" (UID: "90478a56-0c65-4f7d-9d39-95a7720e8622"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:12:59.850226 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.850100    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "90478a56-0c65-4f7d-9d39-95a7720e8622" (UID: "90478a56-0c65-4f7d-9d39-95a7720e8622"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:12:59.850289 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.850269    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90478a56-0c65-4f7d-9d39-95a7720e8622-kube-api-access-gkx6k" (OuterVolumeSpecName: "kube-api-access-gkx6k") pod "90478a56-0c65-4f7d-9d39-95a7720e8622" (UID: "90478a56-0c65-4f7d-9d39-95a7720e8622"). InnerVolumeSpecName "kube-api-access-gkx6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:59.850364 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.850347    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-token" (OuterVolumeSpecName: "istio-token") pod "90478a56-0c65-4f7d-9d39-95a7720e8622" (UID: "90478a56-0c65-4f7d-9d39-95a7720e8622"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:12:59.949641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.949603    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkx6k\" (UniqueName: \"kubernetes.io/projected/90478a56-0c65-4f7d-9d39-95a7720e8622-kube-api-access-gkx6k\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:59.949641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.949637    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:59.949641 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.949647    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:12:59.949915 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:12:59.949657    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/90478a56-0c65-4f7d-9d39-95a7720e8622-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:00.613688 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:00.613655    2547 generic.go:356] "Generic (PLEG): container finished" podID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerID="f510f5c25ab7c280150f9155d55e35f5f65df32688e3677c83400b92f5a25e31" exitCode=0
Sep 11 13:13:00.613904 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:00.613738    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"
Sep 11 13:13:00.613904 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:00.613739    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" event={"ID":"90478a56-0c65-4f7d-9d39-95a7720e8622","Type":"ContainerDied","Data":"f510f5c25ab7c280150f9155d55e35f5f65df32688e3677c83400b92f5a25e31"}
Sep 11 13:13:00.613904 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:00.613805    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr" event={"ID":"90478a56-0c65-4f7d-9d39-95a7720e8622","Type":"ContainerDied","Data":"22aa785720a7fc6839178d60e81dbd95c5c1e770ec35ed6a22a66611ef4854a9"}
Sep 11 13:13:00.613904 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:00.613835    2547 scope.go:117] "RemoveContainer" containerID="f510f5c25ab7c280150f9155d55e35f5f65df32688e3677c83400b92f5a25e31"
Sep 11 13:13:00.623092 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:00.623075    2547 scope.go:117] "RemoveContainer" containerID="d2bb88ba9b8e25f1a8ed994eb371a47d578a8d4db66d8711d1f040c520630ff6"
Sep 11 13:13:00.630757 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:00.630739    2547 scope.go:117] "RemoveContainer" containerID="f510f5c25ab7c280150f9155d55e35f5f65df32688e3677c83400b92f5a25e31"
Sep 11 13:13:00.631058 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:13:00.631037    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f510f5c25ab7c280150f9155d55e35f5f65df32688e3677c83400b92f5a25e31\": container with ID starting with f510f5c25ab7c280150f9155d55e35f5f65df32688e3677c83400b92f5a25e31 not found: ID does not exist" containerID="f510f5c25ab7c280150f9155d55e35f5f65df32688e3677c83400b92f5a25e31"
Sep 11 13:13:00.631207 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:00.631067    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f510f5c25ab7c280150f9155d55e35f5f65df32688e3677c83400b92f5a25e31"} err="failed to get container status \"f510f5c25ab7c280150f9155d55e35f5f65df32688e3677c83400b92f5a25e31\": rpc error: code = NotFound desc = could not find container \"f510f5c25ab7c280150f9155d55e35f5f65df32688e3677c83400b92f5a25e31\": container with ID starting with f510f5c25ab7c280150f9155d55e35f5f65df32688e3677c83400b92f5a25e31 not found: ID does not exist"
Sep 11 13:13:00.631207 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:00.631086    2547 scope.go:117] "RemoveContainer" containerID="d2bb88ba9b8e25f1a8ed994eb371a47d578a8d4db66d8711d1f040c520630ff6"
Sep 11 13:13:00.631391 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:13:00.631373    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2bb88ba9b8e25f1a8ed994eb371a47d578a8d4db66d8711d1f040c520630ff6\": container with ID starting with d2bb88ba9b8e25f1a8ed994eb371a47d578a8d4db66d8711d1f040c520630ff6 not found: ID does not exist" containerID="d2bb88ba9b8e25f1a8ed994eb371a47d578a8d4db66d8711d1f040c520630ff6"
Sep 11 13:13:00.631454 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:00.631394    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2bb88ba9b8e25f1a8ed994eb371a47d578a8d4db66d8711d1f040c520630ff6"} err="failed to get container status \"d2bb88ba9b8e25f1a8ed994eb371a47d578a8d4db66d8711d1f040c520630ff6\": rpc error: code = NotFound desc = could not find container \"d2bb88ba9b8e25f1a8ed994eb371a47d578a8d4db66d8711d1f040c520630ff6\": container with ID starting with d2bb88ba9b8e25f1a8ed994eb371a47d578a8d4db66d8711d1f040c520630ff6 not found: ID does not exist"
Sep 11 13:13:00.650475 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:00.650445    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"]
Sep 11 13:13:00.657019 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:00.656991    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-528ff6-openshift-default-7d8585c684-54ccr"]
Sep 11 13:13:01.006578 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.006503    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" path="/var/lib/kubelet/pods/90478a56-0c65-4f7d-9d39-95a7720e8622/volumes"
Sep 11 13:13:01.750947 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.750911    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"]
Sep 11 13:13:01.751251 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751238    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy"
Sep 11 13:13:01.751299 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751252    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy"
Sep 11 13:13:01.751299 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751267    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy"
Sep 11 13:13:01.751299 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751273    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy"
Sep 11 13:13:01.751299 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751282    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0d59ba9-257e-4488-85dc-5c5b2bfce8d2" containerName="payload-pre-processing"
Sep 11 13:13:01.751299 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751288    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0d59ba9-257e-4488-85dc-5c5b2bfce8d2" containerName="payload-pre-processing"
Sep 11 13:13:01.751299 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751300    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="792821ed-469e-4ac9-aafe-1a9e59e4abea" containerName="revoke-keys"
Sep 11 13:13:01.751525 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751305    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="792821ed-469e-4ac9-aafe-1a9e59e4abea" containerName="revoke-keys"
Sep 11 13:13:01.751525 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751312    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="817f01aa-7d39-451f-930e-c541dc600881" containerName="main"
Sep 11 13:13:01.751525 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751317    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="817f01aa-7d39-451f-930e-c541dc600881" containerName="main"
Sep 11 13:13:01.751525 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751363    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="792821ed-469e-4ac9-aafe-1a9e59e4abea" containerName="revoke-keys"
Sep 11 13:13:01.751525 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751370    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0d59ba9-257e-4488-85dc-5c5b2bfce8d2" containerName="payload-pre-processing"
Sep 11 13:13:01.751525 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751376    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy"
Sep 11 13:13:01.751525 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751380    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d67690b-0191-41b2-bb5d-a57addecc6a9" containerName="istio-proxy"
Sep 11 13:13:01.751525 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751389    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="817f01aa-7d39-451f-930e-c541dc600881" containerName="main"
Sep 11 13:13:01.751525 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.751395    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="90478a56-0c65-4f7d-9d39-95a7720e8622" containerName="istio-proxy"
Sep 11 13:13:01.755527 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.755511    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.789462 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.789430    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1e58f711-openshift-default-dockercfg-jtn7n\""
Sep 11 13:13:01.839177 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.839136    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"]
Sep 11 13:13:01.864598 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.864563    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-token\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.864771 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.864609    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-workload-certs\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.864771 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.864639    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctxj5\" (UniqueName: \"kubernetes.io/projected/436100a4-16c4-4059-bb30-1b8a04fcf1f3-kube-api-access-ctxj5\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.864771 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.864664    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-credential-socket\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.864771 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.864681    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-workload-socket\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.864771 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.864706    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-podinfo\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.864966 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.864778    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-data\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.864966 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.864815    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-envoy\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.864966 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.864927    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istiod-ca-cert\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.966130 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.966091    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istiod-ca-cert\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.966303 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.966139    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-token\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.966303 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.966161    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-workload-certs\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.966303 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.966180    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctxj5\" (UniqueName: \"kubernetes.io/projected/436100a4-16c4-4059-bb30-1b8a04fcf1f3-kube-api-access-ctxj5\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.966303 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.966198    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-credential-socket\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.966303 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.966215    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-workload-socket\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.966303 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.966236    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-podinfo\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.966303 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.966263    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-data\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.966303 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.966292    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-envoy\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.966741 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.966691    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-credential-socket\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.966810 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.966771    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-workload-socket\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.966863 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.966822    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-data\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.966992 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.966961    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-workload-certs\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.967122 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.967060    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istiod-ca-cert\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.968546 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.968521    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-envoy\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.968830 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.968815    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-podinfo\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.992524 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.992494    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-token\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:01.994154 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:01.994136    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctxj5\" (UniqueName: \"kubernetes.io/projected/436100a4-16c4-4059-bb30-1b8a04fcf1f3-kube-api-access-ctxj5\") pod \"e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") " pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:02.065155 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:02.065111    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:02.401493 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:02.401466    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"]
Sep 11 13:13:02.402818 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:13:02.402791    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436100a4_16c4_4059_bb30_1b8a04fcf1f3.slice/crio-6ab2d3f3c34a47fc24848910887ae9e285d38d88e023e634460b0e9a392c4e55 WatchSource:0}: Error finding container 6ab2d3f3c34a47fc24848910887ae9e285d38d88e023e634460b0e9a392c4e55: Status 404 returned error can't find the container with id 6ab2d3f3c34a47fc24848910887ae9e285d38d88e023e634460b0e9a392c4e55
Sep 11 13:13:02.404902 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:02.404873    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:13:02.404986 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:02.404939    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:13:02.404986 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:02.404965    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:13:02.627344 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:02.627304    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" event={"ID":"436100a4-16c4-4059-bb30-1b8a04fcf1f3","Type":"ContainerStarted","Data":"a4291a4f47f9eeee188d74a4e783246c92afaf284d4c06f4a0a0d8017732c008"}
Sep 11 13:13:02.627519 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:02.627370    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" event={"ID":"436100a4-16c4-4059-bb30-1b8a04fcf1f3","Type":"ContainerStarted","Data":"6ab2d3f3c34a47fc24848910887ae9e285d38d88e023e634460b0e9a392c4e55"}
Sep 11 13:13:02.669011 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:02.668914    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" podStartSLOduration=1.668896712 podStartE2EDuration="1.668896712s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:02.666137728 +0000 UTC m=+1052.170002144" watchObservedRunningTime="2026-09-11 13:13:02.668896712 +0000 UTC m=+1052.172761105"
Sep 11 13:13:03.065561 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:03.065526    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:03.070604 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:03.070577    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:03.632455 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:03.632419    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:03.633360 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:03.633342    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:08.083422 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.083387    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"]
Sep 11 13:13:08.087034 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.087008    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"
Sep 11 13:13:08.090140 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.090116    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-1e58f711\""
Sep 11 13:13:08.090447 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.090431    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-1e58f711-dockercfg-bc528\""
Sep 11 13:13:08.105383 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.105347    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"]
Sep 11 13:13:08.223880 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.223844    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a10e9f83-41f3-4c82-b177-298d8eb3fff3-plugins-config-volume\") pod \"payload-processing-e2e-mt-1e58f711-8f96787d5-cddws\" (UID: \"a10e9f83-41f3-4c82-b177-298d8eb3fff3\") " pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"
Sep 11 13:13:08.224058 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.223927    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfdp8\" (UniqueName: \"kubernetes.io/projected/a10e9f83-41f3-4c82-b177-298d8eb3fff3-kube-api-access-jfdp8\") pod \"payload-processing-e2e-mt-1e58f711-8f96787d5-cddws\" (UID: \"a10e9f83-41f3-4c82-b177-298d8eb3fff3\") " pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"
Sep 11 13:13:08.325207 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.325170    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a10e9f83-41f3-4c82-b177-298d8eb3fff3-plugins-config-volume\") pod \"payload-processing-e2e-mt-1e58f711-8f96787d5-cddws\" (UID: \"a10e9f83-41f3-4c82-b177-298d8eb3fff3\") " pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"
Sep 11 13:13:08.325387 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.325266    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfdp8\" (UniqueName: \"kubernetes.io/projected/a10e9f83-41f3-4c82-b177-298d8eb3fff3-kube-api-access-jfdp8\") pod \"payload-processing-e2e-mt-1e58f711-8f96787d5-cddws\" (UID: \"a10e9f83-41f3-4c82-b177-298d8eb3fff3\") " pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"
Sep 11 13:13:08.325968 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.325951    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a10e9f83-41f3-4c82-b177-298d8eb3fff3-plugins-config-volume\") pod \"payload-processing-e2e-mt-1e58f711-8f96787d5-cddws\" (UID: \"a10e9f83-41f3-4c82-b177-298d8eb3fff3\") " pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"
Sep 11 13:13:08.359666 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.359595    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfdp8\" (UniqueName: \"kubernetes.io/projected/a10e9f83-41f3-4c82-b177-298d8eb3fff3-kube-api-access-jfdp8\") pod \"payload-processing-e2e-mt-1e58f711-8f96787d5-cddws\" (UID: \"a10e9f83-41f3-4c82-b177-298d8eb3fff3\") " pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"
Sep 11 13:13:08.398518 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.398485    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"
Sep 11 13:13:08.552825 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.552795    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"]
Sep 11 13:13:08.553017 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.552994    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr" podUID="cb2e76f1-c213-4ca5-8db3-f410bd448e75" containerName="payload-pre-processing" containerID="cri-o://3df4a838c15171c177619753d7abb77ea1fd2b6aee74df997b8a95d3771a7f42" gracePeriod=30
Sep 11 13:13:08.668104 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.668075    2547 generic.go:356] "Generic (PLEG): container finished" podID="cb2e76f1-c213-4ca5-8db3-f410bd448e75" containerID="3df4a838c15171c177619753d7abb77ea1fd2b6aee74df997b8a95d3771a7f42" exitCode=0
Sep 11 13:13:08.668238 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.668146    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr" event={"ID":"cb2e76f1-c213-4ca5-8db3-f410bd448e75","Type":"ContainerDied","Data":"3df4a838c15171c177619753d7abb77ea1fd2b6aee74df997b8a95d3771a7f42"}
Sep 11 13:13:08.723116 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.722977    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"]
Sep 11 13:13:08.725697 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:13:08.725636    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda10e9f83_41f3_4c82_b177_298d8eb3fff3.slice/crio-3d48aa44d4ae97b6a1969464c3dddebdaa88988febb3e9ab5d0190c83f93b06c WatchSource:0}: Error finding container 3d48aa44d4ae97b6a1969464c3dddebdaa88988febb3e9ab5d0190c83f93b06c: Status 404 returned error can't find the container with id 3d48aa44d4ae97b6a1969464c3dddebdaa88988febb3e9ab5d0190c83f93b06c
Sep 11 13:13:08.799825 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.799802    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"
Sep 11 13:13:08.930292 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.930204    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmc4m\" (UniqueName: \"kubernetes.io/projected/cb2e76f1-c213-4ca5-8db3-f410bd448e75-kube-api-access-wmc4m\") pod \"cb2e76f1-c213-4ca5-8db3-f410bd448e75\" (UID: \"cb2e76f1-c213-4ca5-8db3-f410bd448e75\") "
Sep 11 13:13:08.930449 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.930304    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb2e76f1-c213-4ca5-8db3-f410bd448e75-plugins-config-volume\") pod \"cb2e76f1-c213-4ca5-8db3-f410bd448e75\" (UID: \"cb2e76f1-c213-4ca5-8db3-f410bd448e75\") "
Sep 11 13:13:08.930689 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.930659    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb2e76f1-c213-4ca5-8db3-f410bd448e75-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cb2e76f1-c213-4ca5-8db3-f410bd448e75" (UID: "cb2e76f1-c213-4ca5-8db3-f410bd448e75"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:13:08.932281 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:08.932261    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb2e76f1-c213-4ca5-8db3-f410bd448e75-kube-api-access-wmc4m" (OuterVolumeSpecName: "kube-api-access-wmc4m") pod "cb2e76f1-c213-4ca5-8db3-f410bd448e75" (UID: "cb2e76f1-c213-4ca5-8db3-f410bd448e75"). InnerVolumeSpecName "kube-api-access-wmc4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:13:09.031567 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:09.031531    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmc4m\" (UniqueName: \"kubernetes.io/projected/cb2e76f1-c213-4ca5-8db3-f410bd448e75-kube-api-access-wmc4m\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:09.031567 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:09.031561    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cb2e76f1-c213-4ca5-8db3-f410bd448e75-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:09.675199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:09.675108    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"
Sep 11 13:13:09.675199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:09.675117    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr" event={"ID":"cb2e76f1-c213-4ca5-8db3-f410bd448e75","Type":"ContainerDied","Data":"d09847132e27682b410839faf28ca08145d4896f4b6aabbe2b8647f1d29f2f65"}
Sep 11 13:13:09.675199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:09.675186    2547 scope.go:117] "RemoveContainer" containerID="3df4a838c15171c177619753d7abb77ea1fd2b6aee74df997b8a95d3771a7f42"
Sep 11 13:13:09.677149 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:09.677032    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws" event={"ID":"a10e9f83-41f3-4c82-b177-298d8eb3fff3","Type":"ContainerStarted","Data":"65043ad25abe096b845c803b337ece9748e972ec99155d88884afade1c3e5c20"}
Sep 11 13:13:09.677149 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:09.677086    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws" event={"ID":"a10e9f83-41f3-4c82-b177-298d8eb3fff3","Type":"ContainerStarted","Data":"3d48aa44d4ae97b6a1969464c3dddebdaa88988febb3e9ab5d0190c83f93b06c"}
Sep 11 13:13:09.677149 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:09.677135    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"
Sep 11 13:13:09.706972 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:09.706940    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"]
Sep 11 13:13:09.713308 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:09.713279    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a6ba91-76f476c44b-fgrcr"]
Sep 11 13:13:09.746399 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:09.746346    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws" podStartSLOduration=1.74632888 podStartE2EDuration="1.74632888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:09.744872276 +0000 UTC m=+1059.248736679" watchObservedRunningTime="2026-09-11 13:13:09.74632888 +0000 UTC m=+1059.250193339"
Sep 11 13:13:11.006378 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:11.006343    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb2e76f1-c213-4ca5-8db3-f410bd448e75" path="/var/lib/kubelet/pods/cb2e76f1-c213-4ca5-8db3-f410bd448e75/volumes"
Sep 11 13:13:11.799481 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:11.799443    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:13:18.130385 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:18.130355    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"]
Sep 11 13:13:18.130762 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:18.130541    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4" podUID="1337198d-52af-4648-8f4b-809ac212ece2" containerName="istio-proxy" containerID="cri-o://631a1d5cafcb6b16b6318de77c028e5f9b4a3791052496107cdeb5eb0411871b" gracePeriod=30
Sep 11 13:13:19.673921 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:19.673880    2547 patch_prober.go:28] interesting pod/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 13:13:19.674340 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:19.673958    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 13:13:20.684954 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:20.684909    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"
Sep 11 13:13:21.741003 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:21.740971    2547 generic.go:356] "Generic (PLEG): container finished" podID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerID="a4291a4f47f9eeee188d74a4e783246c92afaf284d4c06f4a0a0d8017732c008" exitCode=0
Sep 11 13:13:21.741644 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:21.741030    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" event={"ID":"436100a4-16c4-4059-bb30-1b8a04fcf1f3","Type":"ContainerDied","Data":"a4291a4f47f9eeee188d74a4e783246c92afaf284d4c06f4a0a0d8017732c008"}
Sep 11 13:13:21.741644 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:21.741441    2547 scope.go:117] "RemoveContainer" containerID="a4291a4f47f9eeee188d74a4e783246c92afaf284d4c06f4a0a0d8017732c008"
Sep 11 13:13:21.742458 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:21.742433    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:13:21.742531 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:21.742516    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:13:21.742570 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:21.742551    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:13:22.751131 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:22.751081    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" event={"ID":"436100a4-16c4-4059-bb30-1b8a04fcf1f3","Type":"ContainerStarted","Data":"2ae52863de9f659c4fb89a152d7413a084fe1f76a603e7d016b79b0f2ba7eace"}
Sep 11 13:13:23.066274 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.066163    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:23.066473 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.066318    2547 patch_prober.go:28] interesting pod/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 11 13:13:23.066473 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.066368    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 11 13:13:23.417780 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.417756    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:13:23.572246 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572205    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-workload-socket\") pod \"1337198d-52af-4648-8f4b-809ac212ece2\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") "
Sep 11 13:13:23.572246 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572248    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-istio-data\") pod \"1337198d-52af-4648-8f4b-809ac212ece2\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") "
Sep 11 13:13:23.572500 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572294    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1337198d-52af-4648-8f4b-809ac212ece2-istio-podinfo\") pod \"1337198d-52af-4648-8f4b-809ac212ece2\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") "
Sep 11 13:13:23.572500 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572323    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-workload-certs\") pod \"1337198d-52af-4648-8f4b-809ac212ece2\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") "
Sep 11 13:13:23.572500 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572348    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b76zw\" (UniqueName: \"kubernetes.io/projected/1337198d-52af-4648-8f4b-809ac212ece2-kube-api-access-b76zw\") pod \"1337198d-52af-4648-8f4b-809ac212ece2\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") "
Sep 11 13:13:23.572500 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572370    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1337198d-52af-4648-8f4b-809ac212ece2-istio-token\") pod \"1337198d-52af-4648-8f4b-809ac212ece2\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") "
Sep 11 13:13:23.572500 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572412    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1337198d-52af-4648-8f4b-809ac212ece2-istiod-ca-cert\") pod \"1337198d-52af-4648-8f4b-809ac212ece2\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") "
Sep 11 13:13:23.572500 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572437    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-credential-socket\") pod \"1337198d-52af-4648-8f4b-809ac212ece2\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") "
Sep 11 13:13:23.572500 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572472    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-istio-envoy\") pod \"1337198d-52af-4648-8f4b-809ac212ece2\" (UID: \"1337198d-52af-4648-8f4b-809ac212ece2\") "
Sep 11 13:13:23.572900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572543    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1337198d-52af-4648-8f4b-809ac212ece2" (UID: "1337198d-52af-4648-8f4b-809ac212ece2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:13:23.572900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572554    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-istio-data" (OuterVolumeSpecName: "istio-data") pod "1337198d-52af-4648-8f4b-809ac212ece2" (UID: "1337198d-52af-4648-8f4b-809ac212ece2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:13:23.572900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572567    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1337198d-52af-4648-8f4b-809ac212ece2" (UID: "1337198d-52af-4648-8f4b-809ac212ece2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:13:23.572900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572801    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:23.572900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572824    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:23.572900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572839    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:23.572900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572871    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1337198d-52af-4648-8f4b-809ac212ece2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1337198d-52af-4648-8f4b-809ac212ece2" (UID: "1337198d-52af-4648-8f4b-809ac212ece2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:13:23.573260 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.572927    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1337198d-52af-4648-8f4b-809ac212ece2" (UID: "1337198d-52af-4648-8f4b-809ac212ece2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:13:23.574772 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.574744    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1337198d-52af-4648-8f4b-809ac212ece2" (UID: "1337198d-52af-4648-8f4b-809ac212ece2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:13:23.574896 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.574754    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1337198d-52af-4648-8f4b-809ac212ece2-kube-api-access-b76zw" (OuterVolumeSpecName: "kube-api-access-b76zw") pod "1337198d-52af-4648-8f4b-809ac212ece2" (UID: "1337198d-52af-4648-8f4b-809ac212ece2"). InnerVolumeSpecName "kube-api-access-b76zw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:13:23.575052 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.575033    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1337198d-52af-4648-8f4b-809ac212ece2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1337198d-52af-4648-8f4b-809ac212ece2" (UID: "1337198d-52af-4648-8f4b-809ac212ece2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:13:23.575099 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.575085    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1337198d-52af-4648-8f4b-809ac212ece2-istio-token" (OuterVolumeSpecName: "istio-token") pod "1337198d-52af-4648-8f4b-809ac212ece2" (UID: "1337198d-52af-4648-8f4b-809ac212ece2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:13:23.673420 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.673319    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1337198d-52af-4648-8f4b-809ac212ece2-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:23.673420 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.673353    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1337198d-52af-4648-8f4b-809ac212ece2-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:23.673420 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.673367    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:23.673420 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.673378    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1337198d-52af-4648-8f4b-809ac212ece2-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:23.673420 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.673390    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1337198d-52af-4648-8f4b-809ac212ece2-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:23.673420 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.673401    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b76zw\" (UniqueName: \"kubernetes.io/projected/1337198d-52af-4648-8f4b-809ac212ece2-kube-api-access-b76zw\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:23.761196 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.761152    2547 generic.go:356] "Generic (PLEG): container finished" podID="1337198d-52af-4648-8f4b-809ac212ece2" containerID="631a1d5cafcb6b16b6318de77c028e5f9b4a3791052496107cdeb5eb0411871b" exitCode=0
Sep 11 13:13:23.761686 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.761220    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"
Sep 11 13:13:23.761686 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.761261    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4" event={"ID":"1337198d-52af-4648-8f4b-809ac212ece2","Type":"ContainerDied","Data":"631a1d5cafcb6b16b6318de77c028e5f9b4a3791052496107cdeb5eb0411871b"}
Sep 11 13:13:23.761686 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.761314    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4" event={"ID":"1337198d-52af-4648-8f4b-809ac212ece2","Type":"ContainerDied","Data":"4a5e4c3715ecb58f6722d00f07484d48792816d72a5f10d8e185f6358912fc47"}
Sep 11 13:13:23.761686 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.761345    2547 scope.go:117] "RemoveContainer" containerID="631a1d5cafcb6b16b6318de77c028e5f9b4a3791052496107cdeb5eb0411871b"
Sep 11 13:13:23.779105 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.779071    2547 scope.go:117] "RemoveContainer" containerID="5d249892fb2b2e8623f643a389d3813f809de6ee70e5fb1f4409946b5c17a8be"
Sep 11 13:13:23.787211 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.787190    2547 scope.go:117] "RemoveContainer" containerID="631a1d5cafcb6b16b6318de77c028e5f9b4a3791052496107cdeb5eb0411871b"
Sep 11 13:13:23.787522 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:13:23.787502    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"631a1d5cafcb6b16b6318de77c028e5f9b4a3791052496107cdeb5eb0411871b\": container with ID starting with 631a1d5cafcb6b16b6318de77c028e5f9b4a3791052496107cdeb5eb0411871b not found: ID does not exist" containerID="631a1d5cafcb6b16b6318de77c028e5f9b4a3791052496107cdeb5eb0411871b"
Sep 11 13:13:23.787597 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.787530    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"631a1d5cafcb6b16b6318de77c028e5f9b4a3791052496107cdeb5eb0411871b"} err="failed to get container status \"631a1d5cafcb6b16b6318de77c028e5f9b4a3791052496107cdeb5eb0411871b\": rpc error: code = NotFound desc = could not find container \"631a1d5cafcb6b16b6318de77c028e5f9b4a3791052496107cdeb5eb0411871b\": container with ID starting with 631a1d5cafcb6b16b6318de77c028e5f9b4a3791052496107cdeb5eb0411871b not found: ID does not exist"
Sep 11 13:13:23.787597 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.787548    2547 scope.go:117] "RemoveContainer" containerID="5d249892fb2b2e8623f643a389d3813f809de6ee70e5fb1f4409946b5c17a8be"
Sep 11 13:13:23.787852 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:13:23.787827    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d249892fb2b2e8623f643a389d3813f809de6ee70e5fb1f4409946b5c17a8be\": container with ID starting with 5d249892fb2b2e8623f643a389d3813f809de6ee70e5fb1f4409946b5c17a8be not found: ID does not exist" containerID="5d249892fb2b2e8623f643a389d3813f809de6ee70e5fb1f4409946b5c17a8be"
Sep 11 13:13:23.787951 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.787853    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d249892fb2b2e8623f643a389d3813f809de6ee70e5fb1f4409946b5c17a8be"} err="failed to get container status \"5d249892fb2b2e8623f643a389d3813f809de6ee70e5fb1f4409946b5c17a8be\": rpc error: code = NotFound desc = could not find container \"5d249892fb2b2e8623f643a389d3813f809de6ee70e5fb1f4409946b5c17a8be\": container with ID starting with 5d249892fb2b2e8623f643a389d3813f809de6ee70e5fb1f4409946b5c17a8be not found: ID does not exist"
Sep 11 13:13:23.807910 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.807879    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"]
Sep 11 13:13:23.817776 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:23.817752    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a6ba91-openshift-default-64d6f77f76-ngrb4"]
Sep 11 13:13:24.065878 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:24.065839    2547 patch_prober.go:28] interesting pod/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 11 13:13:24.066167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:24.066140    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 11 13:13:25.006305 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:25.006271    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1337198d-52af-4648-8f4b-809ac212ece2" path="/var/lib/kubelet/pods/1337198d-52af-4648-8f4b-809ac212ece2/volumes"
Sep 11 13:13:25.065823 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:25.065784    2547 patch_prober.go:28] interesting pod/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 11 13:13:25.066099 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:25.066069    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 11 13:13:26.066465 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:26.066428    2547 patch_prober.go:28] interesting pod/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 11 13:13:26.066996 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:26.066828    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 11 13:13:27.065651 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:27.065608    2547 patch_prober.go:28] interesting pod/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 11 13:13:27.066376 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:27.065969    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 11 13:13:28.133832 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.133802    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:28.134293 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.134097    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:28.135391 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.135363    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:13:28.903423 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.903388    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"]
Sep 11 13:13:28.903709 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.903697    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb2e76f1-c213-4ca5-8db3-f410bd448e75" containerName="payload-pre-processing"
Sep 11 13:13:28.903709 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.903711    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb2e76f1-c213-4ca5-8db3-f410bd448e75" containerName="payload-pre-processing"
Sep 11 13:13:28.903827 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.903737    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1337198d-52af-4648-8f4b-809ac212ece2" containerName="istio-proxy"
Sep 11 13:13:28.903827 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.903744    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1337198d-52af-4648-8f4b-809ac212ece2" containerName="istio-proxy"
Sep 11 13:13:28.903827 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.903756    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1337198d-52af-4648-8f4b-809ac212ece2" containerName="istio-proxy"
Sep 11 13:13:28.903827 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.903761    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="1337198d-52af-4648-8f4b-809ac212ece2" containerName="istio-proxy"
Sep 11 13:13:28.903827 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.903812    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1337198d-52af-4648-8f4b-809ac212ece2" containerName="istio-proxy"
Sep 11 13:13:28.903827 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.903819    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb2e76f1-c213-4ca5-8db3-f410bd448e75" containerName="payload-pre-processing"
Sep 11 13:13:28.903827 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.903827    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="1337198d-52af-4648-8f4b-809ac212ece2" containerName="istio-proxy"
Sep 11 13:13:28.906608 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.906593    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"
Sep 11 13:13:28.914744 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.914707    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-1841da-dockercfg-s2bn5\""
Sep 11 13:13:28.914959 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.914946    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-1841da\""
Sep 11 13:13:28.917664 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.917644    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5185271-07ec-431e-b79a-f7fa7d61d3c7-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5\" (UID: \"d5185271-07ec-431e-b79a-f7fa7d61d3c7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"
Sep 11 13:13:28.917761 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.917687    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdglc\" (UniqueName: \"kubernetes.io/projected/d5185271-07ec-431e-b79a-f7fa7d61d3c7-kube-api-access-zdglc\") pod \"payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5\" (UID: \"d5185271-07ec-431e-b79a-f7fa7d61d3c7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"
Sep 11 13:13:28.958956 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:28.958927    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"]
Sep 11 13:13:29.018226 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:29.018191    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5185271-07ec-431e-b79a-f7fa7d61d3c7-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5\" (UID: \"d5185271-07ec-431e-b79a-f7fa7d61d3c7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"
Sep 11 13:13:29.018396 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:29.018240    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdglc\" (UniqueName: \"kubernetes.io/projected/d5185271-07ec-431e-b79a-f7fa7d61d3c7-kube-api-access-zdglc\") pod \"payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5\" (UID: \"d5185271-07ec-431e-b79a-f7fa7d61d3c7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"
Sep 11 13:13:29.018967 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:29.018950    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5185271-07ec-431e-b79a-f7fa7d61d3c7-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5\" (UID: \"d5185271-07ec-431e-b79a-f7fa7d61d3c7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"
Sep 11 13:13:29.043332 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:29.043303    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdglc\" (UniqueName: \"kubernetes.io/projected/d5185271-07ec-431e-b79a-f7fa7d61d3c7-kube-api-access-zdglc\") pod \"payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5\" (UID: \"d5185271-07ec-431e-b79a-f7fa7d61d3c7\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"
Sep 11 13:13:29.216958 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:29.216871    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"
Sep 11 13:13:29.519648 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:29.519459    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"]
Sep 11 13:13:29.522317 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:13:29.522278    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5185271_07ec_431e_b79a_f7fa7d61d3c7.slice/crio-cec738e98905edb42632bbea853fcfd4f9d26b08ffedd0d9cbfc13578ff5cd1b WatchSource:0}: Error finding container cec738e98905edb42632bbea853fcfd4f9d26b08ffedd0d9cbfc13578ff5cd1b: Status 404 returned error can't find the container with id cec738e98905edb42632bbea853fcfd4f9d26b08ffedd0d9cbfc13578ff5cd1b
Sep 11 13:13:29.795533 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:29.795497    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5" event={"ID":"d5185271-07ec-431e-b79a-f7fa7d61d3c7","Type":"ContainerStarted","Data":"768d35930efc0d99e24a17e1a9fc901043ed287c2861daca8bb21a29043e5c29"}
Sep 11 13:13:29.795755 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:29.795557    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5" event={"ID":"d5185271-07ec-431e-b79a-f7fa7d61d3c7","Type":"ContainerStarted","Data":"cec738e98905edb42632bbea853fcfd4f9d26b08ffedd0d9cbfc13578ff5cd1b"}
Sep 11 13:13:29.795755 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:29.795592    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"
Sep 11 13:13:29.851173 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:29.851113    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5" podStartSLOduration=1.851098077 podStartE2EDuration="1.851098077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:29.849467151 +0000 UTC m=+1079.353331544" watchObservedRunningTime="2026-09-11 13:13:29.851098077 +0000 UTC m=+1079.354962513"
Sep 11 13:13:31.408516 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:31.408430    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:13:38.926686 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:38.926652    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2"]
Sep 11 13:13:38.931303 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:38.931284    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2"
Sep 11 13:13:38.934361 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:38.934342    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:13:38.935092 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:38.935077    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:13:38.953761 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:38.953736    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2"]
Sep 11 13:13:39.010112 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:39.010080    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6bc013e-b66f-4c68-b6c9-b8b2d65308db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2\" (UID: \"f6bc013e-b66f-4c68-b6c9-b8b2d65308db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2"
Sep 11 13:13:39.111329 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:39.111283    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6bc013e-b66f-4c68-b6c9-b8b2d65308db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2\" (UID: \"f6bc013e-b66f-4c68-b6c9-b8b2d65308db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2"
Sep 11 13:13:39.111875 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:39.111851    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6bc013e-b66f-4c68-b6c9-b8b2d65308db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2\" (UID: \"f6bc013e-b66f-4c68-b6c9-b8b2d65308db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2"
Sep 11 13:13:39.241210 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:39.241121    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2"
Sep 11 13:13:39.526589 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:39.526565    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2"]
Sep 11 13:13:39.528269 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:13:39.528237    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6bc013e_b66f_4c68_b6c9_b8b2d65308db.slice/crio-b72879e30fb1a18ea2b899d538f4cbbc6259a0c05669eedfc05c8707791f2c9c WatchSource:0}: Error finding container b72879e30fb1a18ea2b899d538f4cbbc6259a0c05669eedfc05c8707791f2c9c: Status 404 returned error can't find the container with id b72879e30fb1a18ea2b899d538f4cbbc6259a0c05669eedfc05c8707791f2c9c
Sep 11 13:13:39.840190 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:39.840157    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2" event={"ID":"f6bc013e-b66f-4c68-b6c9-b8b2d65308db","Type":"ContainerStarted","Data":"6f1e079eb1c5088b1044f3ce7121bfc1d3cac8ad47cf65fa95e1693dd740e2fc"}
Sep 11 13:13:39.840362 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:39.840206    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2" event={"ID":"f6bc013e-b66f-4c68-b6c9-b8b2d65308db","Type":"ContainerStarted","Data":"b72879e30fb1a18ea2b899d538f4cbbc6259a0c05669eedfc05c8707791f2c9c"}
Sep 11 13:13:39.885524 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:39.885473    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2" podStartSLOduration=1.885456689 podStartE2EDuration="1.885456689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:39.884013797 +0000 UTC m=+1089.387878189" watchObservedRunningTime="2026-09-11 13:13:39.885456689 +0000 UTC m=+1089.389321084"
Sep 11 13:13:40.803118 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:40.803088    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"
Sep 11 13:13:40.847089 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:40.847059    2547 generic.go:356] "Generic (PLEG): container finished" podID="f6bc013e-b66f-4c68-b6c9-b8b2d65308db" containerID="6f1e079eb1c5088b1044f3ce7121bfc1d3cac8ad47cf65fa95e1693dd740e2fc" exitCode=0
Sep 11 13:13:40.847286 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:40.847104    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2" event={"ID":"f6bc013e-b66f-4c68-b6c9-b8b2d65308db","Type":"ContainerDied","Data":"6f1e079eb1c5088b1044f3ce7121bfc1d3cac8ad47cf65fa95e1693dd740e2fc"}
Sep 11 13:13:41.976065 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:41.976040    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2"
Sep 11 13:13:42.033904 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:42.033870    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6bc013e-b66f-4c68-b6c9-b8b2d65308db-maas-api-service-ca\") pod \"f6bc013e-b66f-4c68-b6c9-b8b2d65308db\" (UID: \"f6bc013e-b66f-4c68-b6c9-b8b2d65308db\") "
Sep 11 13:13:42.034251 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:42.034221    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6bc013e-b66f-4c68-b6c9-b8b2d65308db-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f6bc013e-b66f-4c68-b6c9-b8b2d65308db" (UID: "f6bc013e-b66f-4c68-b6c9-b8b2d65308db"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:13:42.135083 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:42.134998    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6bc013e-b66f-4c68-b6c9-b8b2d65308db-maas-api-service-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:42.857463 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:42.857431    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2"
Sep 11 13:13:42.857463 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:42.857458    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2" event={"ID":"f6bc013e-b66f-4c68-b6c9-b8b2d65308db","Type":"ContainerDied","Data":"b72879e30fb1a18ea2b899d538f4cbbc6259a0c05669eedfc05c8707791f2c9c"}
Sep 11 13:13:42.857675 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:42.857531    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b72879e30fb1a18ea2b899d538f4cbbc6259a0c05669eedfc05c8707791f2c9c"
Sep 11 13:13:51.681252 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:51.681195    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"]
Sep 11 13:13:51.681755 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:51.681441    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws" podUID="a10e9f83-41f3-4c82-b177-298d8eb3fff3" containerName="payload-processing" containerID="cri-o://65043ad25abe096b845c803b337ece9748e972ec99155d88884afade1c3e5c20" gracePeriod=30
Sep 11 13:13:51.921913 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:51.921878    2547 generic.go:356] "Generic (PLEG): container finished" podID="a10e9f83-41f3-4c82-b177-298d8eb3fff3" containerID="65043ad25abe096b845c803b337ece9748e972ec99155d88884afade1c3e5c20" exitCode=0
Sep 11 13:13:51.922146 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:51.921932    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws" event={"ID":"a10e9f83-41f3-4c82-b177-298d8eb3fff3","Type":"ContainerDied","Data":"65043ad25abe096b845c803b337ece9748e972ec99155d88884afade1c3e5c20"}
Sep 11 13:13:51.949137 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:51.949064    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"
Sep 11 13:13:51.997348 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:51.997316    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2"]
Sep 11 13:13:52.010124 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:52.010090    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1e58f711-kd2d2"]
Sep 11 13:13:52.019611 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:52.019585    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfdp8\" (UniqueName: \"kubernetes.io/projected/a10e9f83-41f3-4c82-b177-298d8eb3fff3-kube-api-access-jfdp8\") pod \"a10e9f83-41f3-4c82-b177-298d8eb3fff3\" (UID: \"a10e9f83-41f3-4c82-b177-298d8eb3fff3\") "
Sep 11 13:13:52.019786 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:52.019753    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a10e9f83-41f3-4c82-b177-298d8eb3fff3-plugins-config-volume\") pod \"a10e9f83-41f3-4c82-b177-298d8eb3fff3\" (UID: \"a10e9f83-41f3-4c82-b177-298d8eb3fff3\") "
Sep 11 13:13:52.020120 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:52.020099    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a10e9f83-41f3-4c82-b177-298d8eb3fff3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a10e9f83-41f3-4c82-b177-298d8eb3fff3" (UID: "a10e9f83-41f3-4c82-b177-298d8eb3fff3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:13:52.021693 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:52.021670    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a10e9f83-41f3-4c82-b177-298d8eb3fff3-kube-api-access-jfdp8" (OuterVolumeSpecName: "kube-api-access-jfdp8") pod "a10e9f83-41f3-4c82-b177-298d8eb3fff3" (UID: "a10e9f83-41f3-4c82-b177-298d8eb3fff3"). InnerVolumeSpecName "kube-api-access-jfdp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:13:52.120919 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:52.120881    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a10e9f83-41f3-4c82-b177-298d8eb3fff3-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:52.120919 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:52.120920    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfdp8\" (UniqueName: \"kubernetes.io/projected/a10e9f83-41f3-4c82-b177-298d8eb3fff3-kube-api-access-jfdp8\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:13:52.929079 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:52.929037    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws" event={"ID":"a10e9f83-41f3-4c82-b177-298d8eb3fff3","Type":"ContainerDied","Data":"3d48aa44d4ae97b6a1969464c3dddebdaa88988febb3e9ab5d0190c83f93b06c"}
Sep 11 13:13:52.929079 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:52.929067    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"
Sep 11 13:13:52.929684 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:52.929113    2547 scope.go:117] "RemoveContainer" containerID="65043ad25abe096b845c803b337ece9748e972ec99155d88884afade1c3e5c20"
Sep 11 13:13:52.970827 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:52.970797    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"]
Sep 11 13:13:52.977392 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:52.977366    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-1e58f711-8f96787d5-cddws"]
Sep 11 13:13:53.006618 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.006586    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a10e9f83-41f3-4c82-b177-298d8eb3fff3" path="/var/lib/kubelet/pods/a10e9f83-41f3-4c82-b177-298d8eb3fff3/volumes"
Sep 11 13:13:53.006942 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.006929    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6bc013e-b66f-4c68-b6c9-b8b2d65308db" path="/var/lib/kubelet/pods/f6bc013e-b66f-4c68-b6c9-b8b2d65308db/volumes"
Sep 11 13:13:53.134009 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.133977    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"]
Sep 11 13:13:53.134316 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.134304    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6bc013e-b66f-4c68-b6c9-b8b2d65308db" containerName="revoke-keys"
Sep 11 13:13:53.134362 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.134317    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6bc013e-b66f-4c68-b6c9-b8b2d65308db" containerName="revoke-keys"
Sep 11 13:13:53.134362 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.134336    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a10e9f83-41f3-4c82-b177-298d8eb3fff3" containerName="payload-processing"
Sep 11 13:13:53.134362 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.134342    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="a10e9f83-41f3-4c82-b177-298d8eb3fff3" containerName="payload-processing"
Sep 11 13:13:53.134455 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.134396    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="a10e9f83-41f3-4c82-b177-298d8eb3fff3" containerName="payload-processing"
Sep 11 13:13:53.134455 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.134406    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6bc013e-b66f-4c68-b6c9-b8b2d65308db" containerName="revoke-keys"
Sep 11 13:13:53.138465 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.138448    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"
Sep 11 13:13:53.144507 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.144478    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-82825f-dockercfg-gvd2p\""
Sep 11 13:13:53.144829 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.144809    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-82825f\""
Sep 11 13:13:53.158228 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.158176    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"]
Sep 11 13:13:53.204277 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.202195    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"]
Sep 11 13:13:53.206193 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.206170    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"
Sep 11 13:13:53.224173 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.224142    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"]
Sep 11 13:13:53.238343 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.238089    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxzxl\" (UniqueName: \"kubernetes.io/projected/6224e750-5a24-4881-833c-786d745edb85-kube-api-access-zxzxl\") pod \"payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k\" (UID: \"6224e750-5a24-4881-833c-786d745edb85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"
Sep 11 13:13:53.238343 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.238224    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6224e750-5a24-4881-833c-786d745edb85-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k\" (UID: \"6224e750-5a24-4881-833c-786d745edb85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"
Sep 11 13:13:53.338708 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.338671    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xst7t\" (UniqueName: \"kubernetes.io/projected/5b7f9c6f-9541-4808-ada3-7183ad7ec501-kube-api-access-xst7t\") pod \"payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq\" (UID: \"5b7f9c6f-9541-4808-ada3-7183ad7ec501\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"
Sep 11 13:13:53.338901 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.338793    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxzxl\" (UniqueName: \"kubernetes.io/projected/6224e750-5a24-4881-833c-786d745edb85-kube-api-access-zxzxl\") pod \"payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k\" (UID: \"6224e750-5a24-4881-833c-786d745edb85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"
Sep 11 13:13:53.338901 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.338836    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7f9c6f-9541-4808-ada3-7183ad7ec501-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq\" (UID: \"5b7f9c6f-9541-4808-ada3-7183ad7ec501\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"
Sep 11 13:13:53.338981 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.338908    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6224e750-5a24-4881-833c-786d745edb85-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k\" (UID: \"6224e750-5a24-4881-833c-786d745edb85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"
Sep 11 13:13:53.339551 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.339534    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6224e750-5a24-4881-833c-786d745edb85-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k\" (UID: \"6224e750-5a24-4881-833c-786d745edb85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"
Sep 11 13:13:53.347252 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.347227    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxzxl\" (UniqueName: \"kubernetes.io/projected/6224e750-5a24-4881-833c-786d745edb85-kube-api-access-zxzxl\") pod \"payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k\" (UID: \"6224e750-5a24-4881-833c-786d745edb85\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"
Sep 11 13:13:53.439828 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.439796    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xst7t\" (UniqueName: \"kubernetes.io/projected/5b7f9c6f-9541-4808-ada3-7183ad7ec501-kube-api-access-xst7t\") pod \"payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq\" (UID: \"5b7f9c6f-9541-4808-ada3-7183ad7ec501\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"
Sep 11 13:13:53.440005 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.439852    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7f9c6f-9541-4808-ada3-7183ad7ec501-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq\" (UID: \"5b7f9c6f-9541-4808-ada3-7183ad7ec501\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"
Sep 11 13:13:53.440483 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.440465    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7f9c6f-9541-4808-ada3-7183ad7ec501-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq\" (UID: \"5b7f9c6f-9541-4808-ada3-7183ad7ec501\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"
Sep 11 13:13:53.448681 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.448654    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"
Sep 11 13:13:53.452149 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.452127    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xst7t\" (UniqueName: \"kubernetes.io/projected/5b7f9c6f-9541-4808-ada3-7183ad7ec501-kube-api-access-xst7t\") pod \"payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq\" (UID: \"5b7f9c6f-9541-4808-ada3-7183ad7ec501\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"
Sep 11 13:13:53.519104 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.519069    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"
Sep 11 13:13:53.723485 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.723425    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"]
Sep 11 13:13:53.725660 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:13:53.725625    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6224e750_5a24_4881_833c_786d745edb85.slice/crio-317cf32ea6f70d54068ab8ceeeb7ef72f6a0006bec41a60283ba217890198c4b WatchSource:0}: Error finding container 317cf32ea6f70d54068ab8ceeeb7ef72f6a0006bec41a60283ba217890198c4b: Status 404 returned error can't find the container with id 317cf32ea6f70d54068ab8ceeeb7ef72f6a0006bec41a60283ba217890198c4b
Sep 11 13:13:53.798614 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.798585    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"]
Sep 11 13:13:53.799271 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:13:53.799241    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7f9c6f_9541_4808_ada3_7183ad7ec501.slice/crio-9b7e8ad14768ae3ae6683cfe4d06581249cdcce3ad12b5161d9af33fd8d562af WatchSource:0}: Error finding container 9b7e8ad14768ae3ae6683cfe4d06581249cdcce3ad12b5161d9af33fd8d562af: Status 404 returned error can't find the container with id 9b7e8ad14768ae3ae6683cfe4d06581249cdcce3ad12b5161d9af33fd8d562af
Sep 11 13:13:53.938102 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.938067    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k" event={"ID":"6224e750-5a24-4881-833c-786d745edb85","Type":"ContainerStarted","Data":"b502666f2131e5f01157cf984d525852c54c78383a9d64e15789c675ffd65fd7"}
Sep 11 13:13:53.938534 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.938121    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k" event={"ID":"6224e750-5a24-4881-833c-786d745edb85","Type":"ContainerStarted","Data":"317cf32ea6f70d54068ab8ceeeb7ef72f6a0006bec41a60283ba217890198c4b"}
Sep 11 13:13:53.938534 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.938175    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"
Sep 11 13:13:53.939752 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.939707    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq" event={"ID":"5b7f9c6f-9541-4808-ada3-7183ad7ec501","Type":"ContainerStarted","Data":"afbe9ba6e965ae4fd362addda3506c37b3e0c242d8f35e90ac89160ece191854"}
Sep 11 13:13:53.939875 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.939770    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq" event={"ID":"5b7f9c6f-9541-4808-ada3-7183ad7ec501","Type":"ContainerStarted","Data":"9b7e8ad14768ae3ae6683cfe4d06581249cdcce3ad12b5161d9af33fd8d562af"}
Sep 11 13:13:53.939875 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.939803    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"
Sep 11 13:13:53.961299 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.961243    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k" podStartSLOduration=0.961222529 podStartE2EDuration="961.222529ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:53.958351938 +0000 UTC m=+1103.462216335" watchObservedRunningTime="2026-09-11 13:13:53.961222529 +0000 UTC m=+1103.465086924"
Sep 11 13:13:53.981905 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:53.981817    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq" podStartSLOduration=0.981800462 podStartE2EDuration="981.800462ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:13:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:13:53.980043333 +0000 UTC m=+1103.483907723" watchObservedRunningTime="2026-09-11 13:13:53.981800462 +0000 UTC m=+1103.485664855"
Sep 11 13:13:57.434626 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:57.434588    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:13:59.433024 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:59.432990    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"]
Sep 11 13:13:59.433489 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:13:59.433231    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerName="istio-proxy" containerID="cri-o://2ae52863de9f659c4fb89a152d7413a084fe1f76a603e7d016b79b0f2ba7eace" gracePeriod=30
Sep 11 13:14:04.680504 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.680476    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:14:04.840910 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.840871    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-token\") pod \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") "
Sep 11 13:14:04.840910 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.840914    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-envoy\") pod \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") "
Sep 11 13:14:04.841122 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.840963    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-workload-socket\") pod \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") "
Sep 11 13:14:04.841122 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841065    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istiod-ca-cert\") pod \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") "
Sep 11 13:14:04.841122 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841108    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-workload-certs\") pod \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") "
Sep 11 13:14:04.841235 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841152    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-podinfo\") pod \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") "
Sep 11 13:14:04.841235 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841190    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-credential-socket\") pod \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") "
Sep 11 13:14:04.841235 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841213    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-data\") pod \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") "
Sep 11 13:14:04.841394 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841264    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctxj5\" (UniqueName: \"kubernetes.io/projected/436100a4-16c4-4059-bb30-1b8a04fcf1f3-kube-api-access-ctxj5\") pod \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\" (UID: \"436100a4-16c4-4059-bb30-1b8a04fcf1f3\") "
Sep 11 13:14:04.841394 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841266    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "436100a4-16c4-4059-bb30-1b8a04fcf1f3" (UID: "436100a4-16c4-4059-bb30-1b8a04fcf1f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:04.841499 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841393    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "436100a4-16c4-4059-bb30-1b8a04fcf1f3" (UID: "436100a4-16c4-4059-bb30-1b8a04fcf1f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:04.841499 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841488    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "436100a4-16c4-4059-bb30-1b8a04fcf1f3" (UID: "436100a4-16c4-4059-bb30-1b8a04fcf1f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:04.841613 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841503    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "436100a4-16c4-4059-bb30-1b8a04fcf1f3" (UID: "436100a4-16c4-4059-bb30-1b8a04fcf1f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:14:04.841663 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841652    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:14:04.841746 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841665    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "436100a4-16c4-4059-bb30-1b8a04fcf1f3" (UID: "436100a4-16c4-4059-bb30-1b8a04fcf1f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:04.841746 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841674    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:14:04.841746 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841691    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:14:04.841746 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.841705    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:14:04.843391 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.843360    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "436100a4-16c4-4059-bb30-1b8a04fcf1f3" (UID: "436100a4-16c4-4059-bb30-1b8a04fcf1f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:14:04.843510 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.843470    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/436100a4-16c4-4059-bb30-1b8a04fcf1f3-kube-api-access-ctxj5" (OuterVolumeSpecName: "kube-api-access-ctxj5") pod "436100a4-16c4-4059-bb30-1b8a04fcf1f3" (UID: "436100a4-16c4-4059-bb30-1b8a04fcf1f3"). InnerVolumeSpecName "kube-api-access-ctxj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:14:04.843605 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.843590    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "436100a4-16c4-4059-bb30-1b8a04fcf1f3" (UID: "436100a4-16c4-4059-bb30-1b8a04fcf1f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:14:04.843648 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.843632    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "436100a4-16c4-4059-bb30-1b8a04fcf1f3" (UID: "436100a4-16c4-4059-bb30-1b8a04fcf1f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:14:04.942804 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.942763    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:14:04.942804 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.942795    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:14:04.942804 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.942804    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctxj5\" (UniqueName: \"kubernetes.io/projected/436100a4-16c4-4059-bb30-1b8a04fcf1f3-kube-api-access-ctxj5\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:14:04.942804 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.942814    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:14:04.943069 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.942823    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/436100a4-16c4-4059-bb30-1b8a04fcf1f3-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:14:04.947180 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.947149    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"
Sep 11 13:14:04.947324 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.947302    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"
Sep 11 13:14:04.994357 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.994319    2547 generic.go:356] "Generic (PLEG): container finished" podID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerID="2ae52863de9f659c4fb89a152d7413a084fe1f76a603e7d016b79b0f2ba7eace" exitCode=0
Sep 11 13:14:04.994529 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.994374    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"
Sep 11 13:14:04.994529 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.994401    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" event={"ID":"436100a4-16c4-4059-bb30-1b8a04fcf1f3","Type":"ContainerDied","Data":"2ae52863de9f659c4fb89a152d7413a084fe1f76a603e7d016b79b0f2ba7eace"}
Sep 11 13:14:04.994529 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.994456    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv" event={"ID":"436100a4-16c4-4059-bb30-1b8a04fcf1f3","Type":"ContainerDied","Data":"6ab2d3f3c34a47fc24848910887ae9e285d38d88e023e634460b0e9a392c4e55"}
Sep 11 13:14:04.994529 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:04.994485    2547 scope.go:117] "RemoveContainer" containerID="2ae52863de9f659c4fb89a152d7413a084fe1f76a603e7d016b79b0f2ba7eace"
Sep 11 13:14:05.009587 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:05.009562    2547 scope.go:117] "RemoveContainer" containerID="a4291a4f47f9eeee188d74a4e783246c92afaf284d4c06f4a0a0d8017732c008"
Sep 11 13:14:05.018158 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:05.018137    2547 scope.go:117] "RemoveContainer" containerID="2ae52863de9f659c4fb89a152d7413a084fe1f76a603e7d016b79b0f2ba7eace"
Sep 11 13:14:05.018476 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:14:05.018460    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ae52863de9f659c4fb89a152d7413a084fe1f76a603e7d016b79b0f2ba7eace\": container with ID starting with 2ae52863de9f659c4fb89a152d7413a084fe1f76a603e7d016b79b0f2ba7eace not found: ID does not exist" containerID="2ae52863de9f659c4fb89a152d7413a084fe1f76a603e7d016b79b0f2ba7eace"
Sep 11 13:14:05.018527 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:05.018483    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ae52863de9f659c4fb89a152d7413a084fe1f76a603e7d016b79b0f2ba7eace"} err="failed to get container status \"2ae52863de9f659c4fb89a152d7413a084fe1f76a603e7d016b79b0f2ba7eace\": rpc error: code = NotFound desc = could not find container \"2ae52863de9f659c4fb89a152d7413a084fe1f76a603e7d016b79b0f2ba7eace\": container with ID starting with 2ae52863de9f659c4fb89a152d7413a084fe1f76a603e7d016b79b0f2ba7eace not found: ID does not exist"
Sep 11 13:14:05.018527 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:05.018500    2547 scope.go:117] "RemoveContainer" containerID="a4291a4f47f9eeee188d74a4e783246c92afaf284d4c06f4a0a0d8017732c008"
Sep 11 13:14:05.018783 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:14:05.018760    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4291a4f47f9eeee188d74a4e783246c92afaf284d4c06f4a0a0d8017732c008\": container with ID starting with a4291a4f47f9eeee188d74a4e783246c92afaf284d4c06f4a0a0d8017732c008 not found: ID does not exist" containerID="a4291a4f47f9eeee188d74a4e783246c92afaf284d4c06f4a0a0d8017732c008"
Sep 11 13:14:05.018832 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:05.018792    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4291a4f47f9eeee188d74a4e783246c92afaf284d4c06f4a0a0d8017732c008"} err="failed to get container status \"a4291a4f47f9eeee188d74a4e783246c92afaf284d4c06f4a0a0d8017732c008\": rpc error: code = NotFound desc = could not find container \"a4291a4f47f9eeee188d74a4e783246c92afaf284d4c06f4a0a0d8017732c008\": container with ID starting with a4291a4f47f9eeee188d74a4e783246c92afaf284d4c06f4a0a0d8017732c008 not found: ID does not exist"
Sep 11 13:14:05.024763 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:05.024708    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"]
Sep 11 13:14:05.026193 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:05.026172    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1e58f711-openshift-default-f44944c6d-2zgsv"]
Sep 11 13:14:07.006876 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:07.006844    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" path="/var/lib/kubelet/pods/436100a4-16c4-4059-bb30-1b8a04fcf1f3/volumes"
Sep 11 13:14:15.947760 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:15.947704    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"]
Sep 11 13:14:15.948251 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:15.948082    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerName="istio-proxy"
Sep 11 13:14:15.948251 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:15.948096    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerName="istio-proxy"
Sep 11 13:14:15.948251 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:15.948107    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerName="istio-proxy"
Sep 11 13:14:15.948251 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:15.948113    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerName="istio-proxy"
Sep 11 13:14:15.948251 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:15.948162    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerName="istio-proxy"
Sep 11 13:14:15.952831 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:15.952810    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:15.972853 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:15.972823    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-4d7bb0-openshift-default-dockercfg-rxgj7\""
Sep 11 13:14:15.995931 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:15.995893    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"]
Sep 11 13:14:16.139643 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.139602    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-workload-socket\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.139643 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.139647    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-envoy\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.139920 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.139675    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-data\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.139920 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.139793    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-credential-socket\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.139920 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.139828    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istiod-ca-cert\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.139920 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.139895    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-token\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.139920 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.139913    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cf8nq\" (UniqueName: \"kubernetes.io/projected/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-kube-api-access-cf8nq\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.140106 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.139931    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-podinfo\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.140106 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.139992    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-workload-certs\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.241155 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.241059    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-credential-socket\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.241155 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.241111    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istiod-ca-cert\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.241399 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.241174    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-token\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.241399 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.241202    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cf8nq\" (UniqueName: \"kubernetes.io/projected/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-kube-api-access-cf8nq\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.241399 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.241228    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-podinfo\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.241399 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.241270    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-workload-certs\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.241399 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.241304    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-workload-socket\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.241399 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.241336    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-envoy\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.241399 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.241362    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-data\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.241790 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.241615    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-credential-socket\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.241790 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.241677    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-data\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.241954 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.241924    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istiod-ca-cert\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.241954 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.241941    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-workload-socket\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.242099 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.242020    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-workload-certs\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.243850 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.243828    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-envoy\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.243991 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.243976    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-podinfo\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.257766 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.257734    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-token\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.258760 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.258733    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cf8nq\" (UniqueName: \"kubernetes.io/projected/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-kube-api-access-cf8nq\") pod \"e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") " pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.262662 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.262637    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:16.548493 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.548468    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"]
Sep 11 13:14:16.551031 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:14:16.550998    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabfca6aa_ee7a_476c_a7a3_0a8f213912e6.slice/crio-e9898f8a53aab0a6c2412ab2a780a35d1e9b705f2202288467fdb8c59d8bf259 WatchSource:0}: Error finding container e9898f8a53aab0a6c2412ab2a780a35d1e9b705f2202288467fdb8c59d8bf259: Status 404 returned error can't find the container with id e9898f8a53aab0a6c2412ab2a780a35d1e9b705f2202288467fdb8c59d8bf259
Sep 11 13:14:16.553164 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.553129    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:14:16.553234 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.553198    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:14:16.553234 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:16.553225    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:14:17.056181 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:17.056146    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" event={"ID":"abfca6aa-ee7a-476c-a7a3-0a8f213912e6","Type":"ContainerStarted","Data":"ec1272535dae1d54aa8f9eac44185021aa43630352f6c5912c28aefd1c5c2f22"}
Sep 11 13:14:17.056597 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:17.056198    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" event={"ID":"abfca6aa-ee7a-476c-a7a3-0a8f213912e6","Type":"ContainerStarted","Data":"e9898f8a53aab0a6c2412ab2a780a35d1e9b705f2202288467fdb8c59d8bf259"}
Sep 11 13:14:17.117892 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:17.117837    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" podStartSLOduration=2.117822529 podStartE2EDuration="2.117822529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:14:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:14:17.117377181 +0000 UTC m=+1126.621241566" watchObservedRunningTime="2026-09-11 13:14:17.117822529 +0000 UTC m=+1126.621686921"
Sep 11 13:14:17.263248 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:17.263208    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:17.268218 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:17.268190    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:18.061213 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:18.061184    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:18.062387 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:18.062371    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:25.118285 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.118242    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"]
Sep 11 13:14:25.118791 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.118636    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="436100a4-16c4-4059-bb30-1b8a04fcf1f3" containerName="istio-proxy"
Sep 11 13:14:25.121754 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.121734    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"]
Sep 11 13:14:25.121896 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.121859    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"
Sep 11 13:14:25.127369 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.127339    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-4d7bb0\""
Sep 11 13:14:25.128941 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.128917    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"
Sep 11 13:14:25.157653 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.157620    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"]
Sep 11 13:14:25.206203 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.206167    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"]
Sep 11 13:14:25.214134 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.214101    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5511bc14-d882-4576-8e07-611611e67c29-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh\" (UID: \"5511bc14-d882-4576-8e07-611611e67c29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"
Sep 11 13:14:25.214134 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.214135    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kd4p\" (UniqueName: \"kubernetes.io/projected/b2d6b948-f096-42a9-89db-bd4c0560ce8d-kube-api-access-2kd4p\") pod \"payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs\" (UID: \"b2d6b948-f096-42a9-89db-bd4c0560ce8d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"
Sep 11 13:14:25.214372 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.214156    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkx28\" (UniqueName: \"kubernetes.io/projected/5511bc14-d882-4576-8e07-611611e67c29-kube-api-access-lkx28\") pod \"payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh\" (UID: \"5511bc14-d882-4576-8e07-611611e67c29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"
Sep 11 13:14:25.214372 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.214232    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d6b948-f096-42a9-89db-bd4c0560ce8d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs\" (UID: \"b2d6b948-f096-42a9-89db-bd4c0560ce8d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"
Sep 11 13:14:25.315178 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.315130    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5511bc14-d882-4576-8e07-611611e67c29-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh\" (UID: \"5511bc14-d882-4576-8e07-611611e67c29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"
Sep 11 13:14:25.315178 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.315177    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kd4p\" (UniqueName: \"kubernetes.io/projected/b2d6b948-f096-42a9-89db-bd4c0560ce8d-kube-api-access-2kd4p\") pod \"payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs\" (UID: \"b2d6b948-f096-42a9-89db-bd4c0560ce8d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"
Sep 11 13:14:25.315458 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.315202    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkx28\" (UniqueName: \"kubernetes.io/projected/5511bc14-d882-4576-8e07-611611e67c29-kube-api-access-lkx28\") pod \"payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh\" (UID: \"5511bc14-d882-4576-8e07-611611e67c29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"
Sep 11 13:14:25.315458 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.315246    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d6b948-f096-42a9-89db-bd4c0560ce8d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs\" (UID: \"b2d6b948-f096-42a9-89db-bd4c0560ce8d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"
Sep 11 13:14:25.315939 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.315915    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d6b948-f096-42a9-89db-bd4c0560ce8d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs\" (UID: \"b2d6b948-f096-42a9-89db-bd4c0560ce8d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"
Sep 11 13:14:25.316050 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.315957    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5511bc14-d882-4576-8e07-611611e67c29-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh\" (UID: \"5511bc14-d882-4576-8e07-611611e67c29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"
Sep 11 13:14:25.330756 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.330700    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kd4p\" (UniqueName: \"kubernetes.io/projected/b2d6b948-f096-42a9-89db-bd4c0560ce8d-kube-api-access-2kd4p\") pod \"payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs\" (UID: \"b2d6b948-f096-42a9-89db-bd4c0560ce8d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"
Sep 11 13:14:25.331424 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.331397    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkx28\" (UniqueName: \"kubernetes.io/projected/5511bc14-d882-4576-8e07-611611e67c29-kube-api-access-lkx28\") pod \"payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh\" (UID: \"5511bc14-d882-4576-8e07-611611e67c29\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"
Sep 11 13:14:25.439035 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.438932    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"
Sep 11 13:14:25.446172 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.446147    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"
Sep 11 13:14:25.746310 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.746227    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"]
Sep 11 13:14:25.751636 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:14:25.751610    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d6b948_f096_42a9_89db_bd4c0560ce8d.slice/crio-582b9b12a72ee0f94f3a656592314b4afbcde84a81564bb359dc7ce18f5b4a9c WatchSource:0}: Error finding container 582b9b12a72ee0f94f3a656592314b4afbcde84a81564bb359dc7ce18f5b4a9c: Status 404 returned error can't find the container with id 582b9b12a72ee0f94f3a656592314b4afbcde84a81564bb359dc7ce18f5b4a9c
Sep 11 13:14:25.758195 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:25.758171    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"]
Sep 11 13:14:25.763886 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:14:25.763857    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5511bc14_d882_4576_8e07_611611e67c29.slice/crio-9f6b7f8315ff1ed59892a34b317b128301228899f3fdc65470c690485de512f8 WatchSource:0}: Error finding container 9f6b7f8315ff1ed59892a34b317b128301228899f3fdc65470c690485de512f8: Status 404 returned error can't find the container with id 9f6b7f8315ff1ed59892a34b317b128301228899f3fdc65470c690485de512f8
Sep 11 13:14:26.104772 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:26.104711    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs" event={"ID":"b2d6b948-f096-42a9-89db-bd4c0560ce8d","Type":"ContainerStarted","Data":"016aa5fa168cf09d4982832a507a585f824755ec304b4e7ff42355c9318e4620"}
Sep 11 13:14:26.104964 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:26.104795    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs" event={"ID":"b2d6b948-f096-42a9-89db-bd4c0560ce8d","Type":"ContainerStarted","Data":"582b9b12a72ee0f94f3a656592314b4afbcde84a81564bb359dc7ce18f5b4a9c"}
Sep 11 13:14:26.104964 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:26.104851    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"
Sep 11 13:14:26.106350 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:26.106322    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh" event={"ID":"5511bc14-d882-4576-8e07-611611e67c29","Type":"ContainerStarted","Data":"dceace8551bacc2a7c2076f49095917f6e705e62c474205a251babc5225b5e22"}
Sep 11 13:14:26.106451 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:26.106365    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh" event={"ID":"5511bc14-d882-4576-8e07-611611e67c29","Type":"ContainerStarted","Data":"9f6b7f8315ff1ed59892a34b317b128301228899f3fdc65470c690485de512f8"}
Sep 11 13:14:26.106451 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:26.106394    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"
Sep 11 13:14:26.141928 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:26.141874    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs" podStartSLOduration=1.1418575930000001 podStartE2EDuration="1.141857593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:14:26.1401947 +0000 UTC m=+1135.644059093" watchObservedRunningTime="2026-09-11 13:14:26.141857593 +0000 UTC m=+1135.645721985"
Sep 11 13:14:26.182097 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:26.182037    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh" podStartSLOduration=1.182013208 podStartE2EDuration="1.182013208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:14:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:14:26.181150147 +0000 UTC m=+1135.685014543" watchObservedRunningTime="2026-09-11 13:14:26.182013208 +0000 UTC m=+1135.685877606"
Sep 11 13:14:27.529586 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:27.529553    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:14:37.113788 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:37.113756    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"
Sep 11 13:14:37.114224 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:37.113837    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"
Sep 11 13:14:39.181544 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:39.181509    2547 generic.go:356] "Generic (PLEG): container finished" podID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerID="ec1272535dae1d54aa8f9eac44185021aa43630352f6c5912c28aefd1c5c2f22" exitCode=0
Sep 11 13:14:39.181995 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:39.181578    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" event={"ID":"abfca6aa-ee7a-476c-a7a3-0a8f213912e6","Type":"ContainerDied","Data":"ec1272535dae1d54aa8f9eac44185021aa43630352f6c5912c28aefd1c5c2f22"}
Sep 11 13:14:39.181995 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:39.181972    2547 scope.go:117] "RemoveContainer" containerID="ec1272535dae1d54aa8f9eac44185021aa43630352f6c5912c28aefd1c5c2f22"
Sep 11 13:14:39.183119 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:39.183094    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:14:39.183196 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:39.183166    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:14:39.183235 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:39.183201    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:14:40.188264 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:40.188232    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" event={"ID":"abfca6aa-ee7a-476c-a7a3-0a8f213912e6","Type":"ContainerStarted","Data":"11550164e3fa9e9ea06c9d8c9354707a6e6427cda4a0faeb320b8e89dba1d89d"}
Sep 11 13:14:40.262998 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:40.262947    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:40.263457 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:40.263421    2547 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 13:14:40.263548 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:40.263493    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 13:14:41.264166 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:41.264126    2547 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 13:14:41.264783 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:41.264746    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 13:14:42.263330 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:42.263293    2547 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 13:14:42.264115 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:42.264083    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 13:14:43.263410 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:43.263360    2547 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 13:14:43.263967 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:43.263448    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 13:14:44.264100 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:44.264063    2547 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 13:14:44.264704 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:44.264673    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 13:14:45.263475 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:45.263427    2547 patch_prober.go:28] interesting pod/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body=
Sep 11 13:14:45.263688 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:45.263500    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused"
Sep 11 13:14:46.372934 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:46.372902    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:46.373393 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:46.373202    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:46.374154 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:46.374134    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:14:47.773707 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:47.773661    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:14:50.496485 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.496447    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"]
Sep 11 13:14:50.500061 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.500042    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.503758 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.503740    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-f705b6-openshift-default-dockercfg-mmw6p\""
Sep 11 13:14:50.527324 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.527295    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"]
Sep 11 13:14:50.649428 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.649393    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-podinfo\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.649625 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.649447    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-credential-socket\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.649625 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.649538    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-workload-certs\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.649625 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.649570    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-token\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.649625 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.649594    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vxtb\" (UniqueName: \"kubernetes.io/projected/ac3b9cc3-6180-4f34-aab6-03ac246defac-kube-api-access-6vxtb\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.649829 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.649630    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-data\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.649829 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.649657    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-workload-socket\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.649829 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.649706    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac3b9cc3-6180-4f34-aab6-03ac246defac-istiod-ca-cert\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.649829 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.649769    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-envoy\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.750962 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.750865    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-podinfo\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.750962 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.750927    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-credential-socket\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.750962 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.750962    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-workload-certs\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.751270 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.750979    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-token\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.751270 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.750997    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vxtb\" (UniqueName: \"kubernetes.io/projected/ac3b9cc3-6180-4f34-aab6-03ac246defac-kube-api-access-6vxtb\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.751270 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.751024    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-data\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.751270 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.751058    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-workload-socket\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.751270 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.751091    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac3b9cc3-6180-4f34-aab6-03ac246defac-istiod-ca-cert\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.751270 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.751116    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-envoy\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.751610 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.751425    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-credential-socket\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.751610 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.751451    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-workload-certs\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.751610 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.751559    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-data\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.751824 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.751699    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-workload-socket\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.751936 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.751915    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac3b9cc3-6180-4f34-aab6-03ac246defac-istiod-ca-cert\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.753583 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.753562    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-podinfo\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.753583 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.753569    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-envoy\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.769861 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.769832    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vxtb\" (UniqueName: \"kubernetes.io/projected/ac3b9cc3-6180-4f34-aab6-03ac246defac-kube-api-access-6vxtb\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.777588 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.777565    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-token\") pod \"e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") " pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:50.811130 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:50.811097    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:51.104801 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:51.104767    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"]
Sep 11 13:14:51.108839 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:14:51.108812    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac3b9cc3_6180_4f34_aab6_03ac246defac.slice/crio-d799974d91de9668977f4a786879a359b633de77b5973d27c5fbf8b8ffc419c5 WatchSource:0}: Error finding container d799974d91de9668977f4a786879a359b633de77b5973d27c5fbf8b8ffc419c5: Status 404 returned error can't find the container with id d799974d91de9668977f4a786879a359b633de77b5973d27c5fbf8b8ffc419c5
Sep 11 13:14:51.111023 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:51.110994    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:14:51.111121 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:51.111058    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:14:51.111121 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:51.111088    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:14:51.252733 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:51.252684    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm" event={"ID":"ac3b9cc3-6180-4f34-aab6-03ac246defac","Type":"ContainerStarted","Data":"bd12fa9f4df015126a5467462a0b2ec01c62abe5c7cfd14ee64ac961cd92eada"}
Sep 11 13:14:51.253271 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:51.252765    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm" event={"ID":"ac3b9cc3-6180-4f34-aab6-03ac246defac","Type":"ContainerStarted","Data":"d799974d91de9668977f4a786879a359b633de77b5973d27c5fbf8b8ffc419c5"}
Sep 11 13:14:51.312740 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:51.312667    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm" podStartSLOduration=1.3126508860000001 podStartE2EDuration="1.312650886s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:14:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:14:51.310948023 +0000 UTC m=+1160.814812417" watchObservedRunningTime="2026-09-11 13:14:51.312650886 +0000 UTC m=+1160.816515280"
Sep 11 13:14:51.811823 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:51.811783    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:52.817237 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:52.817201    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:53.262583 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:53.262471    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:14:53.263562 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:14:53.263541    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:15:00.268594 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.268559    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818875-rh98t"]
Sep 11 13:15:00.271877 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.271857    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl"]
Sep 11 13:15:00.272027 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.271990    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-rh98t"
Sep 11 13:15:00.274900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.274882    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl"
Sep 11 13:15:00.284929 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.284907    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:15:00.288969 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.288952    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl"
Sep 11 13:15:00.293946 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.293923    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-rh98t"
Sep 11 13:15:00.324800 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.319762    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl"]
Sep 11 13:15:00.324800 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.322280    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818875-rh98t"]
Sep 11 13:15:00.617299 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.617273    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl"]
Sep 11 13:15:00.619836 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:15:00.619802    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb273ffa_2fd9_4376_a4b6_7f9cc7a3ad8e.slice/crio-0589ecb6b7a0a6c408b56a2974e099940d3da0583ac3db24044a06724962c2e8 WatchSource:0}: Error finding container 0589ecb6b7a0a6c408b56a2974e099940d3da0583ac3db24044a06724962c2e8: Status 404 returned error can't find the container with id 0589ecb6b7a0a6c408b56a2974e099940d3da0583ac3db24044a06724962c2e8
Sep 11 13:15:00.624541 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.624521    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818875-rh98t"]
Sep 11 13:15:00.736559 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.736529    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"]
Sep 11 13:15:00.740911 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.740894    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"
Sep 11 13:15:00.750191 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.750169    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-f705b6\""
Sep 11 13:15:00.751879 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.751864    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-f705b6-dockercfg-gcfn9\""
Sep 11 13:15:00.767185 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.767161    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"]
Sep 11 13:15:00.846965 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.846937    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3453d033-156c-4d4e-b4ef-ff7ba7730d2e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq\" (UID: \"3453d033-156c-4d4e-b4ef-ff7ba7730d2e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"
Sep 11 13:15:00.847117 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.847030    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkhnj\" (UniqueName: \"kubernetes.io/projected/3453d033-156c-4d4e-b4ef-ff7ba7730d2e-kube-api-access-bkhnj\") pod \"payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq\" (UID: \"3453d033-156c-4d4e-b4ef-ff7ba7730d2e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"
Sep 11 13:15:00.947695 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.947663    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3453d033-156c-4d4e-b4ef-ff7ba7730d2e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq\" (UID: \"3453d033-156c-4d4e-b4ef-ff7ba7730d2e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"
Sep 11 13:15:00.947884 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.947760    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkhnj\" (UniqueName: \"kubernetes.io/projected/3453d033-156c-4d4e-b4ef-ff7ba7730d2e-kube-api-access-bkhnj\") pod \"payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq\" (UID: \"3453d033-156c-4d4e-b4ef-ff7ba7730d2e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"
Sep 11 13:15:00.948607 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.948576    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3453d033-156c-4d4e-b4ef-ff7ba7730d2e-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq\" (UID: \"3453d033-156c-4d4e-b4ef-ff7ba7730d2e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"
Sep 11 13:15:00.964027 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:00.963996    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkhnj\" (UniqueName: \"kubernetes.io/projected/3453d033-156c-4d4e-b4ef-ff7ba7730d2e-kube-api-access-bkhnj\") pod \"payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq\" (UID: \"3453d033-156c-4d4e-b4ef-ff7ba7730d2e\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"
Sep 11 13:15:01.050455 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:01.050418    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"
Sep 11 13:15:01.302268 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:01.302233    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl" event={"ID":"db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e","Type":"ContainerStarted","Data":"a8530d9f8fc28b32d5fca6b63c8a05e27fa838939c15c0153b366437e58b64da"}
Sep 11 13:15:01.302883 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:01.302313    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl" event={"ID":"db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e","Type":"ContainerStarted","Data":"0589ecb6b7a0a6c408b56a2974e099940d3da0583ac3db24044a06724962c2e8"}
Sep 11 13:15:01.304387 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:01.304359    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-rh98t" event={"ID":"197ff720-87cc-4ee4-aa69-b65a169353b1","Type":"ContainerStarted","Data":"01e406963546364f1b447f5e19527497f8c21cd2434b5ff8c0d0f61812f46fb2"}
Sep 11 13:15:01.304496 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:01.304411    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-rh98t" event={"ID":"197ff720-87cc-4ee4-aa69-b65a169353b1","Type":"ContainerStarted","Data":"fd26b8573b7daad6280e282320d6d9742161495f36622aecffda090545a33eaf"}
Sep 11 13:15:01.328346 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:01.328290    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl" podStartSLOduration=1.328277232 podStartE2EDuration="1.328277232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:01.326787964 +0000 UTC m=+1170.830652358" watchObservedRunningTime="2026-09-11 13:15:01.328277232 +0000 UTC m=+1170.832141625"
Sep 11 13:15:01.341769 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:15:01.341743    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3453d033_156c_4d4e_b4ef_ff7ba7730d2e.slice/crio-80c5cbf8356e3f76ef7a637115c9cbe1dfe113d9073577b95bfa6163f9f54ef6 WatchSource:0}: Error finding container 80c5cbf8356e3f76ef7a637115c9cbe1dfe113d9073577b95bfa6163f9f54ef6: Status 404 returned error can't find the container with id 80c5cbf8356e3f76ef7a637115c9cbe1dfe113d9073577b95bfa6163f9f54ef6
Sep 11 13:15:01.346791 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:01.346767    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"]
Sep 11 13:15:01.369900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:01.369846    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-rh98t" podStartSLOduration=1.369824219 podStartE2EDuration="1.369824219s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:01.368313171 +0000 UTC m=+1170.872177566" watchObservedRunningTime="2026-09-11 13:15:01.369824219 +0000 UTC m=+1170.873688610"
Sep 11 13:15:02.311442 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:02.311403    2547 generic.go:356] "Generic (PLEG): container finished" podID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e" containerID="a8530d9f8fc28b32d5fca6b63c8a05e27fa838939c15c0153b366437e58b64da" exitCode=7
Sep 11 13:15:02.311930 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:02.311500    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl" event={"ID":"db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e","Type":"ContainerDied","Data":"a8530d9f8fc28b32d5fca6b63c8a05e27fa838939c15c0153b366437e58b64da"}
Sep 11 13:15:02.311930 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:02.311623    2547 scope.go:117] "RemoveContainer" containerID="a8530d9f8fc28b32d5fca6b63c8a05e27fa838939c15c0153b366437e58b64da"
Sep 11 13:15:02.313081 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:02.313049    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq" event={"ID":"3453d033-156c-4d4e-b4ef-ff7ba7730d2e","Type":"ContainerStarted","Data":"fa9c24b3a3ecb7ba9a6eddcf2b6b8e3861a22ef4abfac40c032e72d721b55a2b"}
Sep 11 13:15:02.313199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:02.313107    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"
Sep 11 13:15:02.313199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:02.313127    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq" event={"ID":"3453d033-156c-4d4e-b4ef-ff7ba7730d2e","Type":"ContainerStarted","Data":"80c5cbf8356e3f76ef7a637115c9cbe1dfe113d9073577b95bfa6163f9f54ef6"}
Sep 11 13:15:02.314589 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:02.314566    2547 generic.go:356] "Generic (PLEG): container finished" podID="197ff720-87cc-4ee4-aa69-b65a169353b1" containerID="01e406963546364f1b447f5e19527497f8c21cd2434b5ff8c0d0f61812f46fb2" exitCode=0
Sep 11 13:15:02.314681 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:02.314616    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-rh98t" event={"ID":"197ff720-87cc-4ee4-aa69-b65a169353b1","Type":"ContainerDied","Data":"01e406963546364f1b447f5e19527497f8c21cd2434b5ff8c0d0f61812f46fb2"}
Sep 11 13:15:02.432892 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:02.432837    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq" podStartSLOduration=2.432821175 podStartE2EDuration="2.432821175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:02.429662452 +0000 UTC m=+1171.933526847" watchObservedRunningTime="2026-09-11 13:15:02.432821175 +0000 UTC m=+1171.936685617"
Sep 11 13:15:03.321819 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:03.321702    2547 generic.go:356] "Generic (PLEG): container finished" podID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e" containerID="42823973d96fbbb878c8fbd2331e063af9aa4a1c8f112d61feb524e4e94b736f" exitCode=7
Sep 11 13:15:03.321819 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:03.321748    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl" event={"ID":"db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e","Type":"ContainerDied","Data":"42823973d96fbbb878c8fbd2331e063af9aa4a1c8f112d61feb524e4e94b736f"}
Sep 11 13:15:03.321819 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:03.321807    2547 scope.go:117] "RemoveContainer" containerID="a8530d9f8fc28b32d5fca6b63c8a05e27fa838939c15c0153b366437e58b64da"
Sep 11 13:15:03.322361 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:03.322016    2547 scope.go:117] "RemoveContainer" containerID="42823973d96fbbb878c8fbd2331e063af9aa4a1c8f112d61feb524e4e94b736f"
Sep 11 13:15:03.322361 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:15:03.322297    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl_odh-ai-gateway-infra(db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl" podUID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e"
Sep 11 13:15:03.462387 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:03.462363    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-rh98t"
Sep 11 13:15:04.329252 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:04.329225    2547 scope.go:117] "RemoveContainer" containerID="42823973d96fbbb878c8fbd2331e063af9aa4a1c8f112d61feb524e4e94b736f"
Sep 11 13:15:04.329780 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:15:04.329475    2547 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl_odh-ai-gateway-infra(db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl" podUID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e"
Sep 11 13:15:04.330352 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:04.330334    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-rh98t"
Sep 11 13:15:04.330426 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:04.330371    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818875-rh98t" event={"ID":"197ff720-87cc-4ee4-aa69-b65a169353b1","Type":"ContainerDied","Data":"fd26b8573b7daad6280e282320d6d9742161495f36622aecffda090545a33eaf"}
Sep 11 13:15:04.330426 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:04.330408    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd26b8573b7daad6280e282320d6d9742161495f36622aecffda090545a33eaf"
Sep 11 13:15:05.362847 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:05.362811    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:15:13.324864 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:13.324832    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"
Sep 11 13:15:15.000790 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:15.000750    2547 scope.go:117] "RemoveContainer" containerID="42823973d96fbbb878c8fbd2331e063af9aa4a1c8f112d61feb524e4e94b736f"
Sep 11 13:15:15.402269 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:15.402230    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl" event={"ID":"db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e","Type":"ContainerStarted","Data":"2059bcd4ccb1982b9939a1085ceca8fecee9bfb9050798a6475f9df28d2309b5"}
Sep 11 13:15:16.409194 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:16.409162    2547 generic.go:356] "Generic (PLEG): container finished" podID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e" containerID="2059bcd4ccb1982b9939a1085ceca8fecee9bfb9050798a6475f9df28d2309b5" exitCode=0
Sep 11 13:15:16.409733 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:16.409235    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl" event={"ID":"db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e","Type":"ContainerDied","Data":"2059bcd4ccb1982b9939a1085ceca8fecee9bfb9050798a6475f9df28d2309b5"}
Sep 11 13:15:16.409733 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:16.409306    2547 scope.go:117] "RemoveContainer" containerID="42823973d96fbbb878c8fbd2331e063af9aa4a1c8f112d61feb524e4e94b736f"
Sep 11 13:15:16.410908 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:16.410887    2547 generic.go:356] "Generic (PLEG): container finished" podID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerID="bd12fa9f4df015126a5467462a0b2ec01c62abe5c7cfd14ee64ac961cd92eada" exitCode=0
Sep 11 13:15:16.411011 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:16.410961    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm" event={"ID":"ac3b9cc3-6180-4f34-aab6-03ac246defac","Type":"ContainerDied","Data":"bd12fa9f4df015126a5467462a0b2ec01c62abe5c7cfd14ee64ac961cd92eada"}
Sep 11 13:15:16.411391 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:16.411373    2547 scope.go:117] "RemoveContainer" containerID="bd12fa9f4df015126a5467462a0b2ec01c62abe5c7cfd14ee64ac961cd92eada"
Sep 11 13:15:16.412439 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:16.412413    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:15:16.412538 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:16.412493    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:15:16.412605 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:16.412545    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:15:16.432979 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:16.432950    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl"]
Sep 11 13:15:17.418262 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:17.418228    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm" event={"ID":"ac3b9cc3-6180-4f34-aab6-03ac246defac","Type":"ContainerStarted","Data":"ee9433e30151f43d1a6de378d674ed575c3261cb5d3b47fa44300993d8c60956"}
Sep 11 13:15:17.589145 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:17.589114    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl"
Sep 11 13:15:17.812111 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:17.812070    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:15:17.812315 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:17.812289    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:15:17.812413 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:17.812350    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm" podUID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 13:15:18.425510 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:18.425479    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl"
Sep 11 13:15:18.426011 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:18.425511    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl" event={"ID":"db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e","Type":"ContainerDied","Data":"0589ecb6b7a0a6c408b56a2974e099940d3da0583ac3db24044a06724962c2e8"}
Sep 11 13:15:18.426011 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:18.425558    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0589ecb6b7a0a6c408b56a2974e099940d3da0583ac3db24044a06724962c2e8"
Sep 11 13:15:18.459357 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:18.459311    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl"]
Sep 11 13:15:18.462502 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:18.462373    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w2-f705b6-29818875-ncljl"]
Sep 11 13:15:18.811892 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:18.811850    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:15:18.812064 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:18.811918    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm" podUID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 13:15:19.006100 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:19.006067    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e" path="/var/lib/kubelet/pods/db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e/volumes"
Sep 11 13:15:19.447360 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:19.447321    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:15:19.811540 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:19.811497    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:15:19.811787 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:19.811560    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm" podUID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 13:15:20.812097 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:20.812063    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:15:20.812504 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:20.812116    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm" podUID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 13:15:21.812424 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:21.812389    2547 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 13:15:21.812869 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:21.812450    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm" podUID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 13:15:22.816138 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:22.816101    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:15:22.816582 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:22.816387    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:15:22.817164 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:22.817149    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:15:31.140943 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:31.140908    2547 scope.go:117] "RemoveContainer" containerID="8c538c4789fd3db7a73f30f76b04cb8c01451b475ce023a62c3a082d38fad661"
Sep 11 13:15:34.425929 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:34.425896    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:15:41.340957 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.340922    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"]
Sep 11 13:15:41.341334 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.341281    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="197ff720-87cc-4ee4-aa69-b65a169353b1" containerName="cleanup"
Sep 11 13:15:41.341334 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.341291    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="197ff720-87cc-4ee4-aa69-b65a169353b1" containerName="cleanup"
Sep 11 13:15:41.341334 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.341305    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e" containerName="cleanup"
Sep 11 13:15:41.341334 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.341311    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e" containerName="cleanup"
Sep 11 13:15:41.341334 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.341329    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e" containerName="cleanup"
Sep 11 13:15:41.341334 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.341334    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e" containerName="cleanup"
Sep 11 13:15:41.341532 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.341387    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e" containerName="cleanup"
Sep 11 13:15:41.341532 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.341395    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="197ff720-87cc-4ee4-aa69-b65a169353b1" containerName="cleanup"
Sep 11 13:15:41.341532 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.341400    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e" containerName="cleanup"
Sep 11 13:15:41.345707 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.345689    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"
Sep 11 13:15:41.348204 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.348181    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-13b2e851\""
Sep 11 13:15:41.348316 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.348221    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-13b2e851-dockercfg-xzgdd\""
Sep 11 13:15:41.356203 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.356177    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"]
Sep 11 13:15:41.417567 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.417531    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29f2a99e-b149-4139-930c-13d6229f6cae-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b\" (UID: \"29f2a99e-b149-4139-930c-13d6229f6cae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"
Sep 11 13:15:41.418218 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.418163    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn7th\" (UniqueName: \"kubernetes.io/projected/29f2a99e-b149-4139-930c-13d6229f6cae-kube-api-access-rn7th\") pod \"payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b\" (UID: \"29f2a99e-b149-4139-930c-13d6229f6cae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"
Sep 11 13:15:41.519615 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.519569    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29f2a99e-b149-4139-930c-13d6229f6cae-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b\" (UID: \"29f2a99e-b149-4139-930c-13d6229f6cae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"
Sep 11 13:15:41.519812 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.519645    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn7th\" (UniqueName: \"kubernetes.io/projected/29f2a99e-b149-4139-930c-13d6229f6cae-kube-api-access-rn7th\") pod \"payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b\" (UID: \"29f2a99e-b149-4139-930c-13d6229f6cae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"
Sep 11 13:15:41.520384 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.520365    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29f2a99e-b149-4139-930c-13d6229f6cae-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b\" (UID: \"29f2a99e-b149-4139-930c-13d6229f6cae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"
Sep 11 13:15:41.528576 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.528553    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn7th\" (UniqueName: \"kubernetes.io/projected/29f2a99e-b149-4139-930c-13d6229f6cae-kube-api-access-rn7th\") pod \"payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b\" (UID: \"29f2a99e-b149-4139-930c-13d6229f6cae\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"
Sep 11 13:15:41.656524 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.656441    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"
Sep 11 13:15:41.932396 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:41.932372    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"]
Sep 11 13:15:41.935052 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:15:41.935018    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f2a99e_b149_4139_930c_13d6229f6cae.slice/crio-d0146969999c7ff9a8ce47dab1ea4d83f5ec0fe64cd2cd8e9c91a6ee02ef8ae0 WatchSource:0}: Error finding container d0146969999c7ff9a8ce47dab1ea4d83f5ec0fe64cd2cd8e9c91a6ee02ef8ae0: Status 404 returned error can't find the container with id d0146969999c7ff9a8ce47dab1ea4d83f5ec0fe64cd2cd8e9c91a6ee02ef8ae0
Sep 11 13:15:42.547049 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:42.547014    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b" event={"ID":"29f2a99e-b149-4139-930c-13d6229f6cae","Type":"ContainerStarted","Data":"900940f5784bf58073d50540c8f5bf3858274e1c338c505b540ee9e474fd7cbe"}
Sep 11 13:15:42.547469 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:42.547064    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b" event={"ID":"29f2a99e-b149-4139-930c-13d6229f6cae","Type":"ContainerStarted","Data":"d0146969999c7ff9a8ce47dab1ea4d83f5ec0fe64cd2cd8e9c91a6ee02ef8ae0"}
Sep 11 13:15:42.547469 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:42.547106    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"
Sep 11 13:15:53.554094 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:53.554064    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"
Sep 11 13:15:53.574753 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:53.574679    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b" podStartSLOduration=12.574662232 podStartE2EDuration="12.574662232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:15:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:15:42.565487995 +0000 UTC m=+1212.069352462" watchObservedRunningTime="2026-09-11 13:15:53.574662232 +0000 UTC m=+1223.078526665"
Sep 11 13:15:54.912947 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:15:54.912916    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:16:12.920871 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:12.920832    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:16:31.162359 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:31.162282    2547 scope.go:117] "RemoveContainer" containerID="7475169fb6c714ae0fd6d175e6c6e817eab900b16349c55ba852f6fdec8b2a19"
Sep 11 13:16:32.336252 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:32.336214    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:16:46.379515 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:46.379479    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr"]
Sep 11 13:16:46.379930 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:46.379855    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e" containerName="cleanup"
Sep 11 13:16:46.379930 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:46.379867    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e" containerName="cleanup"
Sep 11 13:16:46.380010 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:46.379936    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="db273ffa-2fd9-4376-a4b6-7f9cc7a3ad8e" containerName="cleanup"
Sep 11 13:16:46.384324 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:46.384304    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr"
Sep 11 13:16:46.386669 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:46.386651    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:16:46.386938 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:46.386924    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:16:46.396746 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:46.396703    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr"]
Sep 11 13:16:46.403886 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:46.403862    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faaeae1c-1391-428e-93ba-3c384c79bd1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr\" (UID: \"faaeae1c-1391-428e-93ba-3c384c79bd1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr"
Sep 11 13:16:46.505291 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:46.505246    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faaeae1c-1391-428e-93ba-3c384c79bd1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr\" (UID: \"faaeae1c-1391-428e-93ba-3c384c79bd1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr"
Sep 11 13:16:46.505948 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:46.505928    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faaeae1c-1391-428e-93ba-3c384c79bd1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr\" (UID: \"faaeae1c-1391-428e-93ba-3c384c79bd1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr"
Sep 11 13:16:46.694286 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:46.694197    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr"
Sep 11 13:16:46.977420 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:46.977394    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr"]
Sep 11 13:16:46.979363 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:16:46.979324    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaaeae1c_1391_428e_93ba_3c384c79bd1b.slice/crio-1774ce92d38bc0c538b4f7ff62a5bc463c55aa702e8e2fdf70f796785c557f82 WatchSource:0}: Error finding container 1774ce92d38bc0c538b4f7ff62a5bc463c55aa702e8e2fdf70f796785c557f82: Status 404 returned error can't find the container with id 1774ce92d38bc0c538b4f7ff62a5bc463c55aa702e8e2fdf70f796785c557f82
Sep 11 13:16:47.874784 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:47.874668    2547 generic.go:356] "Generic (PLEG): container finished" podID="faaeae1c-1391-428e-93ba-3c384c79bd1b" containerID="90f288976cac281211ccd125e91a6b820832f37e4cd957a6156d6f3bcadfbdd8" exitCode=0
Sep 11 13:16:47.874784 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:47.874745    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr" event={"ID":"faaeae1c-1391-428e-93ba-3c384c79bd1b","Type":"ContainerDied","Data":"90f288976cac281211ccd125e91a6b820832f37e4cd957a6156d6f3bcadfbdd8"}
Sep 11 13:16:47.875198 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:47.874826    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr" event={"ID":"faaeae1c-1391-428e-93ba-3c384c79bd1b","Type":"ContainerStarted","Data":"1774ce92d38bc0c538b4f7ff62a5bc463c55aa702e8e2fdf70f796785c557f82"}
Sep 11 13:16:49.018531 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:49.018504    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr"
Sep 11 13:16:49.040792 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:49.040761    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faaeae1c-1391-428e-93ba-3c384c79bd1b-maas-api-service-ca\") pod \"faaeae1c-1391-428e-93ba-3c384c79bd1b\" (UID: \"faaeae1c-1391-428e-93ba-3c384c79bd1b\") "
Sep 11 13:16:49.041098 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:49.041076    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faaeae1c-1391-428e-93ba-3c384c79bd1b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "faaeae1c-1391-428e-93ba-3c384c79bd1b" (UID: "faaeae1c-1391-428e-93ba-3c384c79bd1b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:16:49.142047 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:49.141957    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/faaeae1c-1391-428e-93ba-3c384c79bd1b-maas-api-service-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:16:49.885975 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:49.885946    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr"
Sep 11 13:16:49.885975 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:49.885964    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr" event={"ID":"faaeae1c-1391-428e-93ba-3c384c79bd1b","Type":"ContainerDied","Data":"1774ce92d38bc0c538b4f7ff62a5bc463c55aa702e8e2fdf70f796785c557f82"}
Sep 11 13:16:49.886196 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:49.886006    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1774ce92d38bc0c538b4f7ff62a5bc463c55aa702e8e2fdf70f796785c557f82"
Sep 11 13:16:50.969254 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:16:50.969213    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:17:00.131957 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.131920    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7781-9fe0bd"]
Sep 11 13:17:00.132369 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.132352    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faaeae1c-1391-428e-93ba-3c384c79bd1b" containerName="revoke-keys"
Sep 11 13:17:00.132415 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.132371    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="faaeae1c-1391-428e-93ba-3c384c79bd1b" containerName="revoke-keys"
Sep 11 13:17:00.132450 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.132443    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="faaeae1c-1391-428e-93ba-3c384c79bd1b" containerName="revoke-keys"
Sep 11 13:17:00.135366 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.135352    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-9fe0bd"
Sep 11 13:17:00.139405 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.139386    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-46lmf\""
Sep 11 13:17:00.159292 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.159261    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-9fe0bd"]
Sep 11 13:17:00.239985 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.239944    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqj8x\" (UniqueName: \"kubernetes.io/projected/546f5084-5d3c-49e3-9d29-084c2de2f4b6-kube-api-access-rqj8x\") pod \"test-curl-7781-9fe0bd\" (UID: \"546f5084-5d3c-49e3-9d29-084c2de2f4b6\") " pod="opendatahub/test-curl-7781-9fe0bd"
Sep 11 13:17:00.340528 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.340487    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqj8x\" (UniqueName: \"kubernetes.io/projected/546f5084-5d3c-49e3-9d29-084c2de2f4b6-kube-api-access-rqj8x\") pod \"test-curl-7781-9fe0bd\" (UID: \"546f5084-5d3c-49e3-9d29-084c2de2f4b6\") " pod="opendatahub/test-curl-7781-9fe0bd"
Sep 11 13:17:00.351590 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.351556    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqj8x\" (UniqueName: \"kubernetes.io/projected/546f5084-5d3c-49e3-9d29-084c2de2f4b6-kube-api-access-rqj8x\") pod \"test-curl-7781-9fe0bd\" (UID: \"546f5084-5d3c-49e3-9d29-084c2de2f4b6\") " pod="opendatahub/test-curl-7781-9fe0bd"
Sep 11 13:17:00.444643 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.444553    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-9fe0bd"
Sep 11 13:17:00.730089 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.730066    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7781-9fe0bd"]
Sep 11 13:17:00.732397 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:17:00.732358    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod546f5084_5d3c_49e3_9d29_084c2de2f4b6.slice/crio-ccbe29690a2e059bde624e05128b627a70fac1d4346c51bc45428847e5570536 WatchSource:0}: Error finding container ccbe29690a2e059bde624e05128b627a70fac1d4346c51bc45428847e5570536: Status 404 returned error can't find the container with id ccbe29690a2e059bde624e05128b627a70fac1d4346c51bc45428847e5570536
Sep 11 13:17:00.941144 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.941113    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-9fe0bd" event={"ID":"546f5084-5d3c-49e3-9d29-084c2de2f4b6","Type":"ContainerStarted","Data":"aa899795edc0c6aa860682359e6753dab7c42a75e3724b862ef2ae19a5289f04"}
Sep 11 13:17:00.941321 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.941153    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7781-9fe0bd" event={"ID":"546f5084-5d3c-49e3-9d29-084c2de2f4b6","Type":"ContainerStarted","Data":"ccbe29690a2e059bde624e05128b627a70fac1d4346c51bc45428847e5570536"}
Sep 11 13:17:00.971087 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:00.971030    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7781-9fe0bd" podStartSLOduration=0.971012182 podStartE2EDuration="971.012182ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:17:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:17:00.970273286 +0000 UTC m=+1290.474137678" watchObservedRunningTime="2026-09-11 13:17:00.971012182 +0000 UTC m=+1290.474876575"
Sep 11 13:17:01.788175 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:01.788140    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7781-9fe0bd"]
Sep 11 13:17:01.792346 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:01.792321    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7781-9fe0bd"]
Sep 11 13:17:01.946173 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:17:01.946146    2547 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7781-9fe0bd" container="test-curl-7781-9fe0bd"
Sep 11 13:17:02.659438 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:02.659404    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"]
Sep 11 13:17:02.950654 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:02.950549    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b" podUID="29f2a99e-b149-4139-930c-13d6229f6cae" containerName="payload-pre-processing" containerID="cri-o://900940f5784bf58073d50540c8f5bf3858274e1c338c505b540ee9e474fd7cbe" gracePeriod=30
Sep 11 13:17:02.950654 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:02.950580    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7781-9fe0bd" podUID="546f5084-5d3c-49e3-9d29-084c2de2f4b6" containerName="test-curl-7781-9fe0bd" containerID="cri-o://aa899795edc0c6aa860682359e6753dab7c42a75e3724b862ef2ae19a5289f04" gracePeriod=2
Sep 11 13:17:03.021327 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:17:03.021288    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7781-9fe0bd\" is forbidden: User \"system:node:ip-10-0-142-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-110.ec2.internal' and this object" podUID="546f5084-5d3c-49e3-9d29-084c2de2f4b6" pod="opendatahub/test-curl-7781-9fe0bd"
Sep 11 13:17:03.210504 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.210442    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"
Sep 11 13:17:03.266577 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.266544    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rn7th\" (UniqueName: \"kubernetes.io/projected/29f2a99e-b149-4139-930c-13d6229f6cae-kube-api-access-rn7th\") pod \"29f2a99e-b149-4139-930c-13d6229f6cae\" (UID: \"29f2a99e-b149-4139-930c-13d6229f6cae\") "
Sep 11 13:17:03.266756 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.266625    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29f2a99e-b149-4139-930c-13d6229f6cae-plugins-config-volume\") pod \"29f2a99e-b149-4139-930c-13d6229f6cae\" (UID: \"29f2a99e-b149-4139-930c-13d6229f6cae\") "
Sep 11 13:17:03.267059 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.267026    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f2a99e-b149-4139-930c-13d6229f6cae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "29f2a99e-b149-4139-930c-13d6229f6cae" (UID: "29f2a99e-b149-4139-930c-13d6229f6cae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:17:03.268622 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.268599    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f2a99e-b149-4139-930c-13d6229f6cae-kube-api-access-rn7th" (OuterVolumeSpecName: "kube-api-access-rn7th") pod "29f2a99e-b149-4139-930c-13d6229f6cae" (UID: "29f2a99e-b149-4139-930c-13d6229f6cae"). InnerVolumeSpecName "kube-api-access-rn7th". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:17:03.367938 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.367901    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/29f2a99e-b149-4139-930c-13d6229f6cae-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:17:03.367938 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.367931    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rn7th\" (UniqueName: \"kubernetes.io/projected/29f2a99e-b149-4139-930c-13d6229f6cae-kube-api-access-rn7th\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:17:03.703782 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.703747    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr"]
Sep 11 13:17:03.720632 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.720411    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-13b2e851-fw4vr"]
Sep 11 13:17:03.957365 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.957280    2547 generic.go:356] "Generic (PLEG): container finished" podID="29f2a99e-b149-4139-930c-13d6229f6cae" containerID="900940f5784bf58073d50540c8f5bf3858274e1c338c505b540ee9e474fd7cbe" exitCode=0
Sep 11 13:17:03.957365 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.957326    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b" event={"ID":"29f2a99e-b149-4139-930c-13d6229f6cae","Type":"ContainerDied","Data":"900940f5784bf58073d50540c8f5bf3858274e1c338c505b540ee9e474fd7cbe"}
Sep 11 13:17:03.957365 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.957337    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"
Sep 11 13:17:03.957910 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.957392    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b" event={"ID":"29f2a99e-b149-4139-930c-13d6229f6cae","Type":"ContainerDied","Data":"d0146969999c7ff9a8ce47dab1ea4d83f5ec0fe64cd2cd8e9c91a6ee02ef8ae0"}
Sep 11 13:17:03.957910 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.957413    2547 scope.go:117] "RemoveContainer" containerID="900940f5784bf58073d50540c8f5bf3858274e1c338c505b540ee9e474fd7cbe"
Sep 11 13:17:03.966194 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.966178    2547 scope.go:117] "RemoveContainer" containerID="900940f5784bf58073d50540c8f5bf3858274e1c338c505b540ee9e474fd7cbe"
Sep 11 13:17:03.966467 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:17:03.966447    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"900940f5784bf58073d50540c8f5bf3858274e1c338c505b540ee9e474fd7cbe\": container with ID starting with 900940f5784bf58073d50540c8f5bf3858274e1c338c505b540ee9e474fd7cbe not found: ID does not exist" containerID="900940f5784bf58073d50540c8f5bf3858274e1c338c505b540ee9e474fd7cbe"
Sep 11 13:17:03.966512 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.966474    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"900940f5784bf58073d50540c8f5bf3858274e1c338c505b540ee9e474fd7cbe"} err="failed to get container status \"900940f5784bf58073d50540c8f5bf3858274e1c338c505b540ee9e474fd7cbe\": rpc error: code = NotFound desc = could not find container \"900940f5784bf58073d50540c8f5bf3858274e1c338c505b540ee9e474fd7cbe\": container with ID starting with 900940f5784bf58073d50540c8f5bf3858274e1c338c505b540ee9e474fd7cbe not found: ID does not exist"
Sep 11 13:17:03.982654 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.982626    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"]
Sep 11 13:17:03.993151 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:03.993126    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-13b2e851-958b6698b-k762b"]
Sep 11 13:17:05.009063 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:05.009035    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29f2a99e-b149-4139-930c-13d6229f6cae" path="/var/lib/kubelet/pods/29f2a99e-b149-4139-930c-13d6229f6cae/volumes"
Sep 11 13:17:05.009409 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:05.009393    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faaeae1c-1391-428e-93ba-3c384c79bd1b" path="/var/lib/kubelet/pods/faaeae1c-1391-428e-93ba-3c384c79bd1b/volumes"
Sep 11 13:17:05.143425 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:05.143397    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-9fe0bd"
Sep 11 13:17:05.287134 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:05.287100    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqj8x\" (UniqueName: \"kubernetes.io/projected/546f5084-5d3c-49e3-9d29-084c2de2f4b6-kube-api-access-rqj8x\") pod \"546f5084-5d3c-49e3-9d29-084c2de2f4b6\" (UID: \"546f5084-5d3c-49e3-9d29-084c2de2f4b6\") "
Sep 11 13:17:05.289242 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:05.289217    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/546f5084-5d3c-49e3-9d29-084c2de2f4b6-kube-api-access-rqj8x" (OuterVolumeSpecName: "kube-api-access-rqj8x") pod "546f5084-5d3c-49e3-9d29-084c2de2f4b6" (UID: "546f5084-5d3c-49e3-9d29-084c2de2f4b6"). InnerVolumeSpecName "kube-api-access-rqj8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:17:05.387970 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:05.387931    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqj8x\" (UniqueName: \"kubernetes.io/projected/546f5084-5d3c-49e3-9d29-084c2de2f4b6-kube-api-access-rqj8x\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:17:05.969687 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:05.969656    2547 generic.go:356] "Generic (PLEG): container finished" podID="546f5084-5d3c-49e3-9d29-084c2de2f4b6" containerID="aa899795edc0c6aa860682359e6753dab7c42a75e3724b862ef2ae19a5289f04" exitCode=137
Sep 11 13:17:05.969860 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:05.969694    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7781-9fe0bd"
Sep 11 13:17:05.969860 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:05.969757    2547 scope.go:117] "RemoveContainer" containerID="aa899795edc0c6aa860682359e6753dab7c42a75e3724b862ef2ae19a5289f04"
Sep 11 13:17:05.978376 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:05.978360    2547 scope.go:117] "RemoveContainer" containerID="aa899795edc0c6aa860682359e6753dab7c42a75e3724b862ef2ae19a5289f04"
Sep 11 13:17:05.978656 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:17:05.978639    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa899795edc0c6aa860682359e6753dab7c42a75e3724b862ef2ae19a5289f04\": container with ID starting with aa899795edc0c6aa860682359e6753dab7c42a75e3724b862ef2ae19a5289f04 not found: ID does not exist" containerID="aa899795edc0c6aa860682359e6753dab7c42a75e3724b862ef2ae19a5289f04"
Sep 11 13:17:05.978774 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:05.978662    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa899795edc0c6aa860682359e6753dab7c42a75e3724b862ef2ae19a5289f04"} err="failed to get container status \"aa899795edc0c6aa860682359e6753dab7c42a75e3724b862ef2ae19a5289f04\": rpc error: code = NotFound desc = could not find container \"aa899795edc0c6aa860682359e6753dab7c42a75e3724b862ef2ae19a5289f04\": container with ID starting with aa899795edc0c6aa860682359e6753dab7c42a75e3724b862ef2ae19a5289f04 not found: ID does not exist"
Sep 11 13:17:05.984960 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:17:05.984936    2547 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7781-9fe0bd\" is forbidden: User \"system:node:ip-10-0-142-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-110.ec2.internal' and this object" podUID="546f5084-5d3c-49e3-9d29-084c2de2f4b6" pod="opendatahub/test-curl-7781-9fe0bd"
Sep 11 13:17:07.006602 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:07.006571    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="546f5084-5d3c-49e3-9d29-084c2de2f4b6" path="/var/lib/kubelet/pods/546f5084-5d3c-49e3-9d29-084c2de2f4b6/volumes"
Sep 11 13:17:11.371901 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:11.371869    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:17:24.937546 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:24.937509    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:17:48.185348 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:17:48.185312    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:18:11.653003 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:18:11.652956    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:18:30.365200 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:18:30.365163    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:18:40.938637 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:18:40.938597    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:18:48.364873 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:18:48.364833    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:19:12.113141 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:12.113099    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:19:13.632695 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.632660    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"]
Sep 11 13:19:13.633099 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.633057    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="546f5084-5d3c-49e3-9d29-084c2de2f4b6" containerName="test-curl-7781-9fe0bd"
Sep 11 13:19:13.633099 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.633069    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="546f5084-5d3c-49e3-9d29-084c2de2f4b6" containerName="test-curl-7781-9fe0bd"
Sep 11 13:19:13.633099 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.633088    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29f2a99e-b149-4139-930c-13d6229f6cae" containerName="payload-pre-processing"
Sep 11 13:19:13.633099 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.633095    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="29f2a99e-b149-4139-930c-13d6229f6cae" containerName="payload-pre-processing"
Sep 11 13:19:13.633231 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.633164    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="546f5084-5d3c-49e3-9d29-084c2de2f4b6" containerName="test-curl-7781-9fe0bd"
Sep 11 13:19:13.633231 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.633175    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="29f2a99e-b149-4139-930c-13d6229f6cae" containerName="payload-pre-processing"
Sep 11 13:19:13.636170 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.636153    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.640471 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.640448    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-82825f\"/\"openshift-service-ca.crt\""
Sep 11 13:19:13.641832 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.641811    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-82825f\"/\"rate-test-model-82825f-kserve-self-signed-certs\""
Sep 11 13:19:13.642055 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.641823    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-82825f\"/\"kube-root-ca.crt\""
Sep 11 13:19:13.642163 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.641857    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-82825f\"/\"default-dockercfg-c46j9\""
Sep 11 13:19:13.749178 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.749144    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-dshm\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.749178 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.749183    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ae794d9-8726-4296-a07c-eb91d0cb7050-tls-certs\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.749411 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.749212    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-home\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.749411 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.749261    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-tmp-dir\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.749411 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.749320    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-model-cache\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.749411 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.749351    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn8zd\" (UniqueName: \"kubernetes.io/projected/3ae794d9-8726-4296-a07c-eb91d0cb7050-kube-api-access-sn8zd\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.804728 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.804673    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"]
Sep 11 13:19:13.850080 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.850036    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-dshm\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.850080 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.850087    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ae794d9-8726-4296-a07c-eb91d0cb7050-tls-certs\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.850351 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.850123    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-home\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.850351 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.850143    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-tmp-dir\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.850351 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.850181    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-model-cache\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.850351 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.850219    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn8zd\" (UniqueName: \"kubernetes.io/projected/3ae794d9-8726-4296-a07c-eb91d0cb7050-kube-api-access-sn8zd\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.850572 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.850542    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-home\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.850625 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.850600    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-tmp-dir\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.850625 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.850616    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-model-cache\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.852420 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.852393    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-dshm\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.852636 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.852621    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ae794d9-8726-4296-a07c-eb91d0cb7050-tls-certs\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.892023 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.891950    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn8zd\" (UniqueName: \"kubernetes.io/projected/3ae794d9-8726-4296-a07c-eb91d0cb7050-kube-api-access-sn8zd\") pod \"rate-test-model-82825f-kserve-58b489bc67-xqskn\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") " pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:13.945739 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:13.945677    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:14.227968 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:14.227886    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"]
Sep 11 13:19:14.233361 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:19:14.233334    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ae794d9_8726_4296_a07c_eb91d0cb7050.slice/crio-421a3f110b38a8dc6600a6552003d4f546de91d11b6e0a2017769244715ad97b WatchSource:0}: Error finding container 421a3f110b38a8dc6600a6552003d4f546de91d11b6e0a2017769244715ad97b: Status 404 returned error can't find the container with id 421a3f110b38a8dc6600a6552003d4f546de91d11b6e0a2017769244715ad97b
Sep 11 13:19:14.598766 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:14.598704    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn" event={"ID":"3ae794d9-8726-4296-a07c-eb91d0cb7050","Type":"ContainerStarted","Data":"1baa766f2ae2b6c4e484d1d860024534c1a22bcc37657c9ee3e4f741f4998e4e"}
Sep 11 13:19:14.598972 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:14.598777    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn" event={"ID":"3ae794d9-8726-4296-a07c-eb91d0cb7050","Type":"ContainerStarted","Data":"421a3f110b38a8dc6600a6552003d4f546de91d11b6e0a2017769244715ad97b"}
Sep 11 13:19:14.637782 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:14.637709    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn" podStartSLOduration=1.637694143 podStartE2EDuration="1.637694143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:19:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:19:14.632513812 +0000 UTC m=+1424.136378205" watchObservedRunningTime="2026-09-11 13:19:14.637694143 +0000 UTC m=+1424.141558562"
Sep 11 13:19:23.946400 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:23.946306    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:23.946400 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:23.946368    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:23.959026 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:23.958999    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:24.658934 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:24.658902    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:19:26.128179 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:26.128143    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:19:30.912351 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:30.912318    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"]
Sep 11 13:19:30.915756 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:30.915734    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:30.924793 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:30.924774    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a3785d-openshift-default-dockercfg-tb2jf\""
Sep 11 13:19:30.953388 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:30.953358    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"]
Sep 11 13:19:31.014738 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.014657    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcd01438-8193-4cef-ade3-11d1172bde0b-istiod-ca-cert\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.014931 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.014743    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fld9j\" (UniqueName: \"kubernetes.io/projected/bcd01438-8193-4cef-ade3-11d1172bde0b-kube-api-access-fld9j\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.014931 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.014784    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-workload-certs\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.014931 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.014852    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-envoy\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.015109 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.014968    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-credential-socket\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.015109 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.015005    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-podinfo\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.015109 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.015083    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-workload-socket\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.015282 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.015116    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-data\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.015282 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.015140    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-token\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.116571 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.116529    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-credential-socket\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.116571 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.116571    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-podinfo\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.116864 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.116609    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-workload-socket\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.116864 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.116635    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-data\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.116864 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.116652    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-token\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.116864 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.116786    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcd01438-8193-4cef-ade3-11d1172bde0b-istiod-ca-cert\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.116864 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.116847    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fld9j\" (UniqueName: \"kubernetes.io/projected/bcd01438-8193-4cef-ade3-11d1172bde0b-kube-api-access-fld9j\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.117128 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.116877    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-workload-certs\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.117128 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.116915    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-envoy\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.117128 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.117001    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-credential-socket\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.117128 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.117037    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-workload-socket\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.117332 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.117256    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-workload-certs\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.117416 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.117353    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-data\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.117575 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.117555    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcd01438-8193-4cef-ade3-11d1172bde0b-istiod-ca-cert\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.119140 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.119119    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-envoy\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.119363 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.119344    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-podinfo\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.163564 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.163470    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fld9j\" (UniqueName: \"kubernetes.io/projected/bcd01438-8193-4cef-ade3-11d1172bde0b-kube-api-access-fld9j\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.201080 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.201051    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-token\") pod \"e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") " pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.207054 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.207021    2547 scope.go:117] "RemoveContainer" containerID="473d9b6b746e164a96cf0cbb31b215c23b44a9ba257ebdc0ee4b6420cf78bfcc"
Sep 11 13:19:31.226676 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.226649    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:31.695088 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:19:31.695055    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd01438_8193_4cef_ade3_11d1172bde0b.slice/crio-15ba40d5e15988874fd4b8bb278d9d12afff7c37a338506e4e1782a92eeb05f3 WatchSource:0}: Error finding container 15ba40d5e15988874fd4b8bb278d9d12afff7c37a338506e4e1782a92eeb05f3: Status 404 returned error can't find the container with id 15ba40d5e15988874fd4b8bb278d9d12afff7c37a338506e4e1782a92eeb05f3
Sep 11 13:19:31.697488 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.697447    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:19:31.697584 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.697543    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:19:31.697584 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.697581    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:19:31.700946 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:31.700925    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"]
Sep 11 13:19:32.690345 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:32.690308    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft" event={"ID":"bcd01438-8193-4cef-ade3-11d1172bde0b","Type":"ContainerStarted","Data":"fd2a46b628e98d67acad11a637bc635fb6b5873126edafcc935962b236e1fae7"}
Sep 11 13:19:32.690811 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:32.690359    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft" event={"ID":"bcd01438-8193-4cef-ade3-11d1172bde0b","Type":"ContainerStarted","Data":"15ba40d5e15988874fd4b8bb278d9d12afff7c37a338506e4e1782a92eeb05f3"}
Sep 11 13:19:32.726145 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:32.726090    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft" podStartSLOduration=2.726072926 podStartE2EDuration="2.726072926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:19:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:19:32.723708116 +0000 UTC m=+1442.227572532" watchObservedRunningTime="2026-09-11 13:19:32.726072926 +0000 UTC m=+1442.229937318"
Sep 11 13:19:33.227330 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:33.227291    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:33.232532 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:33.232506    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:33.695315 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:33.695289    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:33.696248 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:33.696230    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:44.010487 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:44.010447    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:19:53.809950 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:53.809914    2547 generic.go:356] "Generic (PLEG): container finished" podID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerID="fd2a46b628e98d67acad11a637bc635fb6b5873126edafcc935962b236e1fae7" exitCode=0
Sep 11 13:19:53.810377 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:53.809987    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft" event={"ID":"bcd01438-8193-4cef-ade3-11d1172bde0b","Type":"ContainerDied","Data":"fd2a46b628e98d67acad11a637bc635fb6b5873126edafcc935962b236e1fae7"}
Sep 11 13:19:53.810448 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:53.810433    2547 scope.go:117] "RemoveContainer" containerID="fd2a46b628e98d67acad11a637bc635fb6b5873126edafcc935962b236e1fae7"
Sep 11 13:19:53.811637 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:53.811607    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:19:53.811746 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:53.811675    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:19:53.811746 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:53.811705    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:19:54.817435 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:54.817402    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft" event={"ID":"bcd01438-8193-4cef-ade3-11d1172bde0b","Type":"ContainerStarted","Data":"1695b495b4384b326c3c8f54b2d58c2d0cb010b8c7c3a45fe5474b9d69b6faf9"}
Sep 11 13:19:55.227265 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:55.227169    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:19:55.227419 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:55.227385    2547 patch_prober.go:28] interesting pod/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 13:19:55.227478 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:55.227453    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft" podUID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 13:19:56.228087 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:56.228050    2547 patch_prober.go:28] interesting pod/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 13:19:56.228484 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:56.228110    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft" podUID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 13:19:57.227355 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:57.227317    2547 patch_prober.go:28] interesting pod/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 13:19:57.227535 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:57.227374    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft" podUID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 13:19:58.227354 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:58.227321    2547 patch_prober.go:28] interesting pod/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 13:19:58.227786 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:58.227373    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft" podUID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 13:19:59.227881 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:59.227842    2547 patch_prober.go:28] interesting pod/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 13:19:59.228272 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:59.227907    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft" podUID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 13:19:59.659611 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:19:59.659567    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:20:00.234253 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:00.234221    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:20:00.234783 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:00.234661    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:20:00.235684 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:00.235662    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:20:07.227349 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:07.227315    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"]
Sep 11 13:20:08.045365 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.045328    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"]
Sep 11 13:20:08.049010 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.048981    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.053247 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.053220    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-cc857f-openshift-default-dockercfg-52ct5\""
Sep 11 13:20:08.066682 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.066655    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"]
Sep 11 13:20:08.176970 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.176933    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-data\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.176970 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.176968    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-podinfo\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.177188 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.177001    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-workload-certs\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.177188 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.177087    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-envoy\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.177188 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.177120    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-workload-socket\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.177188 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.177167    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-token\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.177337 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.177206    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d2f4\" (UniqueName: \"kubernetes.io/projected/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-kube-api-access-4d2f4\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.177337 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.177228    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-credential-socket\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.177337 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.177282    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istiod-ca-cert\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.278210 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.278171    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-data\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.278210 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.278209    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-podinfo\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.278834 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.278237    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-workload-certs\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.278834 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.278268    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-envoy\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.278834 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.278287    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-workload-socket\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.278834 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.278310    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-token\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.278834 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.278334    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d2f4\" (UniqueName: \"kubernetes.io/projected/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-kube-api-access-4d2f4\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.278834 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.278449    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-credential-socket\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.278834 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.278507    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istiod-ca-cert\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.278834 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.278653    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-data\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.278834 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.278710    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-workload-certs\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.278834 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.278796    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-workload-socket\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.279252 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.278935    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-credential-socket\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.279292 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.279269    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istiod-ca-cert\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.280691 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.280672    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-envoy\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.280938 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.280920    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-podinfo\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.287689 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.287664    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-token\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.287847 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.287805    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d2f4\" (UniqueName: \"kubernetes.io/projected/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-kube-api-access-4d2f4\") pod \"e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") " pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.361048 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.360956    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:08.650082 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.650004    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"]
Sep 11 13:20:08.653617 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:20:08.653590    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a35c0bf_f9b5_449e_ac48_f68dd7dfe713.slice/crio-8c1980e717ac7b2e65e41ecaf40730e1ac39c716ae2e6bfd71a080ebb1b89850 WatchSource:0}: Error finding container 8c1980e717ac7b2e65e41ecaf40730e1ac39c716ae2e6bfd71a080ebb1b89850: Status 404 returned error can't find the container with id 8c1980e717ac7b2e65e41ecaf40730e1ac39c716ae2e6bfd71a080ebb1b89850
Sep 11 13:20:08.656050 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.656020    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:20:08.656132 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.656086    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:20:08.656132 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.656114    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:20:08.889554 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.889504    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" event={"ID":"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713","Type":"ContainerStarted","Data":"003202e3124b877b0bca34895580e3bb49868170a35d11811e92ae160783c72c"}
Sep 11 13:20:08.889775 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.889609    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" event={"ID":"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713","Type":"ContainerStarted","Data":"8c1980e717ac7b2e65e41ecaf40730e1ac39c716ae2e6bfd71a080ebb1b89850"}
Sep 11 13:20:08.920457 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:08.920340    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" podStartSLOduration=0.920324204 podStartE2EDuration="920.324204ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:20:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:20:08.917861583 +0000 UTC m=+1478.421725975" watchObservedRunningTime="2026-09-11 13:20:08.920324204 +0000 UTC m=+1478.424188596"
Sep 11 13:20:09.361264 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:09.361226    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:09.362749 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:09.362704    2547 patch_prober.go:28] interesting pod/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 13:20:09.362880 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:09.362779    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 13:20:10.365566 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:10.365487    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:10.900201 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:10.900169    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:10.901113 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:10.901090    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:20.280573 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:20.280531    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:20:22.246483 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.246438    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn" podUID="3ae794d9-8726-4296-a07c-eb91d0cb7050" containerName="main" containerID="cri-o://1baa766f2ae2b6c4e484d1d860024534c1a22bcc37657c9ee3e4f741f4998e4e" gracePeriod=45
Sep 11 13:20:22.497061 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.496994    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:20:22.520096 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.520063    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-home\") pod \"3ae794d9-8726-4296-a07c-eb91d0cb7050\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") "
Sep 11 13:20:22.520258 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.520109    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-dshm\") pod \"3ae794d9-8726-4296-a07c-eb91d0cb7050\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") "
Sep 11 13:20:22.520258 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.520171    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sn8zd\" (UniqueName: \"kubernetes.io/projected/3ae794d9-8726-4296-a07c-eb91d0cb7050-kube-api-access-sn8zd\") pod \"3ae794d9-8726-4296-a07c-eb91d0cb7050\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") "
Sep 11 13:20:22.520258 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.520239    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-model-cache\") pod \"3ae794d9-8726-4296-a07c-eb91d0cb7050\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") "
Sep 11 13:20:22.520429 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.520284    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-tmp-dir\") pod \"3ae794d9-8726-4296-a07c-eb91d0cb7050\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") "
Sep 11 13:20:22.520429 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.520320    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ae794d9-8726-4296-a07c-eb91d0cb7050-tls-certs\") pod \"3ae794d9-8726-4296-a07c-eb91d0cb7050\" (UID: \"3ae794d9-8726-4296-a07c-eb91d0cb7050\") "
Sep 11 13:20:22.520429 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.520377    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-home" (OuterVolumeSpecName: "home") pod "3ae794d9-8726-4296-a07c-eb91d0cb7050" (UID: "3ae794d9-8726-4296-a07c-eb91d0cb7050"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:22.520592 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.520512    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-model-cache" (OuterVolumeSpecName: "model-cache") pod "3ae794d9-8726-4296-a07c-eb91d0cb7050" (UID: "3ae794d9-8726-4296-a07c-eb91d0cb7050"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:22.520592 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.520544    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3ae794d9-8726-4296-a07c-eb91d0cb7050" (UID: "3ae794d9-8726-4296-a07c-eb91d0cb7050"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:22.520678 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.520641    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-model-cache\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:20:22.520678 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.520656    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-tmp-dir\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:20:22.520678 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.520664    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-home\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:20:22.522493 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.522466    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ae794d9-8726-4296-a07c-eb91d0cb7050-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3ae794d9-8726-4296-a07c-eb91d0cb7050" (UID: "3ae794d9-8726-4296-a07c-eb91d0cb7050"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:20:22.522586 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.522538    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-dshm" (OuterVolumeSpecName: "dshm") pod "3ae794d9-8726-4296-a07c-eb91d0cb7050" (UID: "3ae794d9-8726-4296-a07c-eb91d0cb7050"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:20:22.522586 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.522550    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ae794d9-8726-4296-a07c-eb91d0cb7050-kube-api-access-sn8zd" (OuterVolumeSpecName: "kube-api-access-sn8zd") pod "3ae794d9-8726-4296-a07c-eb91d0cb7050" (UID: "3ae794d9-8726-4296-a07c-eb91d0cb7050"). InnerVolumeSpecName "kube-api-access-sn8zd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:20:22.621372 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.621330    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ae794d9-8726-4296-a07c-eb91d0cb7050-tls-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:20:22.621372 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.621363    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ae794d9-8726-4296-a07c-eb91d0cb7050-dshm\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:20:22.621372 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.621376    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sn8zd\" (UniqueName: \"kubernetes.io/projected/3ae794d9-8726-4296-a07c-eb91d0cb7050-kube-api-access-sn8zd\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:20:22.961652 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.961618    2547 generic.go:356] "Generic (PLEG): container finished" podID="3ae794d9-8726-4296-a07c-eb91d0cb7050" containerID="1baa766f2ae2b6c4e484d1d860024534c1a22bcc37657c9ee3e4f741f4998e4e" exitCode=0
Sep 11 13:20:22.961866 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.961663    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"
Sep 11 13:20:22.961866 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.961703    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn" event={"ID":"3ae794d9-8726-4296-a07c-eb91d0cb7050","Type":"ContainerDied","Data":"1baa766f2ae2b6c4e484d1d860024534c1a22bcc37657c9ee3e4f741f4998e4e"}
Sep 11 13:20:22.961866 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.961777    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn" event={"ID":"3ae794d9-8726-4296-a07c-eb91d0cb7050","Type":"ContainerDied","Data":"421a3f110b38a8dc6600a6552003d4f546de91d11b6e0a2017769244715ad97b"}
Sep 11 13:20:22.961866 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.961796    2547 scope.go:117] "RemoveContainer" containerID="1baa766f2ae2b6c4e484d1d860024534c1a22bcc37657c9ee3e4f741f4998e4e"
Sep 11 13:20:22.971316 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.971295    2547 scope.go:117] "RemoveContainer" containerID="1baa766f2ae2b6c4e484d1d860024534c1a22bcc37657c9ee3e4f741f4998e4e"
Sep 11 13:20:22.971584 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:20:22.971565    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1baa766f2ae2b6c4e484d1d860024534c1a22bcc37657c9ee3e4f741f4998e4e\": container with ID starting with 1baa766f2ae2b6c4e484d1d860024534c1a22bcc37657c9ee3e4f741f4998e4e not found: ID does not exist" containerID="1baa766f2ae2b6c4e484d1d860024534c1a22bcc37657c9ee3e4f741f4998e4e"
Sep 11 13:20:22.971637 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.971592    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1baa766f2ae2b6c4e484d1d860024534c1a22bcc37657c9ee3e4f741f4998e4e"} err="failed to get container status \"1baa766f2ae2b6c4e484d1d860024534c1a22bcc37657c9ee3e4f741f4998e4e\": rpc error: code = NotFound desc = could not find container \"1baa766f2ae2b6c4e484d1d860024534c1a22bcc37657c9ee3e4f741f4998e4e\": container with ID starting with 1baa766f2ae2b6c4e484d1d860024534c1a22bcc37657c9ee3e4f741f4998e4e not found: ID does not exist"
Sep 11 13:20:22.996114 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.996080    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"]
Sep 11 13:20:22.999189 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:22.999154    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-82825f/rate-test-model-82825f-kserve-58b489bc67-xqskn"]
Sep 11 13:20:23.007425 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:23.007394    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ae794d9-8726-4296-a07c-eb91d0cb7050" path="/var/lib/kubelet/pods/3ae794d9-8726-4296-a07c-eb91d0cb7050/volumes"
Sep 11 13:20:31.226500 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:31.226467    2547 scope.go:117] "RemoveContainer" containerID="6f1e079eb1c5088b1044f3ce7121bfc1d3cac8ad47cf65fa95e1693dd740e2fc"
Sep 11 13:20:32.556506 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:32.556467    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:20:37.031944 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:37.031912    2547 generic.go:356] "Generic (PLEG): container finished" podID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerID="003202e3124b877b0bca34895580e3bb49868170a35d11811e92ae160783c72c" exitCode=0
Sep 11 13:20:37.032363 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:37.031949    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" event={"ID":"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713","Type":"ContainerDied","Data":"003202e3124b877b0bca34895580e3bb49868170a35d11811e92ae160783c72c"}
Sep 11 13:20:37.032363 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:37.032359    2547 scope.go:117] "RemoveContainer" containerID="003202e3124b877b0bca34895580e3bb49868170a35d11811e92ae160783c72c"
Sep 11 13:20:37.033605 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:37.033577    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:20:37.033662 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:37.033647    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:20:37.033701 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:37.033693    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:20:38.039164 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:38.039128    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" event={"ID":"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713","Type":"ContainerStarted","Data":"36edf0da85e276ba9939304ecfaed2001d16506bdc9533cc4223d998ca8e798f"}
Sep 11 13:20:38.362853 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:38.362754    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:38.363291 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:38.363263    2547 patch_prober.go:28] interesting pod/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 13:20:38.363489 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:38.363464    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 13:20:39.362348 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:39.361888    2547 patch_prober.go:28] interesting pod/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 13:20:39.362348 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:39.361952    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 13:20:40.362055 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:40.361561    2547 patch_prober.go:28] interesting pod/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 13:20:40.362055 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:40.361646    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 13:20:40.900905 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:40.900860    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:41.361816 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:41.361774    2547 patch_prober.go:28] interesting pod/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 13:20:41.362039 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:41.361839    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 13:20:42.362210 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:42.362167    2547 patch_prober.go:28] interesting pod/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 13:20:42.362745 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:42.362242    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 13:20:43.361582 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:43.361548    2547 patch_prober.go:28] interesting pod/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 13:20:43.361792 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:43.361614    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 13:20:44.366138 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:44.366108    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:44.367068 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:44.367051    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:20:49.570866 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:20:49.570817    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:21:01.433727 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:01.433636    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"]
Sep 11 13:21:01.434249 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:01.433867    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft" podUID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerName="istio-proxy" containerID="cri-o://1695b495b4384b326c3c8f54b2d58c2d0cb010b8c7c3a45fe5474b9d69b6faf9" gracePeriod=30
Sep 11 13:21:06.695458 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.695393    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:21:06.856921 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.856883    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcd01438-8193-4cef-ade3-11d1172bde0b-istiod-ca-cert\") pod \"bcd01438-8193-4cef-ade3-11d1172bde0b\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") "
Sep 11 13:21:06.857090 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.856954    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-data\") pod \"bcd01438-8193-4cef-ade3-11d1172bde0b\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") "
Sep 11 13:21:06.857090 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857048    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-token\") pod \"bcd01438-8193-4cef-ade3-11d1172bde0b\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") "
Sep 11 13:21:06.857090 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857077    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-envoy\") pod \"bcd01438-8193-4cef-ade3-11d1172bde0b\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") "
Sep 11 13:21:06.857253 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857117    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-workload-certs\") pod \"bcd01438-8193-4cef-ade3-11d1172bde0b\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") "
Sep 11 13:21:06.857253 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857159    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-podinfo\") pod \"bcd01438-8193-4cef-ade3-11d1172bde0b\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") "
Sep 11 13:21:06.857253 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857210    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-credential-socket\") pod \"bcd01438-8193-4cef-ade3-11d1172bde0b\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") "
Sep 11 13:21:06.857253 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857227    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-data" (OuterVolumeSpecName: "istio-data") pod "bcd01438-8193-4cef-ade3-11d1172bde0b" (UID: "bcd01438-8193-4cef-ade3-11d1172bde0b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:06.857253 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857237    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-workload-socket\") pod \"bcd01438-8193-4cef-ade3-11d1172bde0b\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") "
Sep 11 13:21:06.857514 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857248    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcd01438-8193-4cef-ade3-11d1172bde0b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bcd01438-8193-4cef-ade3-11d1172bde0b" (UID: "bcd01438-8193-4cef-ade3-11d1172bde0b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:21:06.857514 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857294    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fld9j\" (UniqueName: \"kubernetes.io/projected/bcd01438-8193-4cef-ade3-11d1172bde0b-kube-api-access-fld9j\") pod \"bcd01438-8193-4cef-ade3-11d1172bde0b\" (UID: \"bcd01438-8193-4cef-ade3-11d1172bde0b\") "
Sep 11 13:21:06.857514 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857492    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bcd01438-8193-4cef-ade3-11d1172bde0b" (UID: "bcd01438-8193-4cef-ade3-11d1172bde0b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:06.857514 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857508    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bcd01438-8193-4cef-ade3-11d1172bde0b" (UID: "bcd01438-8193-4cef-ade3-11d1172bde0b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:06.857750 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857609    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bcd01438-8193-4cef-ade3-11d1172bde0b" (UID: "bcd01438-8193-4cef-ade3-11d1172bde0b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:06.857750 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857739    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:06.857908 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857760    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:06.857908 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857775    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:06.857908 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857790    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bcd01438-8193-4cef-ade3-11d1172bde0b-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:06.857908 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.857802    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:06.859463 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.859436    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcd01438-8193-4cef-ade3-11d1172bde0b-kube-api-access-fld9j" (OuterVolumeSpecName: "kube-api-access-fld9j") pod "bcd01438-8193-4cef-ade3-11d1172bde0b" (UID: "bcd01438-8193-4cef-ade3-11d1172bde0b"). InnerVolumeSpecName "kube-api-access-fld9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:21:06.859564 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.859440    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bcd01438-8193-4cef-ade3-11d1172bde0b" (UID: "bcd01438-8193-4cef-ade3-11d1172bde0b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:06.859754 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.859732    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-token" (OuterVolumeSpecName: "istio-token") pod "bcd01438-8193-4cef-ade3-11d1172bde0b" (UID: "bcd01438-8193-4cef-ade3-11d1172bde0b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:21:06.859867 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.859846    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bcd01438-8193-4cef-ade3-11d1172bde0b" (UID: "bcd01438-8193-4cef-ade3-11d1172bde0b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:21:06.958660 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.958561    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:06.958660 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.958603    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:06.958660 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.958613    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bcd01438-8193-4cef-ade3-11d1172bde0b-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:06.958660 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:06.958621    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fld9j\" (UniqueName: \"kubernetes.io/projected/bcd01438-8193-4cef-ade3-11d1172bde0b-kube-api-access-fld9j\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:07.017920 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:07.017885    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:21:07.196050 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:07.196019    2547 generic.go:356] "Generic (PLEG): container finished" podID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerID="1695b495b4384b326c3c8f54b2d58c2d0cb010b8c7c3a45fe5474b9d69b6faf9" exitCode=0
Sep 11 13:21:07.196221 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:07.196076    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"
Sep 11 13:21:07.196221 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:07.196080    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft" event={"ID":"bcd01438-8193-4cef-ade3-11d1172bde0b","Type":"ContainerDied","Data":"1695b495b4384b326c3c8f54b2d58c2d0cb010b8c7c3a45fe5474b9d69b6faf9"}
Sep 11 13:21:07.196360 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:07.196217    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft" event={"ID":"bcd01438-8193-4cef-ade3-11d1172bde0b","Type":"ContainerDied","Data":"15ba40d5e15988874fd4b8bb278d9d12afff7c37a338506e4e1782a92eeb05f3"}
Sep 11 13:21:07.196360 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:07.196250    2547 scope.go:117] "RemoveContainer" containerID="1695b495b4384b326c3c8f54b2d58c2d0cb010b8c7c3a45fe5474b9d69b6faf9"
Sep 11 13:21:07.205319 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:07.205301    2547 scope.go:117] "RemoveContainer" containerID="fd2a46b628e98d67acad11a637bc635fb6b5873126edafcc935962b236e1fae7"
Sep 11 13:21:07.213509 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:07.213493    2547 scope.go:117] "RemoveContainer" containerID="1695b495b4384b326c3c8f54b2d58c2d0cb010b8c7c3a45fe5474b9d69b6faf9"
Sep 11 13:21:07.213811 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:21:07.213792    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1695b495b4384b326c3c8f54b2d58c2d0cb010b8c7c3a45fe5474b9d69b6faf9\": container with ID starting with 1695b495b4384b326c3c8f54b2d58c2d0cb010b8c7c3a45fe5474b9d69b6faf9 not found: ID does not exist" containerID="1695b495b4384b326c3c8f54b2d58c2d0cb010b8c7c3a45fe5474b9d69b6faf9"
Sep 11 13:21:07.213870 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:07.213820    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1695b495b4384b326c3c8f54b2d58c2d0cb010b8c7c3a45fe5474b9d69b6faf9"} err="failed to get container status \"1695b495b4384b326c3c8f54b2d58c2d0cb010b8c7c3a45fe5474b9d69b6faf9\": rpc error: code = NotFound desc = could not find container \"1695b495b4384b326c3c8f54b2d58c2d0cb010b8c7c3a45fe5474b9d69b6faf9\": container with ID starting with 1695b495b4384b326c3c8f54b2d58c2d0cb010b8c7c3a45fe5474b9d69b6faf9 not found: ID does not exist"
Sep 11 13:21:07.213870 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:07.213838    2547 scope.go:117] "RemoveContainer" containerID="fd2a46b628e98d67acad11a637bc635fb6b5873126edafcc935962b236e1fae7"
Sep 11 13:21:07.214100 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:21:07.214083    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd2a46b628e98d67acad11a637bc635fb6b5873126edafcc935962b236e1fae7\": container with ID starting with fd2a46b628e98d67acad11a637bc635fb6b5873126edafcc935962b236e1fae7 not found: ID does not exist" containerID="fd2a46b628e98d67acad11a637bc635fb6b5873126edafcc935962b236e1fae7"
Sep 11 13:21:07.214142 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:07.214106    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2a46b628e98d67acad11a637bc635fb6b5873126edafcc935962b236e1fae7"} err="failed to get container status \"fd2a46b628e98d67acad11a637bc635fb6b5873126edafcc935962b236e1fae7\": rpc error: code = NotFound desc = could not find container \"fd2a46b628e98d67acad11a637bc635fb6b5873126edafcc935962b236e1fae7\": container with ID starting with fd2a46b628e98d67acad11a637bc635fb6b5873126edafcc935962b236e1fae7 not found: ID does not exist"
Sep 11 13:21:07.219341 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:07.219318    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"]
Sep 11 13:21:07.228609 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:07.228584    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a3785d-openshift-default-948cbd4cd-v8cft"]
Sep 11 13:21:09.007362 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:09.007328    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcd01438-8193-4cef-ade3-11d1172bde0b" path="/var/lib/kubelet/pods/bcd01438-8193-4cef-ade3-11d1172bde0b/volumes"
Sep 11 13:21:12.927554 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:12.927514    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"]
Sep 11 13:21:12.927999 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:12.927770    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs" podUID="b2d6b948-f096-42a9-89db-bd4c0560ce8d" containerName="payload-processing" containerID="cri-o://016aa5fa168cf09d4982832a507a585f824755ec304b4e7ff42355c9318e4620" gracePeriod=30
Sep 11 13:21:12.934656 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:12.934602    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"]
Sep 11 13:21:12.934920 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:12.934870    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh" podUID="5511bc14-d882-4576-8e07-611611e67c29" containerName="payload-pre-processing" containerID="cri-o://dceace8551bacc2a7c2076f49095917f6e705e62c474205a251babc5225b5e22" gracePeriod=30
Sep 11 13:21:13.193812 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.193786    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"
Sep 11 13:21:13.218865 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.218709    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d6b948-f096-42a9-89db-bd4c0560ce8d-plugins-config-volume\") pod \"b2d6b948-f096-42a9-89db-bd4c0560ce8d\" (UID: \"b2d6b948-f096-42a9-89db-bd4c0560ce8d\") "
Sep 11 13:21:13.218865 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.218792    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kd4p\" (UniqueName: \"kubernetes.io/projected/b2d6b948-f096-42a9-89db-bd4c0560ce8d-kube-api-access-2kd4p\") pod \"b2d6b948-f096-42a9-89db-bd4c0560ce8d\" (UID: \"b2d6b948-f096-42a9-89db-bd4c0560ce8d\") "
Sep 11 13:21:13.219113 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.219085    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2d6b948-f096-42a9-89db-bd4c0560ce8d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b2d6b948-f096-42a9-89db-bd4c0560ce8d" (UID: "b2d6b948-f096-42a9-89db-bd4c0560ce8d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:21:13.219232 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.219215    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b2d6b948-f096-42a9-89db-bd4c0560ce8d-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:13.221495 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.221457    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2d6b948-f096-42a9-89db-bd4c0560ce8d-kube-api-access-2kd4p" (OuterVolumeSpecName: "kube-api-access-2kd4p") pod "b2d6b948-f096-42a9-89db-bd4c0560ce8d" (UID: "b2d6b948-f096-42a9-89db-bd4c0560ce8d"). InnerVolumeSpecName "kube-api-access-2kd4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:21:13.222069 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.222049    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"
Sep 11 13:21:13.232342 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.232309    2547 generic.go:356] "Generic (PLEG): container finished" podID="b2d6b948-f096-42a9-89db-bd4c0560ce8d" containerID="016aa5fa168cf09d4982832a507a585f824755ec304b4e7ff42355c9318e4620" exitCode=0
Sep 11 13:21:13.232482 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.232348    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"
Sep 11 13:21:13.232482 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.232393    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs" event={"ID":"b2d6b948-f096-42a9-89db-bd4c0560ce8d","Type":"ContainerDied","Data":"016aa5fa168cf09d4982832a507a585f824755ec304b4e7ff42355c9318e4620"}
Sep 11 13:21:13.232482 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.232447    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs" event={"ID":"b2d6b948-f096-42a9-89db-bd4c0560ce8d","Type":"ContainerDied","Data":"582b9b12a72ee0f94f3a656592314b4afbcde84a81564bb359dc7ce18f5b4a9c"}
Sep 11 13:21:13.232482 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.232471    2547 scope.go:117] "RemoveContainer" containerID="016aa5fa168cf09d4982832a507a585f824755ec304b4e7ff42355c9318e4620"
Sep 11 13:21:13.233705 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.233688    2547 generic.go:356] "Generic (PLEG): container finished" podID="5511bc14-d882-4576-8e07-611611e67c29" containerID="dceace8551bacc2a7c2076f49095917f6e705e62c474205a251babc5225b5e22" exitCode=0
Sep 11 13:21:13.233839 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.233766    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"
Sep 11 13:21:13.233839 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.233820    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh" event={"ID":"5511bc14-d882-4576-8e07-611611e67c29","Type":"ContainerDied","Data":"dceace8551bacc2a7c2076f49095917f6e705e62c474205a251babc5225b5e22"}
Sep 11 13:21:13.233967 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.233872    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh" event={"ID":"5511bc14-d882-4576-8e07-611611e67c29","Type":"ContainerDied","Data":"9f6b7f8315ff1ed59892a34b317b128301228899f3fdc65470c690485de512f8"}
Sep 11 13:21:13.249098 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.248801    2547 scope.go:117] "RemoveContainer" containerID="016aa5fa168cf09d4982832a507a585f824755ec304b4e7ff42355c9318e4620"
Sep 11 13:21:13.249376 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:21:13.249318    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"016aa5fa168cf09d4982832a507a585f824755ec304b4e7ff42355c9318e4620\": container with ID starting with 016aa5fa168cf09d4982832a507a585f824755ec304b4e7ff42355c9318e4620 not found: ID does not exist" containerID="016aa5fa168cf09d4982832a507a585f824755ec304b4e7ff42355c9318e4620"
Sep 11 13:21:13.249464 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.249380    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"016aa5fa168cf09d4982832a507a585f824755ec304b4e7ff42355c9318e4620"} err="failed to get container status \"016aa5fa168cf09d4982832a507a585f824755ec304b4e7ff42355c9318e4620\": rpc error: code = NotFound desc = could not find container \"016aa5fa168cf09d4982832a507a585f824755ec304b4e7ff42355c9318e4620\": container with ID starting with 016aa5fa168cf09d4982832a507a585f824755ec304b4e7ff42355c9318e4620 not found: ID does not exist"
Sep 11 13:21:13.249464 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.249409    2547 scope.go:117] "RemoveContainer" containerID="dceace8551bacc2a7c2076f49095917f6e705e62c474205a251babc5225b5e22"
Sep 11 13:21:13.277906 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.277786    2547 scope.go:117] "RemoveContainer" containerID="dceace8551bacc2a7c2076f49095917f6e705e62c474205a251babc5225b5e22"
Sep 11 13:21:13.278528 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:21:13.278488    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dceace8551bacc2a7c2076f49095917f6e705e62c474205a251babc5225b5e22\": container with ID starting with dceace8551bacc2a7c2076f49095917f6e705e62c474205a251babc5225b5e22 not found: ID does not exist" containerID="dceace8551bacc2a7c2076f49095917f6e705e62c474205a251babc5225b5e22"
Sep 11 13:21:13.278754 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.278692    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dceace8551bacc2a7c2076f49095917f6e705e62c474205a251babc5225b5e22"} err="failed to get container status \"dceace8551bacc2a7c2076f49095917f6e705e62c474205a251babc5225b5e22\": rpc error: code = NotFound desc = could not find container \"dceace8551bacc2a7c2076f49095917f6e705e62c474205a251babc5225b5e22\": container with ID starting with dceace8551bacc2a7c2076f49095917f6e705e62c474205a251babc5225b5e22 not found: ID does not exist"
Sep 11 13:21:13.290135 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.290098    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"]
Sep 11 13:21:13.298623 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.298593    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-4d7bb0-8666854bc-vvwxs"]
Sep 11 13:21:13.320054 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.320025    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5511bc14-d882-4576-8e07-611611e67c29-plugins-config-volume\") pod \"5511bc14-d882-4576-8e07-611611e67c29\" (UID: \"5511bc14-d882-4576-8e07-611611e67c29\") "
Sep 11 13:21:13.320231 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.320061    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkx28\" (UniqueName: \"kubernetes.io/projected/5511bc14-d882-4576-8e07-611611e67c29-kube-api-access-lkx28\") pod \"5511bc14-d882-4576-8e07-611611e67c29\" (UID: \"5511bc14-d882-4576-8e07-611611e67c29\") "
Sep 11 13:21:13.320327 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.320305    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kd4p\" (UniqueName: \"kubernetes.io/projected/b2d6b948-f096-42a9-89db-bd4c0560ce8d-kube-api-access-2kd4p\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:13.320440 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.320422    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5511bc14-d882-4576-8e07-611611e67c29-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5511bc14-d882-4576-8e07-611611e67c29" (UID: "5511bc14-d882-4576-8e07-611611e67c29"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:21:13.322250 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.322228    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5511bc14-d882-4576-8e07-611611e67c29-kube-api-access-lkx28" (OuterVolumeSpecName: "kube-api-access-lkx28") pod "5511bc14-d882-4576-8e07-611611e67c29" (UID: "5511bc14-d882-4576-8e07-611611e67c29"). InnerVolumeSpecName "kube-api-access-lkx28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:21:13.421078 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.421042    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5511bc14-d882-4576-8e07-611611e67c29-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:13.421078 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.421073    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkx28\" (UniqueName: \"kubernetes.io/projected/5511bc14-d882-4576-8e07-611611e67c29-kube-api-access-lkx28\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:13.558004 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.557971    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"]
Sep 11 13:21:13.566116 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:13.566091    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-4d7bb0-8458cfc74b-xwtrh"]
Sep 11 13:21:15.006964 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:15.006930    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5511bc14-d882-4576-8e07-611611e67c29" path="/var/lib/kubelet/pods/5511bc14-d882-4576-8e07-611611e67c29/volumes"
Sep 11 13:21:15.007356 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:15.007311    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2d6b948-f096-42a9-89db-bd4c0560ce8d" path="/var/lib/kubelet/pods/b2d6b948-f096-42a9-89db-bd4c0560ce8d/volumes"
Sep 11 13:21:17.700631 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:17.700587    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:21:20.453874 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.453839    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"]
Sep 11 13:21:20.454376 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454356    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerName="istio-proxy"
Sep 11 13:21:20.454463 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454380    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerName="istio-proxy"
Sep 11 13:21:20.454463 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454393    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerName="istio-proxy"
Sep 11 13:21:20.454463 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454403    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerName="istio-proxy"
Sep 11 13:21:20.454463 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454430    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ae794d9-8726-4296-a07c-eb91d0cb7050" containerName="main"
Sep 11 13:21:20.454463 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454438    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ae794d9-8726-4296-a07c-eb91d0cb7050" containerName="main"
Sep 11 13:21:20.454463 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454462    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2d6b948-f096-42a9-89db-bd4c0560ce8d" containerName="payload-processing"
Sep 11 13:21:20.454803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454471    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2d6b948-f096-42a9-89db-bd4c0560ce8d" containerName="payload-processing"
Sep 11 13:21:20.454803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454483    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5511bc14-d882-4576-8e07-611611e67c29" containerName="payload-pre-processing"
Sep 11 13:21:20.454803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454492    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5511bc14-d882-4576-8e07-611611e67c29" containerName="payload-pre-processing"
Sep 11 13:21:20.454803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454587    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ae794d9-8726-4296-a07c-eb91d0cb7050" containerName="main"
Sep 11 13:21:20.454803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454599    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerName="istio-proxy"
Sep 11 13:21:20.454803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454609    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5511bc14-d882-4576-8e07-611611e67c29" containerName="payload-pre-processing"
Sep 11 13:21:20.454803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454621    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2d6b948-f096-42a9-89db-bd4c0560ce8d" containerName="payload-processing"
Sep 11 13:21:20.454803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.454630    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcd01438-8193-4cef-ade3-11d1172bde0b" containerName="istio-proxy"
Sep 11 13:21:20.459282 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.459259    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.463209 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.463187    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-cc857f\"/\"default-dockercfg-wkz79\""
Sep 11 13:21:20.463990 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.463966    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-cc857f\"/\"ipp-route-cc857f-kserve-self-signed-certs\""
Sep 11 13:21:20.463990 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.463982    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-cc857f\"/\"kube-root-ca.crt\""
Sep 11 13:21:20.464506 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.464490    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-cc857f\"/\"openshift-service-ca.crt\""
Sep 11 13:21:20.479039 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.479005    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"]
Sep 11 13:21:20.483729 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.483683    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-home\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.483865 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.483741    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-tmp-dir\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.483865 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.483812    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-model-cache\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.483951 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.483861    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrrdw\" (UniqueName: \"kubernetes.io/projected/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-kube-api-access-xrrdw\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.483985 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.483962    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-dshm\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.484033 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.484016    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-tls-certs\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.585046 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.585003    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-tls-certs\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.585254 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.585062    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-home\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.585254 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.585087    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-tmp-dir\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.585254 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.585121    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-model-cache\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.585254 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.585140    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrrdw\" (UniqueName: \"kubernetes.io/projected/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-kube-api-access-xrrdw\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.585254 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.585201    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-dshm\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.585556 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.585527    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-tmp-dir\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.585679 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.585588    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-home\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.585679 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.585613    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-model-cache\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.587414 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.587387    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-dshm\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.587672 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.587654    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-tls-certs\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.595398 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.595380    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrrdw\" (UniqueName: \"kubernetes.io/projected/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-kube-api-access-xrrdw\") pod \"ipp-route-cc857f-kserve-645b8f8c87-24nf2\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") " pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:20.769108 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:20.769003    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:21.052418 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:21.052377    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"]
Sep 11 13:21:21.059121 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:21:21.059095    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14a79c79_0d66_4d4b_8241_9cf0b33e1a88.slice/crio-59eb64a7ce9be2de42672358de3031bbb9fafcbb279b617ec53f0c8e4cb92eb0 WatchSource:0}: Error finding container 59eb64a7ce9be2de42672358de3031bbb9fafcbb279b617ec53f0c8e4cb92eb0: Status 404 returned error can't find the container with id 59eb64a7ce9be2de42672358de3031bbb9fafcbb279b617ec53f0c8e4cb92eb0
Sep 11 13:21:21.275480 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:21.275446    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2" event={"ID":"14a79c79-0d66-4d4b-8241-9cf0b33e1a88","Type":"ContainerStarted","Data":"21d42cbad4fbbd4194e5378e74d3060422bdb591b8d91723703d453d7cc9686d"}
Sep 11 13:21:21.275480 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:21.275486    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2" event={"ID":"14a79c79-0d66-4d4b-8241-9cf0b33e1a88","Type":"ContainerStarted","Data":"59eb64a7ce9be2de42672358de3031bbb9fafcbb279b617ec53f0c8e4cb92eb0"}
Sep 11 13:21:21.303335 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:21.303230    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2" podStartSLOduration=1.303213637 podStartE2EDuration="1.303213637s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:21.302625078 +0000 UTC m=+1550.806489471" watchObservedRunningTime="2026-09-11 13:21:21.303213637 +0000 UTC m=+1550.807078075"
Sep 11 13:21:22.517085 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:22.517043    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"]
Sep 11 13:21:22.517567 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:22.517330    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerName="istio-proxy" containerID="cri-o://11550164e3fa9e9ea06c9d8c9354707a6e6427cda4a0faeb320b8e89dba1d89d" gracePeriod=30
Sep 11 13:21:22.832835 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:22.832798    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2"]
Sep 11 13:21:22.836231 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:22.836213    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2"
Sep 11 13:21:22.842387 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:22.842362    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:21:22.843821 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:22.843800    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:21:22.863871 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:22.863843    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2"]
Sep 11 13:21:22.906258 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:22.906220    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0639dcc8-1d9f-469a-ba99-545a5269bbbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2\" (UID: \"0639dcc8-1d9f-469a-ba99-545a5269bbbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2"
Sep 11 13:21:23.006753 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:23.006725    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0639dcc8-1d9f-469a-ba99-545a5269bbbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2\" (UID: \"0639dcc8-1d9f-469a-ba99-545a5269bbbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2"
Sep 11 13:21:23.007365 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:23.007343    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0639dcc8-1d9f-469a-ba99-545a5269bbbf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2\" (UID: \"0639dcc8-1d9f-469a-ba99-545a5269bbbf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2"
Sep 11 13:21:23.147116 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:23.147026    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2"
Sep 11 13:21:23.449338 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:23.449254    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2"]
Sep 11 13:21:23.452278 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:21:23.452243    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0639dcc8_1d9f_469a_ba99_545a5269bbbf.slice/crio-d00c533d5ba53d93d981d1be1dff371746273c25b085693f0e9625fd581c80b9 WatchSource:0}: Error finding container d00c533d5ba53d93d981d1be1dff371746273c25b085693f0e9625fd581c80b9: Status 404 returned error can't find the container with id d00c533d5ba53d93d981d1be1dff371746273c25b085693f0e9625fd581c80b9
Sep 11 13:21:24.290952 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:24.290914    2547 generic.go:356] "Generic (PLEG): container finished" podID="0639dcc8-1d9f-469a-ba99-545a5269bbbf" containerID="b56ea0e7940468956c79ad84581c5ee30bb101285e17a5994959c8f1746c09d5" exitCode=0
Sep 11 13:21:24.291340 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:24.290998    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2" event={"ID":"0639dcc8-1d9f-469a-ba99-545a5269bbbf","Type":"ContainerDied","Data":"b56ea0e7940468956c79ad84581c5ee30bb101285e17a5994959c8f1746c09d5"}
Sep 11 13:21:24.291340 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:24.291053    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2" event={"ID":"0639dcc8-1d9f-469a-ba99-545a5269bbbf","Type":"ContainerStarted","Data":"d00c533d5ba53d93d981d1be1dff371746273c25b085693f0e9625fd581c80b9"}
Sep 11 13:21:25.423929 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:25.423902    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2"
Sep 11 13:21:25.532891 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:25.532857    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0639dcc8-1d9f-469a-ba99-545a5269bbbf-maas-api-service-ca\") pod \"0639dcc8-1d9f-469a-ba99-545a5269bbbf\" (UID: \"0639dcc8-1d9f-469a-ba99-545a5269bbbf\") "
Sep 11 13:21:25.533252 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:25.533226    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0639dcc8-1d9f-469a-ba99-545a5269bbbf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0639dcc8-1d9f-469a-ba99-545a5269bbbf" (UID: "0639dcc8-1d9f-469a-ba99-545a5269bbbf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:21:25.634629 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:25.634544    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0639dcc8-1d9f-469a-ba99-545a5269bbbf-maas-api-service-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:26.302546 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:26.302519    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2"
Sep 11 13:21:26.302546 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:26.302531    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2" event={"ID":"0639dcc8-1d9f-469a-ba99-545a5269bbbf","Type":"ContainerDied","Data":"d00c533d5ba53d93d981d1be1dff371746273c25b085693f0e9625fd581c80b9"}
Sep 11 13:21:26.302775 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:26.302582    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d00c533d5ba53d93d981d1be1dff371746273c25b085693f0e9625fd581c80b9"
Sep 11 13:21:27.771130 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.771098    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:21:27.855900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.855816    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-podinfo\") pod \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") "
Sep 11 13:21:27.855900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.855852    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cf8nq\" (UniqueName: \"kubernetes.io/projected/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-kube-api-access-cf8nq\") pod \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") "
Sep 11 13:21:27.855900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.855884    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-workload-socket\") pod \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") "
Sep 11 13:21:27.855900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.855901    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istiod-ca-cert\") pod \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") "
Sep 11 13:21:27.856208 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.855926    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-credential-socket\") pod \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") "
Sep 11 13:21:27.856208 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.855986    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-envoy\") pod \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") "
Sep 11 13:21:27.856208 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.856043    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-data\") pod \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") "
Sep 11 13:21:27.856208 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.856074    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-workload-certs\") pod \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") "
Sep 11 13:21:27.856208 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.856106    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-token\") pod \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\" (UID: \"abfca6aa-ee7a-476c-a7a3-0a8f213912e6\") "
Sep 11 13:21:27.856208 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.856168    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "abfca6aa-ee7a-476c-a7a3-0a8f213912e6" (UID: "abfca6aa-ee7a-476c-a7a3-0a8f213912e6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:27.856539 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.856262    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "abfca6aa-ee7a-476c-a7a3-0a8f213912e6" (UID: "abfca6aa-ee7a-476c-a7a3-0a8f213912e6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:27.856539 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.856409    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-data" (OuterVolumeSpecName: "istio-data") pod "abfca6aa-ee7a-476c-a7a3-0a8f213912e6" (UID: "abfca6aa-ee7a-476c-a7a3-0a8f213912e6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:27.856539 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.856424    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "abfca6aa-ee7a-476c-a7a3-0a8f213912e6" (UID: "abfca6aa-ee7a-476c-a7a3-0a8f213912e6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:27.856699 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.856575    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:27.856699 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.856593    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:27.856699 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.856605    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:27.856699 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.856607    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "abfca6aa-ee7a-476c-a7a3-0a8f213912e6" (UID: "abfca6aa-ee7a-476c-a7a3-0a8f213912e6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:21:27.856699 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.856618    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:27.858158 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.858135    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "abfca6aa-ee7a-476c-a7a3-0a8f213912e6" (UID: "abfca6aa-ee7a-476c-a7a3-0a8f213912e6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:21:27.858282 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.858160    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-kube-api-access-cf8nq" (OuterVolumeSpecName: "kube-api-access-cf8nq") pod "abfca6aa-ee7a-476c-a7a3-0a8f213912e6" (UID: "abfca6aa-ee7a-476c-a7a3-0a8f213912e6"). InnerVolumeSpecName "kube-api-access-cf8nq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:21:27.858282 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.858168    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "abfca6aa-ee7a-476c-a7a3-0a8f213912e6" (UID: "abfca6aa-ee7a-476c-a7a3-0a8f213912e6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:27.858282 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.858258    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-token" (OuterVolumeSpecName: "istio-token") pod "abfca6aa-ee7a-476c-a7a3-0a8f213912e6" (UID: "abfca6aa-ee7a-476c-a7a3-0a8f213912e6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:21:27.957621 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.957578    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:27.957621 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.957611    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:27.957621 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.957625    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:27.957905 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.957636    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cf8nq\" (UniqueName: \"kubernetes.io/projected/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-kube-api-access-cf8nq\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:27.957905 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:27.957649    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/abfca6aa-ee7a-476c-a7a3-0a8f213912e6-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:28.314594 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:28.314561    2547 generic.go:356] "Generic (PLEG): container finished" podID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerID="11550164e3fa9e9ea06c9d8c9354707a6e6427cda4a0faeb320b8e89dba1d89d" exitCode=0
Sep 11 13:21:28.314785 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:28.314608    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"
Sep 11 13:21:28.314785 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:28.314643    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" event={"ID":"abfca6aa-ee7a-476c-a7a3-0a8f213912e6","Type":"ContainerDied","Data":"11550164e3fa9e9ea06c9d8c9354707a6e6427cda4a0faeb320b8e89dba1d89d"}
Sep 11 13:21:28.314785 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:28.314694    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk" event={"ID":"abfca6aa-ee7a-476c-a7a3-0a8f213912e6","Type":"ContainerDied","Data":"e9898f8a53aab0a6c2412ab2a780a35d1e9b705f2202288467fdb8c59d8bf259"}
Sep 11 13:21:28.314785 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:28.314734    2547 scope.go:117] "RemoveContainer" containerID="11550164e3fa9e9ea06c9d8c9354707a6e6427cda4a0faeb320b8e89dba1d89d"
Sep 11 13:21:28.324956 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:28.324934    2547 scope.go:117] "RemoveContainer" containerID="ec1272535dae1d54aa8f9eac44185021aa43630352f6c5912c28aefd1c5c2f22"
Sep 11 13:21:28.334282 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:28.334161    2547 scope.go:117] "RemoveContainer" containerID="11550164e3fa9e9ea06c9d8c9354707a6e6427cda4a0faeb320b8e89dba1d89d"
Sep 11 13:21:28.336427 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:21:28.336386    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11550164e3fa9e9ea06c9d8c9354707a6e6427cda4a0faeb320b8e89dba1d89d\": container with ID starting with 11550164e3fa9e9ea06c9d8c9354707a6e6427cda4a0faeb320b8e89dba1d89d not found: ID does not exist" containerID="11550164e3fa9e9ea06c9d8c9354707a6e6427cda4a0faeb320b8e89dba1d89d"
Sep 11 13:21:28.336549 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:28.336443    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11550164e3fa9e9ea06c9d8c9354707a6e6427cda4a0faeb320b8e89dba1d89d"} err="failed to get container status \"11550164e3fa9e9ea06c9d8c9354707a6e6427cda4a0faeb320b8e89dba1d89d\": rpc error: code = NotFound desc = could not find container \"11550164e3fa9e9ea06c9d8c9354707a6e6427cda4a0faeb320b8e89dba1d89d\": container with ID starting with 11550164e3fa9e9ea06c9d8c9354707a6e6427cda4a0faeb320b8e89dba1d89d not found: ID does not exist"
Sep 11 13:21:28.336549 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:28.336476    2547 scope.go:117] "RemoveContainer" containerID="ec1272535dae1d54aa8f9eac44185021aa43630352f6c5912c28aefd1c5c2f22"
Sep 11 13:21:28.336985 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:21:28.336958    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec1272535dae1d54aa8f9eac44185021aa43630352f6c5912c28aefd1c5c2f22\": container with ID starting with ec1272535dae1d54aa8f9eac44185021aa43630352f6c5912c28aefd1c5c2f22 not found: ID does not exist" containerID="ec1272535dae1d54aa8f9eac44185021aa43630352f6c5912c28aefd1c5c2f22"
Sep 11 13:21:28.337117 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:28.337094    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec1272535dae1d54aa8f9eac44185021aa43630352f6c5912c28aefd1c5c2f22"} err="failed to get container status \"ec1272535dae1d54aa8f9eac44185021aa43630352f6c5912c28aefd1c5c2f22\": rpc error: code = NotFound desc = could not find container \"ec1272535dae1d54aa8f9eac44185021aa43630352f6c5912c28aefd1c5c2f22\": container with ID starting with ec1272535dae1d54aa8f9eac44185021aa43630352f6c5912c28aefd1c5c2f22 not found: ID does not exist"
Sep 11 13:21:28.350582 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:28.350548    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"]
Sep 11 13:21:28.354421 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:28.354394    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-4d7bb0-openshift-default-d9bf896bd-sznmk"]
Sep 11 13:21:29.006949 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:29.006916    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" path="/var/lib/kubelet/pods/abfca6aa-ee7a-476c-a7a3-0a8f213912e6/volumes"
Sep 11 13:21:30.769398 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:30.769350    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:30.769904 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:30.769421    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:30.782372 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:30.782344    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:31.258072 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:31.258037    2547 scope.go:117] "RemoveContainer" containerID="2059bcd4ccb1982b9939a1085ceca8fecee9bfb9050798a6475f9df28d2309b5"
Sep 11 13:21:31.344110 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:31.344080    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:21:33.574992 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:33.574953    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"]
Sep 11 13:21:33.575521 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:33.575210    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq" podUID="3453d033-156c-4d4e-b4ef-ff7ba7730d2e" containerName="payload-processing" containerID="cri-o://fa9c24b3a3ecb7ba9a6eddcf2b6b8e3861a22ef4abfac40c032e72d721b55a2b" gracePeriod=30
Sep 11 13:21:33.837085 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:33.837025    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"
Sep 11 13:21:33.900128 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:33.900090    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2"]
Sep 11 13:21:33.916651 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:33.915291    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkhnj\" (UniqueName: \"kubernetes.io/projected/3453d033-156c-4d4e-b4ef-ff7ba7730d2e-kube-api-access-bkhnj\") pod \"3453d033-156c-4d4e-b4ef-ff7ba7730d2e\" (UID: \"3453d033-156c-4d4e-b4ef-ff7ba7730d2e\") "
Sep 11 13:21:33.916651 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:33.915358    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3453d033-156c-4d4e-b4ef-ff7ba7730d2e-plugins-config-volume\") pod \"3453d033-156c-4d4e-b4ef-ff7ba7730d2e\" (UID: \"3453d033-156c-4d4e-b4ef-ff7ba7730d2e\") "
Sep 11 13:21:33.916651 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:33.916160    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3453d033-156c-4d4e-b4ef-ff7ba7730d2e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3453d033-156c-4d4e-b4ef-ff7ba7730d2e" (UID: "3453d033-156c-4d4e-b4ef-ff7ba7730d2e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:21:33.916651 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:33.916275    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f705b6-p8jt2"]
Sep 11 13:21:33.922009 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:33.921894    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3453d033-156c-4d4e-b4ef-ff7ba7730d2e-kube-api-access-bkhnj" (OuterVolumeSpecName: "kube-api-access-bkhnj") pod "3453d033-156c-4d4e-b4ef-ff7ba7730d2e" (UID: "3453d033-156c-4d4e-b4ef-ff7ba7730d2e"). InnerVolumeSpecName "kube-api-access-bkhnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:21:33.976577 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:33.976538    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:21:34.017079 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:34.017039    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3453d033-156c-4d4e-b4ef-ff7ba7730d2e-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:34.017079 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:34.017072    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkhnj\" (UniqueName: \"kubernetes.io/projected/3453d033-156c-4d4e-b4ef-ff7ba7730d2e-kube-api-access-bkhnj\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:34.347460 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:34.347426    2547 generic.go:356] "Generic (PLEG): container finished" podID="3453d033-156c-4d4e-b4ef-ff7ba7730d2e" containerID="fa9c24b3a3ecb7ba9a6eddcf2b6b8e3861a22ef4abfac40c032e72d721b55a2b" exitCode=0
Sep 11 13:21:34.347681 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:34.347473    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq" event={"ID":"3453d033-156c-4d4e-b4ef-ff7ba7730d2e","Type":"ContainerDied","Data":"fa9c24b3a3ecb7ba9a6eddcf2b6b8e3861a22ef4abfac40c032e72d721b55a2b"}
Sep 11 13:21:34.347681 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:34.347514    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq" event={"ID":"3453d033-156c-4d4e-b4ef-ff7ba7730d2e","Type":"ContainerDied","Data":"80c5cbf8356e3f76ef7a637115c9cbe1dfe113d9073577b95bfa6163f9f54ef6"}
Sep 11 13:21:34.347681 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:34.347543    2547 scope.go:117] "RemoveContainer" containerID="fa9c24b3a3ecb7ba9a6eddcf2b6b8e3861a22ef4abfac40c032e72d721b55a2b"
Sep 11 13:21:34.347681 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:34.347547    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"
Sep 11 13:21:34.356539 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:34.356518    2547 scope.go:117] "RemoveContainer" containerID="fa9c24b3a3ecb7ba9a6eddcf2b6b8e3861a22ef4abfac40c032e72d721b55a2b"
Sep 11 13:21:34.356830 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:21:34.356808    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa9c24b3a3ecb7ba9a6eddcf2b6b8e3861a22ef4abfac40c032e72d721b55a2b\": container with ID starting with fa9c24b3a3ecb7ba9a6eddcf2b6b8e3861a22ef4abfac40c032e72d721b55a2b not found: ID does not exist" containerID="fa9c24b3a3ecb7ba9a6eddcf2b6b8e3861a22ef4abfac40c032e72d721b55a2b"
Sep 11 13:21:34.356894 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:34.356837    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa9c24b3a3ecb7ba9a6eddcf2b6b8e3861a22ef4abfac40c032e72d721b55a2b"} err="failed to get container status \"fa9c24b3a3ecb7ba9a6eddcf2b6b8e3861a22ef4abfac40c032e72d721b55a2b\": rpc error: code = NotFound desc = could not find container \"fa9c24b3a3ecb7ba9a6eddcf2b6b8e3861a22ef4abfac40c032e72d721b55a2b\": container with ID starting with fa9c24b3a3ecb7ba9a6eddcf2b6b8e3861a22ef4abfac40c032e72d721b55a2b not found: ID does not exist"
Sep 11 13:21:34.377551 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:34.377520    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"]
Sep 11 13:21:34.382531 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:34.382503    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f705b6-6bc86f4995-2whcq"]
Sep 11 13:21:35.012583 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:35.012539    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0639dcc8-1d9f-469a-ba99-545a5269bbbf" path="/var/lib/kubelet/pods/0639dcc8-1d9f-469a-ba99-545a5269bbbf/volumes"
Sep 11 13:21:35.013111 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:35.013088    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3453d033-156c-4d4e-b4ef-ff7ba7730d2e" path="/var/lib/kubelet/pods/3453d033-156c-4d4e-b4ef-ff7ba7730d2e/volumes"
Sep 11 13:21:41.838333 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:41.838293    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"]
Sep 11 13:21:41.838837 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:41.838532    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm" podUID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerName="istio-proxy" containerID="cri-o://ee9433e30151f43d1a6de378d674ed575c3261cb5d3b47fa44300993d8c60956" gracePeriod=30
Sep 11 13:21:46.742241 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:46.742209    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:21:47.095034 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.095009    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:21:47.244312 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.244279    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vxtb\" (UniqueName: \"kubernetes.io/projected/ac3b9cc3-6180-4f34-aab6-03ac246defac-kube-api-access-6vxtb\") pod \"ac3b9cc3-6180-4f34-aab6-03ac246defac\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") "
Sep 11 13:21:47.244312 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.244324    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac3b9cc3-6180-4f34-aab6-03ac246defac-istiod-ca-cert\") pod \"ac3b9cc3-6180-4f34-aab6-03ac246defac\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") "
Sep 11 13:21:47.244576 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.244361    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-envoy\") pod \"ac3b9cc3-6180-4f34-aab6-03ac246defac\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") "
Sep 11 13:21:47.244576 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.244400    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-podinfo\") pod \"ac3b9cc3-6180-4f34-aab6-03ac246defac\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") "
Sep 11 13:21:47.244576 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.244439    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-workload-certs\") pod \"ac3b9cc3-6180-4f34-aab6-03ac246defac\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") "
Sep 11 13:21:47.244576 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.244469    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-token\") pod \"ac3b9cc3-6180-4f34-aab6-03ac246defac\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") "
Sep 11 13:21:47.244809 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.244655    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-workload-socket\") pod \"ac3b9cc3-6180-4f34-aab6-03ac246defac\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") "
Sep 11 13:21:47.244809 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.244752    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-data\") pod \"ac3b9cc3-6180-4f34-aab6-03ac246defac\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") "
Sep 11 13:21:47.244809 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.244759    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac3b9cc3-6180-4f34-aab6-03ac246defac-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ac3b9cc3-6180-4f34-aab6-03ac246defac" (UID: "ac3b9cc3-6180-4f34-aab6-03ac246defac"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:21:47.244809 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.244790    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-credential-socket\") pod \"ac3b9cc3-6180-4f34-aab6-03ac246defac\" (UID: \"ac3b9cc3-6180-4f34-aab6-03ac246defac\") "
Sep 11 13:21:47.245033 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.244845    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ac3b9cc3-6180-4f34-aab6-03ac246defac" (UID: "ac3b9cc3-6180-4f34-aab6-03ac246defac"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:47.245033 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.244907    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ac3b9cc3-6180-4f34-aab6-03ac246defac" (UID: "ac3b9cc3-6180-4f34-aab6-03ac246defac"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:47.245144 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.245045    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-data" (OuterVolumeSpecName: "istio-data") pod "ac3b9cc3-6180-4f34-aab6-03ac246defac" (UID: "ac3b9cc3-6180-4f34-aab6-03ac246defac"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:47.245144 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.245055    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ac3b9cc3-6180-4f34-aab6-03ac246defac" (UID: "ac3b9cc3-6180-4f34-aab6-03ac246defac"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:47.245144 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.245097    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:47.245144 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.245115    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:47.245144 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.245125    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ac3b9cc3-6180-4f34-aab6-03ac246defac-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:47.246783 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.246755    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ac3b9cc3-6180-4f34-aab6-03ac246defac" (UID: "ac3b9cc3-6180-4f34-aab6-03ac246defac"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:21:47.247130 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.247098    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-token" (OuterVolumeSpecName: "istio-token") pod "ac3b9cc3-6180-4f34-aab6-03ac246defac" (UID: "ac3b9cc3-6180-4f34-aab6-03ac246defac"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:21:47.247232 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.247144    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ac3b9cc3-6180-4f34-aab6-03ac246defac" (UID: "ac3b9cc3-6180-4f34-aab6-03ac246defac"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:21:47.247232 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.247170    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac3b9cc3-6180-4f34-aab6-03ac246defac-kube-api-access-6vxtb" (OuterVolumeSpecName: "kube-api-access-6vxtb") pod "ac3b9cc3-6180-4f34-aab6-03ac246defac" (UID: "ac3b9cc3-6180-4f34-aab6-03ac246defac"). InnerVolumeSpecName "kube-api-access-6vxtb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:21:47.346554 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.346514    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:47.346554 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.346549    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vxtb\" (UniqueName: \"kubernetes.io/projected/ac3b9cc3-6180-4f34-aab6-03ac246defac-kube-api-access-6vxtb\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:47.346554 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.346560    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:47.346823 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.346569    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:47.346823 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.346578    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:47.346823 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.346587    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ac3b9cc3-6180-4f34-aab6-03ac246defac-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:21:47.415863 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.415822    2547 generic.go:356] "Generic (PLEG): container finished" podID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerID="ee9433e30151f43d1a6de378d674ed575c3261cb5d3b47fa44300993d8c60956" exitCode=0
Sep 11 13:21:47.416053 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.415877    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"
Sep 11 13:21:47.416053 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.415908    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm" event={"ID":"ac3b9cc3-6180-4f34-aab6-03ac246defac","Type":"ContainerDied","Data":"ee9433e30151f43d1a6de378d674ed575c3261cb5d3b47fa44300993d8c60956"}
Sep 11 13:21:47.416053 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.415969    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm" event={"ID":"ac3b9cc3-6180-4f34-aab6-03ac246defac","Type":"ContainerDied","Data":"d799974d91de9668977f4a786879a359b633de77b5973d27c5fbf8b8ffc419c5"}
Sep 11 13:21:47.416053 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.415992    2547 scope.go:117] "RemoveContainer" containerID="ee9433e30151f43d1a6de378d674ed575c3261cb5d3b47fa44300993d8c60956"
Sep 11 13:21:47.425599 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.425579    2547 scope.go:117] "RemoveContainer" containerID="bd12fa9f4df015126a5467462a0b2ec01c62abe5c7cfd14ee64ac961cd92eada"
Sep 11 13:21:47.433221 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.433203    2547 scope.go:117] "RemoveContainer" containerID="ee9433e30151f43d1a6de378d674ed575c3261cb5d3b47fa44300993d8c60956"
Sep 11 13:21:47.433471 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:21:47.433450    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee9433e30151f43d1a6de378d674ed575c3261cb5d3b47fa44300993d8c60956\": container with ID starting with ee9433e30151f43d1a6de378d674ed575c3261cb5d3b47fa44300993d8c60956 not found: ID does not exist" containerID="ee9433e30151f43d1a6de378d674ed575c3261cb5d3b47fa44300993d8c60956"
Sep 11 13:21:47.433522 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.433479    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee9433e30151f43d1a6de378d674ed575c3261cb5d3b47fa44300993d8c60956"} err="failed to get container status \"ee9433e30151f43d1a6de378d674ed575c3261cb5d3b47fa44300993d8c60956\": rpc error: code = NotFound desc = could not find container \"ee9433e30151f43d1a6de378d674ed575c3261cb5d3b47fa44300993d8c60956\": container with ID starting with ee9433e30151f43d1a6de378d674ed575c3261cb5d3b47fa44300993d8c60956 not found: ID does not exist"
Sep 11 13:21:47.433522 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.433503    2547 scope.go:117] "RemoveContainer" containerID="bd12fa9f4df015126a5467462a0b2ec01c62abe5c7cfd14ee64ac961cd92eada"
Sep 11 13:21:47.433820 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:21:47.433800    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd12fa9f4df015126a5467462a0b2ec01c62abe5c7cfd14ee64ac961cd92eada\": container with ID starting with bd12fa9f4df015126a5467462a0b2ec01c62abe5c7cfd14ee64ac961cd92eada not found: ID does not exist" containerID="bd12fa9f4df015126a5467462a0b2ec01c62abe5c7cfd14ee64ac961cd92eada"
Sep 11 13:21:47.433897 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.433824    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd12fa9f4df015126a5467462a0b2ec01c62abe5c7cfd14ee64ac961cd92eada"} err="failed to get container status \"bd12fa9f4df015126a5467462a0b2ec01c62abe5c7cfd14ee64ac961cd92eada\": rpc error: code = NotFound desc = could not find container \"bd12fa9f4df015126a5467462a0b2ec01c62abe5c7cfd14ee64ac961cd92eada\": container with ID starting with bd12fa9f4df015126a5467462a0b2ec01c62abe5c7cfd14ee64ac961cd92eada not found: ID does not exist"
Sep 11 13:21:47.443887 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.443864    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"]
Sep 11 13:21:47.449416 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:47.449389    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f705b6-openshift-default-864d79c888-6zppm"]
Sep 11 13:21:49.007140 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:49.007109    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac3b9cc3-6180-4f34-aab6-03ac246defac" path="/var/lib/kubelet/pods/ac3b9cc3-6180-4f34-aab6-03ac246defac/volumes"
Sep 11 13:21:53.085492 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.085450    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"]
Sep 11 13:21:53.085964 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.085904    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0639dcc8-1d9f-469a-ba99-545a5269bbbf" containerName="revoke-keys"
Sep 11 13:21:53.085964 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.085921    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="0639dcc8-1d9f-469a-ba99-545a5269bbbf" containerName="revoke-keys"
Sep 11 13:21:53.085964 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.085935    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerName="istio-proxy"
Sep 11 13:21:53.085964 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.085941    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerName="istio-proxy"
Sep 11 13:21:53.085964 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.085953    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerName="istio-proxy"
Sep 11 13:21:53.085964 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.085959    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerName="istio-proxy"
Sep 11 13:21:53.085964 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.085966    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3453d033-156c-4d4e-b4ef-ff7ba7730d2e" containerName="payload-processing"
Sep 11 13:21:53.086199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.085972    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="3453d033-156c-4d4e-b4ef-ff7ba7730d2e" containerName="payload-processing"
Sep 11 13:21:53.086199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.085980    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerName="istio-proxy"
Sep 11 13:21:53.086199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.085985    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerName="istio-proxy"
Sep 11 13:21:53.086199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.086054    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerName="istio-proxy"
Sep 11 13:21:53.086199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.086062    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerName="istio-proxy"
Sep 11 13:21:53.086199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.086068    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="3453d033-156c-4d4e-b4ef-ff7ba7730d2e" containerName="payload-processing"
Sep 11 13:21:53.086199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.086075    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerName="istio-proxy"
Sep 11 13:21:53.086199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.086081    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="0639dcc8-1d9f-469a-ba99-545a5269bbbf" containerName="revoke-keys"
Sep 11 13:21:53.090434 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.090401    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.093111 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.093081    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-48a080-openshift-default-dockercfg-x2w46\""
Sep 11 13:21:53.101592 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.101569    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-envoy\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.101791 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.101605    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-workload-socket\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.101791 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.101701    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-data\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.101910 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.101812    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-podinfo\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.101910 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.101841    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.101910 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.101890    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-token\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.102060 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.101919    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-workload-certs\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.102060 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.101967    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98zmx\" (UniqueName: \"kubernetes.io/projected/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-kube-api-access-98zmx\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.102060 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.102009    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-credential-socket\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.104766 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.104707    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"]
Sep 11 13:21:53.202603 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.202568    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-envoy\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.202603 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.202605    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-workload-socket\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.202881 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.202636    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-data\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.202881 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.202660    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-podinfo\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.202881 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.202686    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.202881 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.202746    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-token\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.202881 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.202773    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-workload-certs\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.202881 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.202842    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98zmx\" (UniqueName: \"kubernetes.io/projected/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-kube-api-access-98zmx\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.203212 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.202900    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-credential-socket\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.203212 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.203117    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-workload-socket\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.203324 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.203296    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-credential-socket\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.203389 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.203331    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-workload-certs\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.203447 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.203380    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-data\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.203517 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.203493    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.205007 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.204989    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-envoy\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.205216 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.205198    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-podinfo\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.211293 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.211264    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-token\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.211904 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.211885    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98zmx\" (UniqueName: \"kubernetes.io/projected/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-kube-api-access-98zmx\") pod \"e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") " pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.402385 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.402287    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:53.685822 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.685792    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"]
Sep 11 13:21:53.688506 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:21:53.688473    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc9ade9_afe2_4ee2_8b54_f9c1587f885a.slice/crio-6a838882b6109e9370ffb1318a650c7a700be396f6c19393c47c607f9e9ab8d0 WatchSource:0}: Error finding container 6a838882b6109e9370ffb1318a650c7a700be396f6c19393c47c607f9e9ab8d0: Status 404 returned error can't find the container with id 6a838882b6109e9370ffb1318a650c7a700be396f6c19393c47c607f9e9ab8d0
Sep 11 13:21:53.690831 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.690794    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:21:53.690929 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.690872    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:21:53.690929 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:53.690902    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:21:54.453732 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:54.453676    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv" event={"ID":"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a","Type":"ContainerStarted","Data":"ce869acccdcbf0290f28574fd5e19a38d8f676483720a0675a660108c67ecba9"}
Sep 11 13:21:54.454135 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:54.453758    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv" event={"ID":"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a","Type":"ContainerStarted","Data":"6a838882b6109e9370ffb1318a650c7a700be396f6c19393c47c607f9e9ab8d0"}
Sep 11 13:21:54.507364 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:54.507310    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv" podStartSLOduration=1.5072898970000002 podStartE2EDuration="1.507289897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:21:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:21:54.505750381 +0000 UTC m=+1584.009614771" watchObservedRunningTime="2026-09-11 13:21:54.507289897 +0000 UTC m=+1584.011154289"
Sep 11 13:21:55.403088 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:55.403049    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:55.408953 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:55.408922    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:55.458371 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:55.458338    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:21:55.459304 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:21:55.459286    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:22:02.879360 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.879319    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"]
Sep 11 13:22:02.879772 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.879685    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerName="istio-proxy"
Sep 11 13:22:02.879772 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.879698    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="abfca6aa-ee7a-476c-a7a3-0a8f213912e6" containerName="istio-proxy"
Sep 11 13:22:02.879867 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.879786    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac3b9cc3-6180-4f34-aab6-03ac246defac" containerName="istio-proxy"
Sep 11 13:22:02.882746 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.882704    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"
Sep 11 13:22:02.888474 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.888452    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-48a080\""
Sep 11 13:22:02.888591 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.888453    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-48a080-dockercfg-bxcgq\""
Sep 11 13:22:02.909552 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.909521    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"]
Sep 11 13:22:02.921582 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.921552    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"]
Sep 11 13:22:02.925423 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.925405    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"
Sep 11 13:22:02.947498 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.947463    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"]
Sep 11 13:22:02.997042 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.997000    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a964513-ab96-4651-9f11-2f8a807d91fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c\" (UID: \"5a964513-ab96-4651-9f11-2f8a807d91fe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"
Sep 11 13:22:02.997336 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.997066    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf\" (UID: \"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"
Sep 11 13:22:02.997336 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.997117    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pngc9\" (UniqueName: \"kubernetes.io/projected/5a964513-ab96-4651-9f11-2f8a807d91fe-kube-api-access-pngc9\") pod \"payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c\" (UID: \"5a964513-ab96-4651-9f11-2f8a807d91fe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"
Sep 11 13:22:02.997336 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:02.997156    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhsj7\" (UniqueName: \"kubernetes.io/projected/aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90-kube-api-access-bhsj7\") pod \"payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf\" (UID: \"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"
Sep 11 13:22:03.098289 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:03.098252    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a964513-ab96-4651-9f11-2f8a807d91fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c\" (UID: \"5a964513-ab96-4651-9f11-2f8a807d91fe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"
Sep 11 13:22:03.098289 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:03.098295    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf\" (UID: \"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"
Sep 11 13:22:03.098518 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:03.098317    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pngc9\" (UniqueName: \"kubernetes.io/projected/5a964513-ab96-4651-9f11-2f8a807d91fe-kube-api-access-pngc9\") pod \"payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c\" (UID: \"5a964513-ab96-4651-9f11-2f8a807d91fe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"
Sep 11 13:22:03.098518 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:03.098350    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhsj7\" (UniqueName: \"kubernetes.io/projected/aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90-kube-api-access-bhsj7\") pod \"payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf\" (UID: \"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"
Sep 11 13:22:03.099047 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:03.099026    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf\" (UID: \"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"
Sep 11 13:22:03.099097 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:03.099028    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a964513-ab96-4651-9f11-2f8a807d91fe-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c\" (UID: \"5a964513-ab96-4651-9f11-2f8a807d91fe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"
Sep 11 13:22:03.112103 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:03.112067    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhsj7\" (UniqueName: \"kubernetes.io/projected/aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90-kube-api-access-bhsj7\") pod \"payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf\" (UID: \"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"
Sep 11 13:22:03.115022 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:03.114992    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pngc9\" (UniqueName: \"kubernetes.io/projected/5a964513-ab96-4651-9f11-2f8a807d91fe-kube-api-access-pngc9\") pod \"payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c\" (UID: \"5a964513-ab96-4651-9f11-2f8a807d91fe\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"
Sep 11 13:22:03.199245 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:03.199148    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"
Sep 11 13:22:03.235321 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:03.235278    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"
Sep 11 13:22:03.486033 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:03.486003    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"]
Sep 11 13:22:03.486652 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:22:03.486628    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a964513_ab96_4651_9f11_2f8a807d91fe.slice/crio-aecd7d908b21b2ac9e6ad78d17b3da304770fb8640eceb4cb6f31de7ad549e79 WatchSource:0}: Error finding container aecd7d908b21b2ac9e6ad78d17b3da304770fb8640eceb4cb6f31de7ad549e79: Status 404 returned error can't find the container with id aecd7d908b21b2ac9e6ad78d17b3da304770fb8640eceb4cb6f31de7ad549e79
Sep 11 13:22:03.505878 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:03.505851    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c" event={"ID":"5a964513-ab96-4651-9f11-2f8a807d91fe","Type":"ContainerStarted","Data":"aecd7d908b21b2ac9e6ad78d17b3da304770fb8640eceb4cb6f31de7ad549e79"}
Sep 11 13:22:03.562731 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:03.562694    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"]
Sep 11 13:22:03.564495 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:22:03.564469    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1bbde9_2518_4ca0_b5fe_4e9feefbfa90.slice/crio-32c196671843e8080711fcb0618f168b4cdf2a63d4e74bf092329d9403fe0351 WatchSource:0}: Error finding container 32c196671843e8080711fcb0618f168b4cdf2a63d4e74bf092329d9403fe0351: Status 404 returned error can't find the container with id 32c196671843e8080711fcb0618f168b4cdf2a63d4e74bf092329d9403fe0351
Sep 11 13:22:04.512490 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:04.512452    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c" event={"ID":"5a964513-ab96-4651-9f11-2f8a807d91fe","Type":"ContainerStarted","Data":"3dd481cf7c77ce1e9b18a27f6185361ef7ab6e6864c5053d7c9f2b003ad8bc74"}
Sep 11 13:22:04.513018 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:04.512540    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"
Sep 11 13:22:04.514075 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:04.514051    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf" event={"ID":"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90","Type":"ContainerStarted","Data":"1373580aca261596ae2a5e02792160dfec60d7ed000a25b672937c0bb82bcdab"}
Sep 11 13:22:04.514212 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:04.514093    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf" event={"ID":"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90","Type":"ContainerStarted","Data":"32c196671843e8080711fcb0618f168b4cdf2a63d4e74bf092329d9403fe0351"}
Sep 11 13:22:04.514212 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:04.514128    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"
Sep 11 13:22:04.645942 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:04.645885    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c" podStartSLOduration=2.645868601 podStartE2EDuration="2.645868601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:22:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:04.645252724 +0000 UTC m=+1594.149117117" watchObservedRunningTime="2026-09-11 13:22:04.645868601 +0000 UTC m=+1594.149733006"
Sep 11 13:22:04.723119 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:04.723063    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf" podStartSLOduration=2.723046472 podStartE2EDuration="2.723046472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:22:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:04.72284274 +0000 UTC m=+1594.226707133" watchObservedRunningTime="2026-09-11 13:22:04.723046472 +0000 UTC m=+1594.226910864"
Sep 11 13:22:07.369387 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:07.369353    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:22:15.522156 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:15.522120    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"
Sep 11 13:22:15.522536 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:15.522209    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"
Sep 11 13:22:18.597570 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:18.597536    2547 generic.go:356] "Generic (PLEG): container finished" podID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerID="ce869acccdcbf0290f28574fd5e19a38d8f676483720a0675a660108c67ecba9" exitCode=0
Sep 11 13:22:18.597981 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:18.597613    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv" event={"ID":"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a","Type":"ContainerDied","Data":"ce869acccdcbf0290f28574fd5e19a38d8f676483720a0675a660108c67ecba9"}
Sep 11 13:22:18.598025 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:18.598007    2547 scope.go:117] "RemoveContainer" containerID="ce869acccdcbf0290f28574fd5e19a38d8f676483720a0675a660108c67ecba9"
Sep 11 13:22:18.599103 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:18.599077    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:22:18.599206 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:18.599140    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:22:18.599206 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:18.599176    2547 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 11 13:22:19.607822 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:19.607783    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv" event={"ID":"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a","Type":"ContainerStarted","Data":"2b3e287011347cfc36c5b0665cd884b8fadecce5f7ff23c7b155135723534298"}
Sep 11 13:22:20.402778 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:20.402737    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:22:20.402967 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:20.402950    2547 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 11 13:22:20.403022 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:20.402999    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv" podUID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 11 13:22:21.402910 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:21.402874    2547 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 11 13:22:21.403310 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:21.402930    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv" podUID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 11 13:22:22.403694 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:22.403657    2547 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 11 13:22:22.404117 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:22.403711    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv" podUID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 11 13:22:23.403399 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:23.403301    2547 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 11 13:22:23.403399 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:23.403368    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv" podUID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 11 13:22:24.403680 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:24.403643    2547 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 11 13:22:24.404175 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:24.403701    2547 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv" podUID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 11 13:22:25.407736 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:25.407678    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:22:25.408207 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:25.408145    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:22:25.408919 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:25.408898    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:22:27.432075 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:27.432039    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq"]
Sep 11 13:22:27.435648 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:27.435629    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq"
Sep 11 13:22:27.438952 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:27.438908    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:22:27.439083 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:27.438961    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:22:27.491528 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:27.491498    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq"]
Sep 11 13:22:27.537361 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:27.537332    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f4171f-603d-4399-9a6d-69ed35cf2170-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq\" (UID: \"92f4171f-603d-4399-9a6d-69ed35cf2170\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq"
Sep 11 13:22:27.638099 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:27.638069    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f4171f-603d-4399-9a6d-69ed35cf2170-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq\" (UID: \"92f4171f-603d-4399-9a6d-69ed35cf2170\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq"
Sep 11 13:22:27.638676 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:27.638658    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f4171f-603d-4399-9a6d-69ed35cf2170-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq\" (UID: \"92f4171f-603d-4399-9a6d-69ed35cf2170\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq"
Sep 11 13:22:27.746208 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:27.746132    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq"
Sep 11 13:22:28.020998 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:28.020973    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq"]
Sep 11 13:22:28.022527 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:22:28.022502    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92f4171f_603d_4399_9a6d_69ed35cf2170.slice/crio-e96fed3733b63cbd9eecc2dd273eadde5ad42b1c042ef13fb9bcb1a9e532405f WatchSource:0}: Error finding container e96fed3733b63cbd9eecc2dd273eadde5ad42b1c042ef13fb9bcb1a9e532405f: Status 404 returned error can't find the container with id e96fed3733b63cbd9eecc2dd273eadde5ad42b1c042ef13fb9bcb1a9e532405f
Sep 11 13:22:28.655794 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:28.655699    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq" event={"ID":"92f4171f-603d-4399-9a6d-69ed35cf2170","Type":"ContainerStarted","Data":"46ef971fbe604a96d3bdcbc1a35251f69005bb9daacbd5cb0ef32ebb10be8861"}
Sep 11 13:22:28.655794 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:28.655767    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq" event={"ID":"92f4171f-603d-4399-9a6d-69ed35cf2170","Type":"ContainerStarted","Data":"e96fed3733b63cbd9eecc2dd273eadde5ad42b1c042ef13fb9bcb1a9e532405f"}
Sep 11 13:22:28.684396 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:28.684343    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq" podStartSLOduration=1.684326615 podStartE2EDuration="1.684326615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:28.680941226 +0000 UTC m=+1618.184805619" watchObservedRunningTime="2026-09-11 13:22:28.684326615 +0000 UTC m=+1618.188191008"
Sep 11 13:22:29.662237 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:29.662203    2547 generic.go:356] "Generic (PLEG): container finished" podID="92f4171f-603d-4399-9a6d-69ed35cf2170" containerID="46ef971fbe604a96d3bdcbc1a35251f69005bb9daacbd5cb0ef32ebb10be8861" exitCode=0
Sep 11 13:22:29.662615 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:29.662289    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq" event={"ID":"92f4171f-603d-4399-9a6d-69ed35cf2170","Type":"ContainerDied","Data":"46ef971fbe604a96d3bdcbc1a35251f69005bb9daacbd5cb0ef32ebb10be8861"}
Sep 11 13:22:30.792296 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:30.792271    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq"
Sep 11 13:22:30.968934 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:30.968848    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f4171f-603d-4399-9a6d-69ed35cf2170-maas-api-service-ca\") pod \"92f4171f-603d-4399-9a6d-69ed35cf2170\" (UID: \"92f4171f-603d-4399-9a6d-69ed35cf2170\") "
Sep 11 13:22:30.969159 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:30.969137    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92f4171f-603d-4399-9a6d-69ed35cf2170-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "92f4171f-603d-4399-9a6d-69ed35cf2170" (UID: "92f4171f-603d-4399-9a6d-69ed35cf2170"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:31.070005 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:31.069974    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92f4171f-603d-4399-9a6d-69ed35cf2170-maas-api-service-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:31.672753 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:31.672652    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq" event={"ID":"92f4171f-603d-4399-9a6d-69ed35cf2170","Type":"ContainerDied","Data":"e96fed3733b63cbd9eecc2dd273eadde5ad42b1c042ef13fb9bcb1a9e532405f"}
Sep 11 13:22:31.672753 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:31.672698    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e96fed3733b63cbd9eecc2dd273eadde5ad42b1c042ef13fb9bcb1a9e532405f"
Sep 11 13:22:31.672753 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:31.672662    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq"
Sep 11 13:22:38.696635 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:38.696590    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"]
Sep 11 13:22:38.697166 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:38.696827    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf" podUID="aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90" containerName="payload-processing" containerID="cri-o://1373580aca261596ae2a5e02792160dfec60d7ed000a25b672937c0bb82bcdab" gracePeriod=30
Sep 11 13:22:38.714026 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:38.713996    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"]
Sep 11 13:22:38.714249 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:38.714225    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c" podUID="5a964513-ab96-4651-9f11-2f8a807d91fe" containerName="payload-pre-processing" containerID="cri-o://3dd481cf7c77ce1e9b18a27f6185361ef7ab6e6864c5053d7c9f2b003ad8bc74" gracePeriod=30
Sep 11 13:22:38.978895 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:38.978820    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq"]
Sep 11 13:22:38.982797 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:38.982769    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-48a080-rdzvq"]
Sep 11 13:22:39.006836 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.006811    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"
Sep 11 13:22:39.007407 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.007381    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92f4171f-603d-4399-9a6d-69ed35cf2170" path="/var/lib/kubelet/pods/92f4171f-603d-4399-9a6d-69ed35cf2170/volumes"
Sep 11 13:22:39.009443 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.009425    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"
Sep 11 13:22:39.036755 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.036732    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90-plugins-config-volume\") pod \"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90\" (UID: \"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90\") "
Sep 11 13:22:39.036866 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.036797    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a964513-ab96-4651-9f11-2f8a807d91fe-plugins-config-volume\") pod \"5a964513-ab96-4651-9f11-2f8a807d91fe\" (UID: \"5a964513-ab96-4651-9f11-2f8a807d91fe\") "
Sep 11 13:22:39.036866 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.036829    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pngc9\" (UniqueName: \"kubernetes.io/projected/5a964513-ab96-4651-9f11-2f8a807d91fe-kube-api-access-pngc9\") pod \"5a964513-ab96-4651-9f11-2f8a807d91fe\" (UID: \"5a964513-ab96-4651-9f11-2f8a807d91fe\") "
Sep 11 13:22:39.036866 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.036851    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhsj7\" (UniqueName: \"kubernetes.io/projected/aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90-kube-api-access-bhsj7\") pod \"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90\" (UID: \"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90\") "
Sep 11 13:22:39.037165 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.037144    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a964513-ab96-4651-9f11-2f8a807d91fe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5a964513-ab96-4651-9f11-2f8a807d91fe" (UID: "5a964513-ab96-4651-9f11-2f8a807d91fe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:39.037239 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.037180    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90" (UID: "aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:39.038985 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.038959    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a964513-ab96-4651-9f11-2f8a807d91fe-kube-api-access-pngc9" (OuterVolumeSpecName: "kube-api-access-pngc9") pod "5a964513-ab96-4651-9f11-2f8a807d91fe" (UID: "5a964513-ab96-4651-9f11-2f8a807d91fe"). InnerVolumeSpecName "kube-api-access-pngc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:22:39.039087 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.038988    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90-kube-api-access-bhsj7" (OuterVolumeSpecName: "kube-api-access-bhsj7") pod "aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90" (UID: "aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90"). InnerVolumeSpecName "kube-api-access-bhsj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:22:39.138470 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.138442    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:39.138470 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.138469    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5a964513-ab96-4651-9f11-2f8a807d91fe-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:39.138669 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.138479    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pngc9\" (UniqueName: \"kubernetes.io/projected/5a964513-ab96-4651-9f11-2f8a807d91fe-kube-api-access-pngc9\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:39.138669 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.138491    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhsj7\" (UniqueName: \"kubernetes.io/projected/aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90-kube-api-access-bhsj7\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:39.714557 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.714527    2547 generic.go:356] "Generic (PLEG): container finished" podID="aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90" containerID="1373580aca261596ae2a5e02792160dfec60d7ed000a25b672937c0bb82bcdab" exitCode=0
Sep 11 13:22:39.714975 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.714582    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"
Sep 11 13:22:39.714975 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.714616    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf" event={"ID":"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90","Type":"ContainerDied","Data":"1373580aca261596ae2a5e02792160dfec60d7ed000a25b672937c0bb82bcdab"}
Sep 11 13:22:39.714975 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.714740    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf" event={"ID":"aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90","Type":"ContainerDied","Data":"32c196671843e8080711fcb0618f168b4cdf2a63d4e74bf092329d9403fe0351"}
Sep 11 13:22:39.714975 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.714777    2547 scope.go:117] "RemoveContainer" containerID="1373580aca261596ae2a5e02792160dfec60d7ed000a25b672937c0bb82bcdab"
Sep 11 13:22:39.716094 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.715793    2547 generic.go:356] "Generic (PLEG): container finished" podID="5a964513-ab96-4651-9f11-2f8a807d91fe" containerID="3dd481cf7c77ce1e9b18a27f6185361ef7ab6e6864c5053d7c9f2b003ad8bc74" exitCode=0
Sep 11 13:22:39.716094 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.715838    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"
Sep 11 13:22:39.716094 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.715867    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c" event={"ID":"5a964513-ab96-4651-9f11-2f8a807d91fe","Type":"ContainerDied","Data":"3dd481cf7c77ce1e9b18a27f6185361ef7ab6e6864c5053d7c9f2b003ad8bc74"}
Sep 11 13:22:39.716094 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.715916    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c" event={"ID":"5a964513-ab96-4651-9f11-2f8a807d91fe","Type":"ContainerDied","Data":"aecd7d908b21b2ac9e6ad78d17b3da304770fb8640eceb4cb6f31de7ad549e79"}
Sep 11 13:22:39.724191 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.724174    2547 scope.go:117] "RemoveContainer" containerID="1373580aca261596ae2a5e02792160dfec60d7ed000a25b672937c0bb82bcdab"
Sep 11 13:22:39.724442 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:22:39.724423    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1373580aca261596ae2a5e02792160dfec60d7ed000a25b672937c0bb82bcdab\": container with ID starting with 1373580aca261596ae2a5e02792160dfec60d7ed000a25b672937c0bb82bcdab not found: ID does not exist" containerID="1373580aca261596ae2a5e02792160dfec60d7ed000a25b672937c0bb82bcdab"
Sep 11 13:22:39.724501 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.724449    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1373580aca261596ae2a5e02792160dfec60d7ed000a25b672937c0bb82bcdab"} err="failed to get container status \"1373580aca261596ae2a5e02792160dfec60d7ed000a25b672937c0bb82bcdab\": rpc error: code = NotFound desc = could not find container \"1373580aca261596ae2a5e02792160dfec60d7ed000a25b672937c0bb82bcdab\": container with ID starting with 1373580aca261596ae2a5e02792160dfec60d7ed000a25b672937c0bb82bcdab not found: ID does not exist"
Sep 11 13:22:39.724501 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.724463    2547 scope.go:117] "RemoveContainer" containerID="3dd481cf7c77ce1e9b18a27f6185361ef7ab6e6864c5053d7c9f2b003ad8bc74"
Sep 11 13:22:39.732004 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.731989    2547 scope.go:117] "RemoveContainer" containerID="3dd481cf7c77ce1e9b18a27f6185361ef7ab6e6864c5053d7c9f2b003ad8bc74"
Sep 11 13:22:39.732244 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:22:39.732227    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dd481cf7c77ce1e9b18a27f6185361ef7ab6e6864c5053d7c9f2b003ad8bc74\": container with ID starting with 3dd481cf7c77ce1e9b18a27f6185361ef7ab6e6864c5053d7c9f2b003ad8bc74 not found: ID does not exist" containerID="3dd481cf7c77ce1e9b18a27f6185361ef7ab6e6864c5053d7c9f2b003ad8bc74"
Sep 11 13:22:39.732306 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.732248    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd481cf7c77ce1e9b18a27f6185361ef7ab6e6864c5053d7c9f2b003ad8bc74"} err="failed to get container status \"3dd481cf7c77ce1e9b18a27f6185361ef7ab6e6864c5053d7c9f2b003ad8bc74\": rpc error: code = NotFound desc = could not find container \"3dd481cf7c77ce1e9b18a27f6185361ef7ab6e6864c5053d7c9f2b003ad8bc74\": container with ID starting with 3dd481cf7c77ce1e9b18a27f6185361ef7ab6e6864c5053d7c9f2b003ad8bc74 not found: ID does not exist"
Sep 11 13:22:39.746281 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.746258    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"]
Sep 11 13:22:39.749235 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.749215    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-48a080-5b76759c89-dc4mf"]
Sep 11 13:22:39.775025 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.775003    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"]
Sep 11 13:22:39.778425 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:39.778406    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-48a080-7f5c5f9d4b-gxm6c"]
Sep 11 13:22:41.006816 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:41.006776    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a964513-ab96-4651-9f11-2f8a807d91fe" path="/var/lib/kubelet/pods/5a964513-ab96-4651-9f11-2f8a807d91fe/volumes"
Sep 11 13:22:41.007337 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:41.007278    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90" path="/var/lib/kubelet/pods/aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90/volumes"
Sep 11 13:22:43.121481 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:43.121447    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:22:46.021931 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:46.021898    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"]
Sep 11 13:22:46.022342 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:46.022149    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv" podUID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerName="istio-proxy" containerID="cri-o://2b3e287011347cfc36c5b0665cd884b8fadecce5f7ff23c7b155135723534298" gracePeriod=30
Sep 11 13:22:49.884963 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.884929    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs"]
Sep 11 13:22:49.885350 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.885263    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a964513-ab96-4651-9f11-2f8a807d91fe" containerName="payload-pre-processing"
Sep 11 13:22:49.885350 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.885275    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a964513-ab96-4651-9f11-2f8a807d91fe" containerName="payload-pre-processing"
Sep 11 13:22:49.885350 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.885287    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90" containerName="payload-processing"
Sep 11 13:22:49.885350 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.885293    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90" containerName="payload-processing"
Sep 11 13:22:49.885350 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.885304    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92f4171f-603d-4399-9a6d-69ed35cf2170" containerName="revoke-keys"
Sep 11 13:22:49.885350 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.885309    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="92f4171f-603d-4399-9a6d-69ed35cf2170" containerName="revoke-keys"
Sep 11 13:22:49.885575 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.885366    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="92f4171f-603d-4399-9a6d-69ed35cf2170" containerName="revoke-keys"
Sep 11 13:22:49.885575 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.885372    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a964513-ab96-4651-9f11-2f8a807d91fe" containerName="payload-pre-processing"
Sep 11 13:22:49.885575 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.885378    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa1bbde9-2518-4ca0-b5fe-4e9feefbfa90" containerName="payload-processing"
Sep 11 13:22:49.889640 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.889623    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs"
Sep 11 13:22:49.892066 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.892045    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:22:49.892430 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.892413    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:22:49.906484 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.906459    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs"]
Sep 11 13:22:49.935955 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:49.935934    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f17c9b0-eb03-4c23-bd38-c4af95e15fba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs\" (UID: \"8f17c9b0-eb03-4c23-bd38-c4af95e15fba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs"
Sep 11 13:22:50.036558 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:50.036532    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f17c9b0-eb03-4c23-bd38-c4af95e15fba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs\" (UID: \"8f17c9b0-eb03-4c23-bd38-c4af95e15fba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs"
Sep 11 13:22:50.037129 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:50.037111    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f17c9b0-eb03-4c23-bd38-c4af95e15fba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs\" (UID: \"8f17c9b0-eb03-4c23-bd38-c4af95e15fba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs"
Sep 11 13:22:50.199323 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:50.199249    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs"
Sep 11 13:22:50.468109 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:50.468084    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs"]
Sep 11 13:22:50.470697 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:22:50.470668    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f17c9b0_eb03_4c23_bd38_c4af95e15fba.slice/crio-db7488974d5665fc44366e2c850a9dc1e5a2dbfadeab7900ea90229cf13ab112 WatchSource:0}: Error finding container db7488974d5665fc44366e2c850a9dc1e5a2dbfadeab7900ea90229cf13ab112: Status 404 returned error can't find the container with id db7488974d5665fc44366e2c850a9dc1e5a2dbfadeab7900ea90229cf13ab112
Sep 11 13:22:50.773539 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:50.773509    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs" event={"ID":"8f17c9b0-eb03-4c23-bd38-c4af95e15fba","Type":"ContainerStarted","Data":"8fb47b013fec4d458334b45ef9eb98fd5d09637809140731cf1d310a04fb86bd"}
Sep 11 13:22:50.773691 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:50.773603    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs" event={"ID":"8f17c9b0-eb03-4c23-bd38-c4af95e15fba","Type":"ContainerStarted","Data":"db7488974d5665fc44366e2c850a9dc1e5a2dbfadeab7900ea90229cf13ab112"}
Sep 11 13:22:50.792842 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:50.792800    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs" podStartSLOduration=1.792786934 podStartE2EDuration="1.792786934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:22:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:22:50.791629313 +0000 UTC m=+1640.295493707" watchObservedRunningTime="2026-09-11 13:22:50.792786934 +0000 UTC m=+1640.296651382"
Sep 11 13:22:51.267772 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.267748    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:22:51.348675 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.348591    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-workload-certs\") pod \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") "
Sep 11 13:22:51.348675 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.348632    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-workload-socket\") pod \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") "
Sep 11 13:22:51.348911 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.348689    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98zmx\" (UniqueName: \"kubernetes.io/projected/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-kube-api-access-98zmx\") pod \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") "
Sep 11 13:22:51.348911 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.348745    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-envoy\") pod \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") "
Sep 11 13:22:51.348911 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.348781    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-credential-socket\") pod \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") "
Sep 11 13:22:51.348911 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.348829    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-token\") pod \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") "
Sep 11 13:22:51.348911 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.348857    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-data\") pod \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") "
Sep 11 13:22:51.348911 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.348887    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-podinfo\") pod \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") "
Sep 11 13:22:51.348911 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.348889    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" (UID: "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:22:51.349265 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.348914    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istiod-ca-cert\") pod \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\" (UID: \"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a\") "
Sep 11 13:22:51.349265 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.348986    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" (UID: "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:22:51.349265 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.349129    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" (UID: "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:22:51.349265 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.349203    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" (UID: "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:22:51.349265 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.349250    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:51.349265 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.349269    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:51.349574 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.349280    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:51.349574 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.349561    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" (UID: "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:51.350971 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.350950    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-kube-api-access-98zmx" (OuterVolumeSpecName: "kube-api-access-98zmx") pod "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" (UID: "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a"). InnerVolumeSpecName "kube-api-access-98zmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:22:51.351066 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.351026    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" (UID: "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:22:51.351377 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.351359    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" (UID: "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:22:51.351427 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.351391    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" (UID: "9dc9ade9-afe2-4ee2-8b54-f9c1587f885a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:22:51.450366 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.450334    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98zmx\" (UniqueName: \"kubernetes.io/projected/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-kube-api-access-98zmx\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:51.450366 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.450363    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:51.450568 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.450376    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:51.450568 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.450386    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:51.450568 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.450397    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:51.450568 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.450407    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:51.780152 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.780122    2547 generic.go:356] "Generic (PLEG): container finished" podID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerID="2b3e287011347cfc36c5b0665cd884b8fadecce5f7ff23c7b155135723534298" exitCode=0
Sep 11 13:22:51.780315 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.780167    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"
Sep 11 13:22:51.780315 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.780198    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv" event={"ID":"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a","Type":"ContainerDied","Data":"2b3e287011347cfc36c5b0665cd884b8fadecce5f7ff23c7b155135723534298"}
Sep 11 13:22:51.780315 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.780260    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv" event={"ID":"9dc9ade9-afe2-4ee2-8b54-f9c1587f885a","Type":"ContainerDied","Data":"6a838882b6109e9370ffb1318a650c7a700be396f6c19393c47c607f9e9ab8d0"}
Sep 11 13:22:51.780315 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.780287    2547 scope.go:117] "RemoveContainer" containerID="2b3e287011347cfc36c5b0665cd884b8fadecce5f7ff23c7b155135723534298"
Sep 11 13:22:51.781851 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.781831    2547 generic.go:356] "Generic (PLEG): container finished" podID="8f17c9b0-eb03-4c23-bd38-c4af95e15fba" containerID="8fb47b013fec4d458334b45ef9eb98fd5d09637809140731cf1d310a04fb86bd" exitCode=0
Sep 11 13:22:51.781968 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.781907    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs" event={"ID":"8f17c9b0-eb03-4c23-bd38-c4af95e15fba","Type":"ContainerDied","Data":"8fb47b013fec4d458334b45ef9eb98fd5d09637809140731cf1d310a04fb86bd"}
Sep 11 13:22:51.789043 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.789027    2547 scope.go:117] "RemoveContainer" containerID="ce869acccdcbf0290f28574fd5e19a38d8f676483720a0675a660108c67ecba9"
Sep 11 13:22:51.796263 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.796247    2547 scope.go:117] "RemoveContainer" containerID="2b3e287011347cfc36c5b0665cd884b8fadecce5f7ff23c7b155135723534298"
Sep 11 13:22:51.796508 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:22:51.796489    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b3e287011347cfc36c5b0665cd884b8fadecce5f7ff23c7b155135723534298\": container with ID starting with 2b3e287011347cfc36c5b0665cd884b8fadecce5f7ff23c7b155135723534298 not found: ID does not exist" containerID="2b3e287011347cfc36c5b0665cd884b8fadecce5f7ff23c7b155135723534298"
Sep 11 13:22:51.796570 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.796514    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b3e287011347cfc36c5b0665cd884b8fadecce5f7ff23c7b155135723534298"} err="failed to get container status \"2b3e287011347cfc36c5b0665cd884b8fadecce5f7ff23c7b155135723534298\": rpc error: code = NotFound desc = could not find container \"2b3e287011347cfc36c5b0665cd884b8fadecce5f7ff23c7b155135723534298\": container with ID starting with 2b3e287011347cfc36c5b0665cd884b8fadecce5f7ff23c7b155135723534298 not found: ID does not exist"
Sep 11 13:22:51.796570 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.796531    2547 scope.go:117] "RemoveContainer" containerID="ce869acccdcbf0290f28574fd5e19a38d8f676483720a0675a660108c67ecba9"
Sep 11 13:22:51.796764 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:22:51.796745    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce869acccdcbf0290f28574fd5e19a38d8f676483720a0675a660108c67ecba9\": container with ID starting with ce869acccdcbf0290f28574fd5e19a38d8f676483720a0675a660108c67ecba9 not found: ID does not exist" containerID="ce869acccdcbf0290f28574fd5e19a38d8f676483720a0675a660108c67ecba9"
Sep 11 13:22:51.796825 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.796769    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce869acccdcbf0290f28574fd5e19a38d8f676483720a0675a660108c67ecba9"} err="failed to get container status \"ce869acccdcbf0290f28574fd5e19a38d8f676483720a0675a660108c67ecba9\": rpc error: code = NotFound desc = could not find container \"ce869acccdcbf0290f28574fd5e19a38d8f676483720a0675a660108c67ecba9\": container with ID starting with ce869acccdcbf0290f28574fd5e19a38d8f676483720a0675a660108c67ecba9 not found: ID does not exist"
Sep 11 13:22:51.827577 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.827554    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"]
Sep 11 13:22:51.834822 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:51.834798    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-48a080-openshift-default-65dd7c5546-jb5gv"]
Sep 11 13:22:52.919348 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:52.919323    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs"
Sep 11 13:22:52.962004 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:52.961974    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f17c9b0-eb03-4c23-bd38-c4af95e15fba-maas-api-service-ca\") pod \"8f17c9b0-eb03-4c23-bd38-c4af95e15fba\" (UID: \"8f17c9b0-eb03-4c23-bd38-c4af95e15fba\") "
Sep 11 13:22:52.962300 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:52.962281    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f17c9b0-eb03-4c23-bd38-c4af95e15fba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8f17c9b0-eb03-4c23-bd38-c4af95e15fba" (UID: "8f17c9b0-eb03-4c23-bd38-c4af95e15fba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:22:53.006084 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:53.006050    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" path="/var/lib/kubelet/pods/9dc9ade9-afe2-4ee2-8b54-f9c1587f885a/volumes"
Sep 11 13:22:53.063611 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:53.063546    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f17c9b0-eb03-4c23-bd38-c4af95e15fba-maas-api-service-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:22:53.793460 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:53.793429    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs"
Sep 11 13:22:53.793614 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:53.793474    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs" event={"ID":"8f17c9b0-eb03-4c23-bd38-c4af95e15fba","Type":"ContainerDied","Data":"db7488974d5665fc44366e2c850a9dc1e5a2dbfadeab7900ea90229cf13ab112"}
Sep 11 13:22:53.793614 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:22:53.793518    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db7488974d5665fc44366e2c850a9dc1e5a2dbfadeab7900ea90229cf13ab112"
Sep 11 13:23:03.218388 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:03.218353    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:23:06.075894 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:06.075854    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs"]
Sep 11 13:23:06.080415 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:06.080388    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-cc857f-2wcbs"]
Sep 11 13:23:07.007138 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:07.007093    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f17c9b0-eb03-4c23-bd38-c4af95e15fba" path="/var/lib/kubelet/pods/8f17c9b0-eb03-4c23-bd38-c4af95e15fba/volumes"
Sep 11 13:23:11.469704 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:11.469665    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"]
Sep 11 13:23:17.543249 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:17.543213    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:23:26.489065 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.489007    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2" podUID="14a79c79-0d66-4d4b-8241-9cf0b33e1a88" containerName="main" containerID="cri-o://21d42cbad4fbbd4194e5378e74d3060422bdb591b8d91723703d453d7cc9686d" gracePeriod=45
Sep 11 13:23:26.729006 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.728981    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:23:26.843307 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.843282    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-tmp-dir\") pod \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") "
Sep 11 13:23:26.843474 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.843337    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-dshm\") pod \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") "
Sep 11 13:23:26.843474 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.843362    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-model-cache\") pod \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") "
Sep 11 13:23:26.843474 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.843395    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-tls-certs\") pod \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") "
Sep 11 13:23:26.843474 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.843432    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrrdw\" (UniqueName: \"kubernetes.io/projected/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-kube-api-access-xrrdw\") pod \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") "
Sep 11 13:23:26.843474 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.843454    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-home\") pod \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\" (UID: \"14a79c79-0d66-4d4b-8241-9cf0b33e1a88\") "
Sep 11 13:23:26.843786 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.843551    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "14a79c79-0d66-4d4b-8241-9cf0b33e1a88" (UID: "14a79c79-0d66-4d4b-8241-9cf0b33e1a88"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:23:26.843786 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.843635    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-model-cache" (OuterVolumeSpecName: "model-cache") pod "14a79c79-0d66-4d4b-8241-9cf0b33e1a88" (UID: "14a79c79-0d66-4d4b-8241-9cf0b33e1a88"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:23:26.843786 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.843697    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-tmp-dir\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:23:26.843914 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.843801    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-home" (OuterVolumeSpecName: "home") pod "14a79c79-0d66-4d4b-8241-9cf0b33e1a88" (UID: "14a79c79-0d66-4d4b-8241-9cf0b33e1a88"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:23:26.845539 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.845519    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "14a79c79-0d66-4d4b-8241-9cf0b33e1a88" (UID: "14a79c79-0d66-4d4b-8241-9cf0b33e1a88"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:23:26.845622 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.845522    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-dshm" (OuterVolumeSpecName: "dshm") pod "14a79c79-0d66-4d4b-8241-9cf0b33e1a88" (UID: "14a79c79-0d66-4d4b-8241-9cf0b33e1a88"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:23:26.845622 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.845572    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-kube-api-access-xrrdw" (OuterVolumeSpecName: "kube-api-access-xrrdw") pod "14a79c79-0d66-4d4b-8241-9cf0b33e1a88" (UID: "14a79c79-0d66-4d4b-8241-9cf0b33e1a88"). InnerVolumeSpecName "kube-api-access-xrrdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:23:26.944659 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.944633    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-home\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:23:26.944659 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.944655    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-dshm\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:23:26.944850 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.944664    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-model-cache\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:23:26.944850 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.944673    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-tls-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:23:26.944850 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.944682    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrrdw\" (UniqueName: \"kubernetes.io/projected/14a79c79-0d66-4d4b-8241-9cf0b33e1a88-kube-api-access-xrrdw\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:23:26.948482 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.948457    2547 generic.go:356] "Generic (PLEG): container finished" podID="14a79c79-0d66-4d4b-8241-9cf0b33e1a88" containerID="21d42cbad4fbbd4194e5378e74d3060422bdb591b8d91723703d453d7cc9686d" exitCode=0
Sep 11 13:23:26.948572 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.948504    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"
Sep 11 13:23:26.948572 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.948531    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2" event={"ID":"14a79c79-0d66-4d4b-8241-9cf0b33e1a88","Type":"ContainerDied","Data":"21d42cbad4fbbd4194e5378e74d3060422bdb591b8d91723703d453d7cc9686d"}
Sep 11 13:23:26.948647 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.948569    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2" event={"ID":"14a79c79-0d66-4d4b-8241-9cf0b33e1a88","Type":"ContainerDied","Data":"59eb64a7ce9be2de42672358de3031bbb9fafcbb279b617ec53f0c8e4cb92eb0"}
Sep 11 13:23:26.948647 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.948593    2547 scope.go:117] "RemoveContainer" containerID="21d42cbad4fbbd4194e5378e74d3060422bdb591b8d91723703d453d7cc9686d"
Sep 11 13:23:26.962749 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.962727    2547 scope.go:117] "RemoveContainer" containerID="21d42cbad4fbbd4194e5378e74d3060422bdb591b8d91723703d453d7cc9686d"
Sep 11 13:23:26.963050 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:23:26.963021    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21d42cbad4fbbd4194e5378e74d3060422bdb591b8d91723703d453d7cc9686d\": container with ID starting with 21d42cbad4fbbd4194e5378e74d3060422bdb591b8d91723703d453d7cc9686d not found: ID does not exist" containerID="21d42cbad4fbbd4194e5378e74d3060422bdb591b8d91723703d453d7cc9686d"
Sep 11 13:23:26.963108 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.963057    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21d42cbad4fbbd4194e5378e74d3060422bdb591b8d91723703d453d7cc9686d"} err="failed to get container status \"21d42cbad4fbbd4194e5378e74d3060422bdb591b8d91723703d453d7cc9686d\": rpc error: code = NotFound desc = could not find container \"21d42cbad4fbbd4194e5378e74d3060422bdb591b8d91723703d453d7cc9686d\": container with ID starting with 21d42cbad4fbbd4194e5378e74d3060422bdb591b8d91723703d453d7cc9686d not found: ID does not exist"
Sep 11 13:23:26.974574 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.974549    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"]
Sep 11 13:23:26.979268 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:26.979249    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-cc857f/ipp-route-cc857f-kserve-645b8f8c87-24nf2"]
Sep 11 13:23:27.005986 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:27.005963    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14a79c79-0d66-4d4b-8241-9cf0b33e1a88" path="/var/lib/kubelet/pods/14a79c79-0d66-4d4b-8241-9cf0b33e1a88/volumes"
Sep 11 13:23:31.308858 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:23:31.308828    2547 scope.go:117] "RemoveContainer" containerID="90f288976cac281211ccd125e91a6b820832f37e4cd957a6156d6f3bcadfbdd8"
Sep 11 13:24:01.354767 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.354671    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"]
Sep 11 13:24:01.355263 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.354913    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy" containerID="cri-o://36edf0da85e276ba9939304ecfaed2001d16506bdc9533cc4223d998ca8e798f" gracePeriod=30
Sep 11 13:24:01.802942 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.802913    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql"]
Sep 11 13:24:01.803258 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.803245    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14a79c79-0d66-4d4b-8241-9cf0b33e1a88" containerName="main"
Sep 11 13:24:01.803309 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.803260    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="14a79c79-0d66-4d4b-8241-9cf0b33e1a88" containerName="main"
Sep 11 13:24:01.803309 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.803272    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerName="istio-proxy"
Sep 11 13:24:01.803309 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.803278    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerName="istio-proxy"
Sep 11 13:24:01.803309 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.803285    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerName="istio-proxy"
Sep 11 13:24:01.803309 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.803292    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerName="istio-proxy"
Sep 11 13:24:01.803309 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.803302    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f17c9b0-eb03-4c23-bd38-c4af95e15fba" containerName="revoke-keys"
Sep 11 13:24:01.803309 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.803308    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f17c9b0-eb03-4c23-bd38-c4af95e15fba" containerName="revoke-keys"
Sep 11 13:24:01.803532 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.803356    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerName="istio-proxy"
Sep 11 13:24:01.803532 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.803363    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="14a79c79-0d66-4d4b-8241-9cf0b33e1a88" containerName="main"
Sep 11 13:24:01.803532 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.803369    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dc9ade9-afe2-4ee2-8b54-f9c1587f885a" containerName="istio-proxy"
Sep 11 13:24:01.803532 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.803375    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f17c9b0-eb03-4c23-bd38-c4af95e15fba" containerName="revoke-keys"
Sep 11 13:24:01.806312 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.806295    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql"
Sep 11 13:24:01.811972 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.811948    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:24:01.811972 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.811966    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:24:01.831173 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.831141    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql"]
Sep 11 13:24:01.911892 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:01.911860    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abc9c304-5f77-4a53-b93b-f2d2012904ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql\" (UID: \"abc9c304-5f77-4a53-b93b-f2d2012904ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql"
Sep 11 13:24:02.013036 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:02.013005    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abc9c304-5f77-4a53-b93b-f2d2012904ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql\" (UID: \"abc9c304-5f77-4a53-b93b-f2d2012904ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql"
Sep 11 13:24:02.013581 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:02.013561    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abc9c304-5f77-4a53-b93b-f2d2012904ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql\" (UID: \"abc9c304-5f77-4a53-b93b-f2d2012904ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql"
Sep 11 13:24:02.116021 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:02.115933    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql"
Sep 11 13:24:02.392811 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:02.392736    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql"]
Sep 11 13:24:02.395830 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:24:02.395799    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabc9c304_5f77_4a53_b93b_f2d2012904ca.slice/crio-2cbb4545f13c91017935be322ac819036a53ca2df275e4b2a50c7afaf28d7ced WatchSource:0}: Error finding container 2cbb4545f13c91017935be322ac819036a53ca2df275e4b2a50c7afaf28d7ced: Status 404 returned error can't find the container with id 2cbb4545f13c91017935be322ac819036a53ca2df275e4b2a50c7afaf28d7ced
Sep 11 13:24:03.114322 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:03.114294    2547 generic.go:356] "Generic (PLEG): container finished" podID="abc9c304-5f77-4a53-b93b-f2d2012904ca" containerID="66445ddf7bb6eda5c1268dca8694396f9984226f13ef26cb3b0b88e818b6296d" exitCode=0
Sep 11 13:24:03.114457 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:03.114352    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql" event={"ID":"abc9c304-5f77-4a53-b93b-f2d2012904ca","Type":"ContainerDied","Data":"66445ddf7bb6eda5c1268dca8694396f9984226f13ef26cb3b0b88e818b6296d"}
Sep 11 13:24:03.114457 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:03.114413    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql" event={"ID":"abc9c304-5f77-4a53-b93b-f2d2012904ca","Type":"ContainerStarted","Data":"2cbb4545f13c91017935be322ac819036a53ca2df275e4b2a50c7afaf28d7ced"}
Sep 11 13:24:04.244155 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:04.244132    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql"
Sep 11 13:24:04.333355 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:04.333332    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abc9c304-5f77-4a53-b93b-f2d2012904ca-maas-api-service-ca\") pod \"abc9c304-5f77-4a53-b93b-f2d2012904ca\" (UID: \"abc9c304-5f77-4a53-b93b-f2d2012904ca\") "
Sep 11 13:24:04.333649 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:04.333628    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abc9c304-5f77-4a53-b93b-f2d2012904ca-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "abc9c304-5f77-4a53-b93b-f2d2012904ca" (UID: "abc9c304-5f77-4a53-b93b-f2d2012904ca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:04.434596 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:04.434543    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/abc9c304-5f77-4a53-b93b-f2d2012904ca-maas-api-service-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:05.125559 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:05.125526    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql"
Sep 11 13:24:05.125559 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:05.125549    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql" event={"ID":"abc9c304-5f77-4a53-b93b-f2d2012904ca","Type":"ContainerDied","Data":"2cbb4545f13c91017935be322ac819036a53ca2df275e4b2a50c7afaf28d7ced"}
Sep 11 13:24:05.125762 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:05.125595    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2cbb4545f13c91017935be322ac819036a53ca2df275e4b2a50c7afaf28d7ced"
Sep 11 13:24:06.612226 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.612165    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:24:06.753579 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.753552    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-data\") pod \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") "
Sep 11 13:24:06.753776 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.753589    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-podinfo\") pod \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") "
Sep 11 13:24:06.753776 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.753651    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-workload-certs\") pod \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") "
Sep 11 13:24:06.753776 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.753674    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istiod-ca-cert\") pod \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") "
Sep 11 13:24:06.753776 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.753710    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4d2f4\" (UniqueName: \"kubernetes.io/projected/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-kube-api-access-4d2f4\") pod \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") "
Sep 11 13:24:06.753776 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.753771    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-token\") pod \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") "
Sep 11 13:24:06.754033 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.753797    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-workload-socket\") pod \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") "
Sep 11 13:24:06.754033 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.753824    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-data" (OuterVolumeSpecName: "istio-data") pod "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" (UID: "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:06.754033 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.753837    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-envoy\") pod \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") "
Sep 11 13:24:06.754033 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.753922    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-credential-socket\") pod \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\" (UID: \"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713\") "
Sep 11 13:24:06.754033 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.753944    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" (UID: "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:06.754311 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.754125    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" (UID: "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:06.754311 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.754182    2547 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-workload-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:06.754311 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.754199    2547 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-data\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:06.754311 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.754225    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" (UID: "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:06.754518 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.754361    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" (UID: "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:06.756041 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.756011    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-kube-api-access-4d2f4" (OuterVolumeSpecName: "kube-api-access-4d2f4") pod "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" (UID: "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713"). InnerVolumeSpecName "kube-api-access-4d2f4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:24:06.756169 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.756102    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-token" (OuterVolumeSpecName: "istio-token") pod "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" (UID: "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:24:06.756337 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.756317    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" (UID: "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:24:06.756337 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.756323    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" (UID: "9a35c0bf-f9b5-449e-ac48-f68dd7dfe713"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 13:24:06.854920 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.854892    2547 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-envoy\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:06.854920 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.854916    2547 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-credential-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:06.855063 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.854926    2547 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-podinfo\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:06.855063 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.854935    2547 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istiod-ca-cert\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:06.855063 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.854943    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4d2f4\" (UniqueName: \"kubernetes.io/projected/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-kube-api-access-4d2f4\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:06.855063 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.854952    2547 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-istio-token\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:06.855063 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:06.854959    2547 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713-workload-socket\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:07.136688 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:07.136657    2547 generic.go:356] "Generic (PLEG): container finished" podID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerID="36edf0da85e276ba9939304ecfaed2001d16506bdc9533cc4223d998ca8e798f" exitCode=0
Sep 11 13:24:07.136877 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:07.136694    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" event={"ID":"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713","Type":"ContainerDied","Data":"36edf0da85e276ba9939304ecfaed2001d16506bdc9533cc4223d998ca8e798f"}
Sep 11 13:24:07.136877 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:07.136733    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"
Sep 11 13:24:07.136877 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:07.136756    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557" event={"ID":"9a35c0bf-f9b5-449e-ac48-f68dd7dfe713","Type":"ContainerDied","Data":"8c1980e717ac7b2e65e41ecaf40730e1ac39c716ae2e6bfd71a080ebb1b89850"}
Sep 11 13:24:07.136877 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:07.136778    2547 scope.go:117] "RemoveContainer" containerID="36edf0da85e276ba9939304ecfaed2001d16506bdc9533cc4223d998ca8e798f"
Sep 11 13:24:07.147602 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:07.147581    2547 scope.go:117] "RemoveContainer" containerID="003202e3124b877b0bca34895580e3bb49868170a35d11811e92ae160783c72c"
Sep 11 13:24:07.155859 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:07.155836    2547 scope.go:117] "RemoveContainer" containerID="36edf0da85e276ba9939304ecfaed2001d16506bdc9533cc4223d998ca8e798f"
Sep 11 13:24:07.156194 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:24:07.156165    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36edf0da85e276ba9939304ecfaed2001d16506bdc9533cc4223d998ca8e798f\": container with ID starting with 36edf0da85e276ba9939304ecfaed2001d16506bdc9533cc4223d998ca8e798f not found: ID does not exist" containerID="36edf0da85e276ba9939304ecfaed2001d16506bdc9533cc4223d998ca8e798f"
Sep 11 13:24:07.156194 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:07.156204    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36edf0da85e276ba9939304ecfaed2001d16506bdc9533cc4223d998ca8e798f"} err="failed to get container status \"36edf0da85e276ba9939304ecfaed2001d16506bdc9533cc4223d998ca8e798f\": rpc error: code = NotFound desc = could not find container \"36edf0da85e276ba9939304ecfaed2001d16506bdc9533cc4223d998ca8e798f\": container with ID starting with 36edf0da85e276ba9939304ecfaed2001d16506bdc9533cc4223d998ca8e798f not found: ID does not exist"
Sep 11 13:24:07.156194 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:07.156225    2547 scope.go:117] "RemoveContainer" containerID="003202e3124b877b0bca34895580e3bb49868170a35d11811e92ae160783c72c"
Sep 11 13:24:07.156672 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:24:07.156648    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"003202e3124b877b0bca34895580e3bb49868170a35d11811e92ae160783c72c\": container with ID starting with 003202e3124b877b0bca34895580e3bb49868170a35d11811e92ae160783c72c not found: ID does not exist" containerID="003202e3124b877b0bca34895580e3bb49868170a35d11811e92ae160783c72c"
Sep 11 13:24:07.157137 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:07.156679    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"003202e3124b877b0bca34895580e3bb49868170a35d11811e92ae160783c72c"} err="failed to get container status \"003202e3124b877b0bca34895580e3bb49868170a35d11811e92ae160783c72c\": rpc error: code = NotFound desc = could not find container \"003202e3124b877b0bca34895580e3bb49868170a35d11811e92ae160783c72c\": container with ID starting with 003202e3124b877b0bca34895580e3bb49868170a35d11811e92ae160783c72c not found: ID does not exist"
Sep 11 13:24:07.158408 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:07.158382    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"]
Sep 11 13:24:07.160046 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:07.160026    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-cc857f-openshift-default-5c69c696b6-fm557"]
Sep 11 13:24:09.006978 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:09.006946    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" path="/var/lib/kubelet/pods/9a35c0bf-f9b5-449e-ac48-f68dd7dfe713/volumes"
Sep 11 13:24:12.922635 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:12.922605    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql"]
Sep 11 13:24:12.928544 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:12.928515    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-e3f42f-dqzql"]
Sep 11 13:24:13.006679 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:13.006644    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abc9c304-5f77-4a53-b93b-f2d2012904ca" path="/var/lib/kubelet/pods/abc9c304-5f77-4a53-b93b-f2d2012904ca/volumes"
Sep 11 13:24:16.223799 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:16.223767    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:24:20.090411 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.090379    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8"]
Sep 11 13:24:20.090879 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.090703    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abc9c304-5f77-4a53-b93b-f2d2012904ca" containerName="revoke-keys"
Sep 11 13:24:20.090879 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.090731    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="abc9c304-5f77-4a53-b93b-f2d2012904ca" containerName="revoke-keys"
Sep 11 13:24:20.090879 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.090748    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy"
Sep 11 13:24:20.090879 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.090753    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy"
Sep 11 13:24:20.090879 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.090763    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy"
Sep 11 13:24:20.090879 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.090769    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy"
Sep 11 13:24:20.090879 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.090820    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy"
Sep 11 13:24:20.090879 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.090828    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a35c0bf-f9b5-449e-ac48-f68dd7dfe713" containerName="istio-proxy"
Sep 11 13:24:20.090879 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.090835    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="abc9c304-5f77-4a53-b93b-f2d2012904ca" containerName="revoke-keys"
Sep 11 13:24:20.094754 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.094710    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8"
Sep 11 13:24:20.097653 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.097633    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:24:20.097773 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.097642    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:24:20.105419 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.105394    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8"]
Sep 11 13:24:20.263757 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.263706    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4ec4b75-5dd9-4422-9103-96cc244c3d9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8\" (UID: \"f4ec4b75-5dd9-4422-9103-96cc244c3d9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8"
Sep 11 13:24:20.364214 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.364129    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4ec4b75-5dd9-4422-9103-96cc244c3d9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8\" (UID: \"f4ec4b75-5dd9-4422-9103-96cc244c3d9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8"
Sep 11 13:24:20.364780 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.364760    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4ec4b75-5dd9-4422-9103-96cc244c3d9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8\" (UID: \"f4ec4b75-5dd9-4422-9103-96cc244c3d9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8"
Sep 11 13:24:20.405797 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.405768    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8"
Sep 11 13:24:20.677289 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:20.677263    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8"]
Sep 11 13:24:20.679592 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:24:20.679563    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ec4b75_5dd9_4422_9103_96cc244c3d9b.slice/crio-6ea6dc5a62646c367dc81fadb9dab9cdd0a50c3630d8122a26d12f468fbf249c WatchSource:0}: Error finding container 6ea6dc5a62646c367dc81fadb9dab9cdd0a50c3630d8122a26d12f468fbf249c: Status 404 returned error can't find the container with id 6ea6dc5a62646c367dc81fadb9dab9cdd0a50c3630d8122a26d12f468fbf249c
Sep 11 13:24:21.202806 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:21.202696    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8" event={"ID":"f4ec4b75-5dd9-4422-9103-96cc244c3d9b","Type":"ContainerStarted","Data":"cf36588c288f6631f443fe75ea93f1fc2fcecb062d38287686790a44e82fc246"}
Sep 11 13:24:21.202806 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:21.202765    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8" event={"ID":"f4ec4b75-5dd9-4422-9103-96cc244c3d9b","Type":"ContainerStarted","Data":"6ea6dc5a62646c367dc81fadb9dab9cdd0a50c3630d8122a26d12f468fbf249c"}
Sep 11 13:24:21.219509 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:21.219461    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8" podStartSLOduration=1.21944669 podStartE2EDuration="1.21944669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:24:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:24:21.217843838 +0000 UTC m=+1730.721708231" watchObservedRunningTime="2026-09-11 13:24:21.21944669 +0000 UTC m=+1730.723311083"
Sep 11 13:24:22.208892 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:22.208857    2547 generic.go:356] "Generic (PLEG): container finished" podID="f4ec4b75-5dd9-4422-9103-96cc244c3d9b" containerID="cf36588c288f6631f443fe75ea93f1fc2fcecb062d38287686790a44e82fc246" exitCode=0
Sep 11 13:24:22.209278 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:22.208901    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8" event={"ID":"f4ec4b75-5dd9-4422-9103-96cc244c3d9b","Type":"ContainerDied","Data":"cf36588c288f6631f443fe75ea93f1fc2fcecb062d38287686790a44e82fc246"}
Sep 11 13:24:23.340631 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:23.340607    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8"
Sep 11 13:24:23.492731 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:23.492624    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4ec4b75-5dd9-4422-9103-96cc244c3d9b-maas-api-service-ca\") pod \"f4ec4b75-5dd9-4422-9103-96cc244c3d9b\" (UID: \"f4ec4b75-5dd9-4422-9103-96cc244c3d9b\") "
Sep 11 13:24:23.493031 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:23.493008    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ec4b75-5dd9-4422-9103-96cc244c3d9b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f4ec4b75-5dd9-4422-9103-96cc244c3d9b" (UID: "f4ec4b75-5dd9-4422-9103-96cc244c3d9b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:23.594102 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:23.594074    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4ec4b75-5dd9-4422-9103-96cc244c3d9b-maas-api-service-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:24.219196 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:24.219166    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8"
Sep 11 13:24:24.219370 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:24.219198    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8" event={"ID":"f4ec4b75-5dd9-4422-9103-96cc244c3d9b","Type":"ContainerDied","Data":"6ea6dc5a62646c367dc81fadb9dab9cdd0a50c3630d8122a26d12f468fbf249c"}
Sep 11 13:24:24.219370 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:24.219246    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6ea6dc5a62646c367dc81fadb9dab9cdd0a50c3630d8122a26d12f468fbf249c"
Sep 11 13:24:30.791850 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:30.791820    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"]
Sep 11 13:24:30.792277 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:30.792021    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5" podUID="d5185271-07ec-431e-b79a-f7fa7d61d3c7" containerName="payload-processing" containerID="cri-o://768d35930efc0d99e24a17e1a9fc901043ed287c2861daca8bb21a29043e5c29" gracePeriod=30
Sep 11 13:24:30.801398 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:30.801363    2547 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5" podUID="d5185271-07ec-431e-b79a-f7fa7d61d3c7" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.48:9004: connect: connection refused"
Sep 11 13:24:31.019288 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.019257    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8"]
Sep 11 13:24:31.032550 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.032525    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-1841da-rr8v8"]
Sep 11 13:24:31.046673 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.046618    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"
Sep 11 13:24:31.157033 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.157004    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5185271-07ec-431e-b79a-f7fa7d61d3c7-plugins-config-volume\") pod \"d5185271-07ec-431e-b79a-f7fa7d61d3c7\" (UID: \"d5185271-07ec-431e-b79a-f7fa7d61d3c7\") "
Sep 11 13:24:31.157199 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.157056    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdglc\" (UniqueName: \"kubernetes.io/projected/d5185271-07ec-431e-b79a-f7fa7d61d3c7-kube-api-access-zdglc\") pod \"d5185271-07ec-431e-b79a-f7fa7d61d3c7\" (UID: \"d5185271-07ec-431e-b79a-f7fa7d61d3c7\") "
Sep 11 13:24:31.157428 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.157398    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5185271-07ec-431e-b79a-f7fa7d61d3c7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d5185271-07ec-431e-b79a-f7fa7d61d3c7" (UID: "d5185271-07ec-431e-b79a-f7fa7d61d3c7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:31.159107 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.159085    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5185271-07ec-431e-b79a-f7fa7d61d3c7-kube-api-access-zdglc" (OuterVolumeSpecName: "kube-api-access-zdglc") pod "d5185271-07ec-431e-b79a-f7fa7d61d3c7" (UID: "d5185271-07ec-431e-b79a-f7fa7d61d3c7"). InnerVolumeSpecName "kube-api-access-zdglc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:24:31.254597 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.254560    2547 generic.go:356] "Generic (PLEG): container finished" podID="d5185271-07ec-431e-b79a-f7fa7d61d3c7" containerID="768d35930efc0d99e24a17e1a9fc901043ed287c2861daca8bb21a29043e5c29" exitCode=0
Sep 11 13:24:31.254749 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.254599    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"
Sep 11 13:24:31.254749 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.254616    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5" event={"ID":"d5185271-07ec-431e-b79a-f7fa7d61d3c7","Type":"ContainerDied","Data":"768d35930efc0d99e24a17e1a9fc901043ed287c2861daca8bb21a29043e5c29"}
Sep 11 13:24:31.254749 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.254661    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5" event={"ID":"d5185271-07ec-431e-b79a-f7fa7d61d3c7","Type":"ContainerDied","Data":"cec738e98905edb42632bbea853fcfd4f9d26b08ffedd0d9cbfc13578ff5cd1b"}
Sep 11 13:24:31.254749 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.254685    2547 scope.go:117] "RemoveContainer" containerID="768d35930efc0d99e24a17e1a9fc901043ed287c2861daca8bb21a29043e5c29"
Sep 11 13:24:31.258010 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.257989    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdglc\" (UniqueName: \"kubernetes.io/projected/d5185271-07ec-431e-b79a-f7fa7d61d3c7-kube-api-access-zdglc\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:31.258096 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.258014    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d5185271-07ec-431e-b79a-f7fa7d61d3c7-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:31.264116 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.264095    2547 scope.go:117] "RemoveContainer" containerID="768d35930efc0d99e24a17e1a9fc901043ed287c2861daca8bb21a29043e5c29"
Sep 11 13:24:31.264393 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:24:31.264373    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"768d35930efc0d99e24a17e1a9fc901043ed287c2861daca8bb21a29043e5c29\": container with ID starting with 768d35930efc0d99e24a17e1a9fc901043ed287c2861daca8bb21a29043e5c29 not found: ID does not exist" containerID="768d35930efc0d99e24a17e1a9fc901043ed287c2861daca8bb21a29043e5c29"
Sep 11 13:24:31.264480 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.264401    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"768d35930efc0d99e24a17e1a9fc901043ed287c2861daca8bb21a29043e5c29"} err="failed to get container status \"768d35930efc0d99e24a17e1a9fc901043ed287c2861daca8bb21a29043e5c29\": rpc error: code = NotFound desc = could not find container \"768d35930efc0d99e24a17e1a9fc901043ed287c2861daca8bb21a29043e5c29\": container with ID starting with 768d35930efc0d99e24a17e1a9fc901043ed287c2861daca8bb21a29043e5c29 not found: ID does not exist"
Sep 11 13:24:31.293876 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.293851    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"]
Sep 11 13:24:31.309167 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:31.309108    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-1841da-569f6485b9-p4nn5"]
Sep 11 13:24:33.006522 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:33.006488    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5185271-07ec-431e-b79a-f7fa7d61d3c7" path="/var/lib/kubelet/pods/d5185271-07ec-431e-b79a-f7fa7d61d3c7/volumes"
Sep 11 13:24:33.007016 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:33.006814    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4ec4b75-5dd9-4422-9103-96cc244c3d9b" path="/var/lib/kubelet/pods/f4ec4b75-5dd9-4422-9103-96cc244c3d9b/volumes"
Sep 11 13:24:33.636118 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:33.636086    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:24:38.825684 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:38.825648    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5"]
Sep 11 13:24:38.826070 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:38.826011    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5185271-07ec-431e-b79a-f7fa7d61d3c7" containerName="payload-processing"
Sep 11 13:24:38.826070 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:38.826023    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5185271-07ec-431e-b79a-f7fa7d61d3c7" containerName="payload-processing"
Sep 11 13:24:38.826070 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:38.826034    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ec4b75-5dd9-4422-9103-96cc244c3d9b" containerName="revoke-keys"
Sep 11 13:24:38.826070 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:38.826040    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ec4b75-5dd9-4422-9103-96cc244c3d9b" containerName="revoke-keys"
Sep 11 13:24:38.826207 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:38.826095    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5185271-07ec-431e-b79a-f7fa7d61d3c7" containerName="payload-processing"
Sep 11 13:24:38.826207 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:38.826104    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ec4b75-5dd9-4422-9103-96cc244c3d9b" containerName="revoke-keys"
Sep 11 13:24:38.829239 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:38.829223    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5"
Sep 11 13:24:38.833018 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:38.832996    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:24:38.836955 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:38.836937    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:24:38.858882 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:38.858859    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5"]
Sep 11 13:24:38.911007 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:38.910983    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25a42c9e-92a5-4cf4-941f-8e0b8eedccd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5\" (UID: \"25a42c9e-92a5-4cf4-941f-8e0b8eedccd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5"
Sep 11 13:24:39.011619 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:39.011593    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25a42c9e-92a5-4cf4-941f-8e0b8eedccd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5\" (UID: \"25a42c9e-92a5-4cf4-941f-8e0b8eedccd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5"
Sep 11 13:24:39.012145 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:39.012129    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25a42c9e-92a5-4cf4-941f-8e0b8eedccd1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5\" (UID: \"25a42c9e-92a5-4cf4-941f-8e0b8eedccd1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5"
Sep 11 13:24:39.139030 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:39.138962    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5"
Sep 11 13:24:39.435028 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:39.435003    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5"]
Sep 11 13:24:39.437508 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:24:39.437479    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25a42c9e_92a5_4cf4_941f_8e0b8eedccd1.slice/crio-6c1269a4d70599d8c9a19d550a380528f032ac518ffae23dbbe2221041ee96c1 WatchSource:0}: Error finding container 6c1269a4d70599d8c9a19d550a380528f032ac518ffae23dbbe2221041ee96c1: Status 404 returned error can't find the container with id 6c1269a4d70599d8c9a19d550a380528f032ac518ffae23dbbe2221041ee96c1
Sep 11 13:24:40.297479 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:40.297445    2547 generic.go:356] "Generic (PLEG): container finished" podID="25a42c9e-92a5-4cf4-941f-8e0b8eedccd1" containerID="118fd8ea348158c0aa538d29092c681e1383ef347507088f997f6b17ca1bddd0" exitCode=0
Sep 11 13:24:40.297856 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:40.297532    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5" event={"ID":"25a42c9e-92a5-4cf4-941f-8e0b8eedccd1","Type":"ContainerDied","Data":"118fd8ea348158c0aa538d29092c681e1383ef347507088f997f6b17ca1bddd0"}
Sep 11 13:24:40.297856 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:40.297578    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5" event={"ID":"25a42c9e-92a5-4cf4-941f-8e0b8eedccd1","Type":"ContainerStarted","Data":"6c1269a4d70599d8c9a19d550a380528f032ac518ffae23dbbe2221041ee96c1"}
Sep 11 13:24:41.433747 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:41.433707    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5"
Sep 11 13:24:41.528371 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:41.528344    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25a42c9e-92a5-4cf4-941f-8e0b8eedccd1-maas-api-service-ca\") pod \"25a42c9e-92a5-4cf4-941f-8e0b8eedccd1\" (UID: \"25a42c9e-92a5-4cf4-941f-8e0b8eedccd1\") "
Sep 11 13:24:41.528692 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:41.528674    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/25a42c9e-92a5-4cf4-941f-8e0b8eedccd1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "25a42c9e-92a5-4cf4-941f-8e0b8eedccd1" (UID: "25a42c9e-92a5-4cf4-941f-8e0b8eedccd1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:41.629823 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:41.629765    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/25a42c9e-92a5-4cf4-941f-8e0b8eedccd1-maas-api-service-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:42.309416 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:42.309384    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5" event={"ID":"25a42c9e-92a5-4cf4-941f-8e0b8eedccd1","Type":"ContainerDied","Data":"6c1269a4d70599d8c9a19d550a380528f032ac518ffae23dbbe2221041ee96c1"}
Sep 11 13:24:42.309416 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:42.309405    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5"
Sep 11 13:24:42.309615 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:42.309431    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c1269a4d70599d8c9a19d550a380528f032ac518ffae23dbbe2221041ee96c1"
Sep 11 13:24:49.519649 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.519610    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"]
Sep 11 13:24:49.520065 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.519919    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq" podUID="5b7f9c6f-9541-4808-ada3-7183ad7ec501" containerName="payload-processing" containerID="cri-o://afbe9ba6e965ae4fd362addda3506c37b3e0c242d8f35e90ac89160ece191854" gracePeriod=30
Sep 11 13:24:49.527749 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.527706    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"]
Sep 11 13:24:49.527938 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.527918    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k" podUID="6224e750-5a24-4881-833c-786d745edb85" containerName="payload-pre-processing" containerID="cri-o://b502666f2131e5f01157cf984d525852c54c78383a9d64e15789c675ffd65fd7" gracePeriod=30
Sep 11 13:24:49.754182 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.754149    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5"]
Sep 11 13:24:49.760408 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.760382    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-82825f-vwcc5"]
Sep 11 13:24:49.785577 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.785558    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"
Sep 11 13:24:49.788380 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.788360    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"
Sep 11 13:24:49.897746 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.897691    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6224e750-5a24-4881-833c-786d745edb85-plugins-config-volume\") pod \"6224e750-5a24-4881-833c-786d745edb85\" (UID: \"6224e750-5a24-4881-833c-786d745edb85\") "
Sep 11 13:24:49.897939 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.897760    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7f9c6f-9541-4808-ada3-7183ad7ec501-plugins-config-volume\") pod \"5b7f9c6f-9541-4808-ada3-7183ad7ec501\" (UID: \"5b7f9c6f-9541-4808-ada3-7183ad7ec501\") "
Sep 11 13:24:49.897939 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.897826    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xst7t\" (UniqueName: \"kubernetes.io/projected/5b7f9c6f-9541-4808-ada3-7183ad7ec501-kube-api-access-xst7t\") pod \"5b7f9c6f-9541-4808-ada3-7183ad7ec501\" (UID: \"5b7f9c6f-9541-4808-ada3-7183ad7ec501\") "
Sep 11 13:24:49.897939 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.897870    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxzxl\" (UniqueName: \"kubernetes.io/projected/6224e750-5a24-4881-833c-786d745edb85-kube-api-access-zxzxl\") pod \"6224e750-5a24-4881-833c-786d745edb85\" (UID: \"6224e750-5a24-4881-833c-786d745edb85\") "
Sep 11 13:24:49.898109 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.898083    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b7f9c6f-9541-4808-ada3-7183ad7ec501-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5b7f9c6f-9541-4808-ada3-7183ad7ec501" (UID: "5b7f9c6f-9541-4808-ada3-7183ad7ec501"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:49.898148 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.898116    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6224e750-5a24-4881-833c-786d745edb85-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6224e750-5a24-4881-833c-786d745edb85" (UID: "6224e750-5a24-4881-833c-786d745edb85"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:24:49.899881 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.899858    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b7f9c6f-9541-4808-ada3-7183ad7ec501-kube-api-access-xst7t" (OuterVolumeSpecName: "kube-api-access-xst7t") pod "5b7f9c6f-9541-4808-ada3-7183ad7ec501" (UID: "5b7f9c6f-9541-4808-ada3-7183ad7ec501"). InnerVolumeSpecName "kube-api-access-xst7t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:24:49.899881 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.899867    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6224e750-5a24-4881-833c-786d745edb85-kube-api-access-zxzxl" (OuterVolumeSpecName: "kube-api-access-zxzxl") pod "6224e750-5a24-4881-833c-786d745edb85" (UID: "6224e750-5a24-4881-833c-786d745edb85"). InnerVolumeSpecName "kube-api-access-zxzxl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:24:49.998596 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.998568    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7f9c6f-9541-4808-ada3-7183ad7ec501-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:49.998596 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.998591    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xst7t\" (UniqueName: \"kubernetes.io/projected/5b7f9c6f-9541-4808-ada3-7183ad7ec501-kube-api-access-xst7t\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:49.998596 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.998601    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxzxl\" (UniqueName: \"kubernetes.io/projected/6224e750-5a24-4881-833c-786d745edb85-kube-api-access-zxzxl\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:49.998836 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:49.998610    2547 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6224e750-5a24-4881-833c-786d745edb85-plugins-config-volume\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:24:50.350725 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.350686    2547 generic.go:356] "Generic (PLEG): container finished" podID="6224e750-5a24-4881-833c-786d745edb85" containerID="b502666f2131e5f01157cf984d525852c54c78383a9d64e15789c675ffd65fd7" exitCode=0
Sep 11 13:24:50.350912 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.350753    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"
Sep 11 13:24:50.350912 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.350774    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k" event={"ID":"6224e750-5a24-4881-833c-786d745edb85","Type":"ContainerDied","Data":"b502666f2131e5f01157cf984d525852c54c78383a9d64e15789c675ffd65fd7"}
Sep 11 13:24:50.350912 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.350834    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k" event={"ID":"6224e750-5a24-4881-833c-786d745edb85","Type":"ContainerDied","Data":"317cf32ea6f70d54068ab8ceeeb7ef72f6a0006bec41a60283ba217890198c4b"}
Sep 11 13:24:50.350912 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.350853    2547 scope.go:117] "RemoveContainer" containerID="b502666f2131e5f01157cf984d525852c54c78383a9d64e15789c675ffd65fd7"
Sep 11 13:24:50.352152 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.352128    2547 generic.go:356] "Generic (PLEG): container finished" podID="5b7f9c6f-9541-4808-ada3-7183ad7ec501" containerID="afbe9ba6e965ae4fd362addda3506c37b3e0c242d8f35e90ac89160ece191854" exitCode=0
Sep 11 13:24:50.352252 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.352170    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"
Sep 11 13:24:50.352252 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.352208    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq" event={"ID":"5b7f9c6f-9541-4808-ada3-7183ad7ec501","Type":"ContainerDied","Data":"afbe9ba6e965ae4fd362addda3506c37b3e0c242d8f35e90ac89160ece191854"}
Sep 11 13:24:50.352355 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.352257    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq" event={"ID":"5b7f9c6f-9541-4808-ada3-7183ad7ec501","Type":"ContainerDied","Data":"9b7e8ad14768ae3ae6683cfe4d06581249cdcce3ad12b5161d9af33fd8d562af"}
Sep 11 13:24:50.359358 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.359340    2547 scope.go:117] "RemoveContainer" containerID="b502666f2131e5f01157cf984d525852c54c78383a9d64e15789c675ffd65fd7"
Sep 11 13:24:50.359738 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:24:50.359698    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b502666f2131e5f01157cf984d525852c54c78383a9d64e15789c675ffd65fd7\": container with ID starting with b502666f2131e5f01157cf984d525852c54c78383a9d64e15789c675ffd65fd7 not found: ID does not exist" containerID="b502666f2131e5f01157cf984d525852c54c78383a9d64e15789c675ffd65fd7"
Sep 11 13:24:50.359826 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.359746    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b502666f2131e5f01157cf984d525852c54c78383a9d64e15789c675ffd65fd7"} err="failed to get container status \"b502666f2131e5f01157cf984d525852c54c78383a9d64e15789c675ffd65fd7\": rpc error: code = NotFound desc = could not find container \"b502666f2131e5f01157cf984d525852c54c78383a9d64e15789c675ffd65fd7\": container with ID starting with b502666f2131e5f01157cf984d525852c54c78383a9d64e15789c675ffd65fd7 not found: ID does not exist"
Sep 11 13:24:50.359826 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.359768    2547 scope.go:117] "RemoveContainer" containerID="afbe9ba6e965ae4fd362addda3506c37b3e0c242d8f35e90ac89160ece191854"
Sep 11 13:24:50.367579 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.367563    2547 scope.go:117] "RemoveContainer" containerID="afbe9ba6e965ae4fd362addda3506c37b3e0c242d8f35e90ac89160ece191854"
Sep 11 13:24:50.367871 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:24:50.367853    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afbe9ba6e965ae4fd362addda3506c37b3e0c242d8f35e90ac89160ece191854\": container with ID starting with afbe9ba6e965ae4fd362addda3506c37b3e0c242d8f35e90ac89160ece191854 not found: ID does not exist" containerID="afbe9ba6e965ae4fd362addda3506c37b3e0c242d8f35e90ac89160ece191854"
Sep 11 13:24:50.367931 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.367875    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afbe9ba6e965ae4fd362addda3506c37b3e0c242d8f35e90ac89160ece191854"} err="failed to get container status \"afbe9ba6e965ae4fd362addda3506c37b3e0c242d8f35e90ac89160ece191854\": rpc error: code = NotFound desc = could not find container \"afbe9ba6e965ae4fd362addda3506c37b3e0c242d8f35e90ac89160ece191854\": container with ID starting with afbe9ba6e965ae4fd362addda3506c37b3e0c242d8f35e90ac89160ece191854 not found: ID does not exist"
Sep 11 13:24:50.376821 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.376800    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"]
Sep 11 13:24:50.380539 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.380520    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-82825f-6d78f698b-s6x6k"]
Sep 11 13:24:50.397115 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.397087    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"]
Sep 11 13:24:50.399629 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:50.399605    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-82825f-7d96f66cd7-2bcnq"]
Sep 11 13:24:51.007527 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:51.007495    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="25a42c9e-92a5-4cf4-941f-8e0b8eedccd1" path="/var/lib/kubelet/pods/25a42c9e-92a5-4cf4-941f-8e0b8eedccd1/volumes"
Sep 11 13:24:51.007919 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:51.007851    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b7f9c6f-9541-4808-ada3-7183ad7ec501" path="/var/lib/kubelet/pods/5b7f9c6f-9541-4808-ada3-7183ad7ec501/volumes"
Sep 11 13:24:51.008160 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:51.008147    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6224e750-5a24-4881-833c-786d745edb85" path="/var/lib/kubelet/pods/6224e750-5a24-4881-833c-786d745edb85/volumes"
Sep 11 13:24:52.231507 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:24:52.231476    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:25:01.823639 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:25:01.823605    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:26:23.925608 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:26:23.925571    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:26:51.533501 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:26:51.533467    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:26:58.016151 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:26:58.016077    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:27:05.446844 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:27:05.446810    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:27:13.717966 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:27:13.717929    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:27:27.418246 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:27:27.418215    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:27:31.376191 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:27:31.376162    2547 scope.go:117] "RemoveContainer" containerID="b56ea0e7940468956c79ad84581c5ee30bb101285e17a5994959c8f1746c09d5"
Sep 11 13:27:35.758907 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:27:35.758870    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:28:31.393486 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:28:31.393418    2547 scope.go:117] "RemoveContainer" containerID="46ef971fbe604a96d3bdcbc1a35251f69005bb9daacbd5cb0ef32ebb10be8861"
Sep 11 13:29:04.738698 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:04.738665    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:29:11.267603 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:11.267572    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:29:19.522697 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:19.522659    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:29:30.259205 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.259149    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"]
Sep 11 13:29:30.259702 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.259601    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="25a42c9e-92a5-4cf4-941f-8e0b8eedccd1" containerName="revoke-keys"
Sep 11 13:29:30.259702 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.259621    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="25a42c9e-92a5-4cf4-941f-8e0b8eedccd1" containerName="revoke-keys"
Sep 11 13:29:30.259702 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.259637    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6224e750-5a24-4881-833c-786d745edb85" containerName="payload-pre-processing"
Sep 11 13:29:30.259702 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.259645    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="6224e750-5a24-4881-833c-786d745edb85" containerName="payload-pre-processing"
Sep 11 13:29:30.259702 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.259669    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b7f9c6f-9541-4808-ada3-7183ad7ec501" containerName="payload-processing"
Sep 11 13:29:30.259702 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.259679    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b7f9c6f-9541-4808-ada3-7183ad7ec501" containerName="payload-processing"
Sep 11 13:29:30.260065 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.259769    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="25a42c9e-92a5-4cf4-941f-8e0b8eedccd1" containerName="revoke-keys"
Sep 11 13:29:30.260065 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.259783    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="6224e750-5a24-4881-833c-786d745edb85" containerName="payload-pre-processing"
Sep 11 13:29:30.260065 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.259794    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b7f9c6f-9541-4808-ada3-7183ad7ec501" containerName="payload-processing"
Sep 11 13:29:30.262799 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.262780    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.267284 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.267259    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-893f6e7c-kserve-self-signed-certs\""
Sep 11 13:29:30.276832 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.276813    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"]
Sep 11 13:29:30.309181 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.309158    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-dshm\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.309276 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.309187    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klmk2\" (UniqueName: \"kubernetes.io/projected/68c58586-cd7b-440e-8a59-e5f98e8df574-kube-api-access-klmk2\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.309276 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.309214    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68c58586-cd7b-440e-8a59-e5f98e8df574-tls-certs\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.309276 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.309248    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-model-cache\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.309276 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.309267    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-tmp-dir\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.309440 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.309339    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-home\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.410523 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.410490    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-home\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.410523 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.410528    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-dshm\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.410783 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.410546    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klmk2\" (UniqueName: \"kubernetes.io/projected/68c58586-cd7b-440e-8a59-e5f98e8df574-kube-api-access-klmk2\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.410783 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.410573    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68c58586-cd7b-440e-8a59-e5f98e8df574-tls-certs\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.410783 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.410596    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-model-cache\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.410783 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.410624    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-tmp-dir\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.410971 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.410942    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-home\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.411013 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.410981    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-model-cache\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.411047 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.411036    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-tmp-dir\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.412821 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.412805    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-dshm\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.413103 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.413082    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68c58586-cd7b-440e-8a59-e5f98e8df574-tls-certs\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.426129 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.426104    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klmk2\" (UniqueName: \"kubernetes.io/projected/68c58586-cd7b-440e-8a59-e5f98e8df574-kube-api-access-klmk2\") pod \"e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") " pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.571196 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.571151    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:30.852546 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:30.852474    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"]
Sep 11 13:29:30.855305 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:29:30.855278    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68c58586_cd7b_440e_8a59_e5f98e8df574.slice/crio-95111164c3e6b2c55693784029e361990f0174b920f32a41d2f1384f1965a0d7 WatchSource:0}: Error finding container 95111164c3e6b2c55693784029e361990f0174b920f32a41d2f1384f1965a0d7: Status 404 returned error can't find the container with id 95111164c3e6b2c55693784029e361990f0174b920f32a41d2f1384f1965a0d7
Sep 11 13:29:31.410500 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:31.410469    2547 scope.go:117] "RemoveContainer" containerID="8fb47b013fec4d458334b45ef9eb98fd5d09637809140731cf1d310a04fb86bd"
Sep 11 13:29:31.621966 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:31.621933    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht" event={"ID":"68c58586-cd7b-440e-8a59-e5f98e8df574","Type":"ContainerStarted","Data":"2531922cfc1a42018e3ed036d1a6a66e86be8b34e11c3c529ef22356f05fc22a"}
Sep 11 13:29:31.622132 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:31.621978    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht" event={"ID":"68c58586-cd7b-440e-8a59-e5f98e8df574","Type":"ContainerStarted","Data":"95111164c3e6b2c55693784029e361990f0174b920f32a41d2f1384f1965a0d7"}
Sep 11 13:29:31.656886 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:31.656844    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht" podStartSLOduration=1.65683246 podStartE2EDuration="1.65683246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:29:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:29:31.656787459 +0000 UTC m=+2041.160651851" watchObservedRunningTime="2026-09-11 13:29:31.65683246 +0000 UTC m=+2041.160696852"
Sep 11 13:29:33.076613 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:33.076579    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:29:40.572207 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:40.572162    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:40.572207 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:40.572224    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:40.584468 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:40.584445    2547 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:40.672509 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:40.672487    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:29:56.452054 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:29:56.451972    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:30:00.141410 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:00.141374    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818890-7298j"]
Sep 11 13:30:00.144671 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:00.144654    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818890-7298j"
Sep 11 13:30:00.147241 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:00.147217    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-kt2vz\""
Sep 11 13:30:00.153729 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:00.153687    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818890-7298j"]
Sep 11 13:30:00.155915 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:00.155895    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818890-7298j"
Sep 11 13:30:00.431803 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:00.431780    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29818890-7298j"]
Sep 11 13:30:00.434380 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:30:00.434352    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8934edaa_f925_4ca4_b834_f1dc9ca6ca39.slice/crio-6efc849c09a1a23fcea89edf311df85650ec81838d4d1cab61ebd8aef77ca6ab WatchSource:0}: Error finding container 6efc849c09a1a23fcea89edf311df85650ec81838d4d1cab61ebd8aef77ca6ab: Status 404 returned error can't find the container with id 6efc849c09a1a23fcea89edf311df85650ec81838d4d1cab61ebd8aef77ca6ab
Sep 11 13:30:00.758241 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:00.758145    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818890-7298j" event={"ID":"8934edaa-f925-4ca4-b834-f1dc9ca6ca39","Type":"ContainerStarted","Data":"78a4283e2afab475a8cdc6b2b5222dbd1f796961c2c5aba2c7647c8a48b1a2ce"}
Sep 11 13:30:00.758241 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:00.758209    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818890-7298j" event={"ID":"8934edaa-f925-4ca4-b834-f1dc9ca6ca39","Type":"ContainerStarted","Data":"6efc849c09a1a23fcea89edf311df85650ec81838d4d1cab61ebd8aef77ca6ab"}
Sep 11 13:30:00.773178 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:00.773132    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818890-7298j" podStartSLOduration=0.773116916 podStartE2EDuration="773.116916ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:30:00.77288089 +0000 UTC m=+2070.276745282" watchObservedRunningTime="2026-09-11 13:30:00.773116916 +0000 UTC m=+2070.276981309"
Sep 11 13:30:01.763486 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:01.763446    2547 generic.go:356] "Generic (PLEG): container finished" podID="8934edaa-f925-4ca4-b834-f1dc9ca6ca39" containerID="78a4283e2afab475a8cdc6b2b5222dbd1f796961c2c5aba2c7647c8a48b1a2ce" exitCode=0
Sep 11 13:30:01.763486 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:01.763486    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818890-7298j" event={"ID":"8934edaa-f925-4ca4-b834-f1dc9ca6ca39","Type":"ContainerDied","Data":"78a4283e2afab475a8cdc6b2b5222dbd1f796961c2c5aba2c7647c8a48b1a2ce"}
Sep 11 13:30:02.892216 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:02.892194    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818890-7298j"
Sep 11 13:30:03.773140 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:03.773111    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818890-7298j"
Sep 11 13:30:03.773310 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:03.773145    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29818890-7298j" event={"ID":"8934edaa-f925-4ca4-b834-f1dc9ca6ca39","Type":"ContainerDied","Data":"6efc849c09a1a23fcea89edf311df85650ec81838d4d1cab61ebd8aef77ca6ab"}
Sep 11 13:30:03.773310 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:03.773191    2547 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6efc849c09a1a23fcea89edf311df85650ec81838d4d1cab61ebd8aef77ca6ab"
Sep 11 13:30:07.563386 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:07.563352    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"]
Sep 11 13:30:09.854079 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:09.854047    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:30:18.815277 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:18.815240    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:30:22.581732 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.581673    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht" podUID="68c58586-cd7b-440e-8a59-e5f98e8df574" containerName="main" containerID="cri-o://2531922cfc1a42018e3ed036d1a6a66e86be8b34e11c3c529ef22356f05fc22a" gracePeriod=45
Sep 11 13:30:22.826678 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.826652    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:30:22.859048 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.858979    2547 generic.go:356] "Generic (PLEG): container finished" podID="68c58586-cd7b-440e-8a59-e5f98e8df574" containerID="2531922cfc1a42018e3ed036d1a6a66e86be8b34e11c3c529ef22356f05fc22a" exitCode=0
Sep 11 13:30:22.859048 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.859023    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"
Sep 11 13:30:22.859048 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.859035    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht" event={"ID":"68c58586-cd7b-440e-8a59-e5f98e8df574","Type":"ContainerDied","Data":"2531922cfc1a42018e3ed036d1a6a66e86be8b34e11c3c529ef22356f05fc22a"}
Sep 11 13:30:22.859280 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.859065    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht" event={"ID":"68c58586-cd7b-440e-8a59-e5f98e8df574","Type":"ContainerDied","Data":"95111164c3e6b2c55693784029e361990f0174b920f32a41d2f1384f1965a0d7"}
Sep 11 13:30:22.859280 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.859081    2547 scope.go:117] "RemoveContainer" containerID="2531922cfc1a42018e3ed036d1a6a66e86be8b34e11c3c529ef22356f05fc22a"
Sep 11 13:30:22.866580 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.866565    2547 scope.go:117] "RemoveContainer" containerID="2531922cfc1a42018e3ed036d1a6a66e86be8b34e11c3c529ef22356f05fc22a"
Sep 11 13:30:22.866897 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:30:22.866878    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2531922cfc1a42018e3ed036d1a6a66e86be8b34e11c3c529ef22356f05fc22a\": container with ID starting with 2531922cfc1a42018e3ed036d1a6a66e86be8b34e11c3c529ef22356f05fc22a not found: ID does not exist" containerID="2531922cfc1a42018e3ed036d1a6a66e86be8b34e11c3c529ef22356f05fc22a"
Sep 11 13:30:22.866952 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.866906    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2531922cfc1a42018e3ed036d1a6a66e86be8b34e11c3c529ef22356f05fc22a"} err="failed to get container status \"2531922cfc1a42018e3ed036d1a6a66e86be8b34e11c3c529ef22356f05fc22a\": rpc error: code = NotFound desc = could not find container \"2531922cfc1a42018e3ed036d1a6a66e86be8b34e11c3c529ef22356f05fc22a\": container with ID starting with 2531922cfc1a42018e3ed036d1a6a66e86be8b34e11c3c529ef22356f05fc22a not found: ID does not exist"
Sep 11 13:30:22.915336 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.915313    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-home\") pod \"68c58586-cd7b-440e-8a59-e5f98e8df574\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") "
Sep 11 13:30:22.915441 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.915360    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68c58586-cd7b-440e-8a59-e5f98e8df574-tls-certs\") pod \"68c58586-cd7b-440e-8a59-e5f98e8df574\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") "
Sep 11 13:30:22.915441 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.915391    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-tmp-dir\") pod \"68c58586-cd7b-440e-8a59-e5f98e8df574\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") "
Sep 11 13:30:22.915441 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.915425    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-model-cache\") pod \"68c58586-cd7b-440e-8a59-e5f98e8df574\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") "
Sep 11 13:30:22.915606 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.915479    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-dshm\") pod \"68c58586-cd7b-440e-8a59-e5f98e8df574\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") "
Sep 11 13:30:22.915606 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.915503    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klmk2\" (UniqueName: \"kubernetes.io/projected/68c58586-cd7b-440e-8a59-e5f98e8df574-kube-api-access-klmk2\") pod \"68c58586-cd7b-440e-8a59-e5f98e8df574\" (UID: \"68c58586-cd7b-440e-8a59-e5f98e8df574\") "
Sep 11 13:30:22.915708 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.915613    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-home" (OuterVolumeSpecName: "home") pod "68c58586-cd7b-440e-8a59-e5f98e8df574" (UID: "68c58586-cd7b-440e-8a59-e5f98e8df574"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:30:22.915708 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.915688    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "68c58586-cd7b-440e-8a59-e5f98e8df574" (UID: "68c58586-cd7b-440e-8a59-e5f98e8df574"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:30:22.915708 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.915701    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-model-cache" (OuterVolumeSpecName: "model-cache") pod "68c58586-cd7b-440e-8a59-e5f98e8df574" (UID: "68c58586-cd7b-440e-8a59-e5f98e8df574"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:30:22.915896 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.915808    2547 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-home\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:30:22.915896 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.915851    2547 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-tmp-dir\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:30:22.915896 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.915867    2547 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-model-cache\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:30:22.917490 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.917459    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68c58586-cd7b-440e-8a59-e5f98e8df574-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "68c58586-cd7b-440e-8a59-e5f98e8df574" (UID: "68c58586-cd7b-440e-8a59-e5f98e8df574"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:30:22.917586 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.917516    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68c58586-cd7b-440e-8a59-e5f98e8df574-kube-api-access-klmk2" (OuterVolumeSpecName: "kube-api-access-klmk2") pod "68c58586-cd7b-440e-8a59-e5f98e8df574" (UID: "68c58586-cd7b-440e-8a59-e5f98e8df574"). InnerVolumeSpecName "kube-api-access-klmk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:30:22.917586 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:22.917535    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-dshm" (OuterVolumeSpecName: "dshm") pod "68c58586-cd7b-440e-8a59-e5f98e8df574" (UID: "68c58586-cd7b-440e-8a59-e5f98e8df574"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 13:30:23.017123 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:23.017098    2547 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/68c58586-cd7b-440e-8a59-e5f98e8df574-dshm\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:30:23.017123 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:23.017123    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klmk2\" (UniqueName: \"kubernetes.io/projected/68c58586-cd7b-440e-8a59-e5f98e8df574-kube-api-access-klmk2\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:30:23.017276 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:23.017133    2547 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/68c58586-cd7b-440e-8a59-e5f98e8df574-tls-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:30:25.981688 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:25.981650    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"]
Sep 11 13:30:25.984922 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:25.984898    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-893f6e7c-kserve-d9dbbd855-5qhht"]
Sep 11 13:30:27.005236 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:27.005204    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68c58586-cd7b-440e-8a59-e5f98e8df574" path="/var/lib/kubelet/pods/68c58586-cd7b-440e-8a59-e5f98e8df574/volumes"
Sep 11 13:30:31.435366 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:31.435338    2547 scope.go:117] "RemoveContainer" containerID="cf36588c288f6631f443fe75ea93f1fc2fcecb062d38287686790a44e82fc246"
Sep 11 13:30:31.442855 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:31.442804    2547 scope.go:117] "RemoveContainer" containerID="66445ddf7bb6eda5c1268dca8694396f9984226f13ef26cb3b0b88e818b6296d"
Sep 11 13:30:35.821998 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:35.821968    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:30:40.024242 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.024208    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:30:40.047489 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.047456    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-78554b866-brp64"]
Sep 11 13:30:40.047836 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.047819    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8934edaa-f925-4ca4-b834-f1dc9ca6ca39" containerName="cleanup"
Sep 11 13:30:40.047932 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.047838    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="8934edaa-f925-4ca4-b834-f1dc9ca6ca39" containerName="cleanup"
Sep 11 13:30:40.047932 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.047853    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68c58586-cd7b-440e-8a59-e5f98e8df574" containerName="main"
Sep 11 13:30:40.047932 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.047861    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="68c58586-cd7b-440e-8a59-e5f98e8df574" containerName="main"
Sep 11 13:30:40.048088 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.047953    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="8934edaa-f925-4ca4-b834-f1dc9ca6ca39" containerName="cleanup"
Sep 11 13:30:40.048088 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.047968    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="68c58586-cd7b-440e-8a59-e5f98e8df574" containerName="main"
Sep 11 13:30:40.050730 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.050693    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.053436 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.053413    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 13:30:40.054249 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.054229    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 13:30:40.054339 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.054298    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 13:30:40.054412 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.054357    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-kb4hz\""
Sep 11 13:30:40.054478 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.054413    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 13:30:40.064468 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.064413    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78554b866-brp64"]
Sep 11 13:30:40.146466 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.146434    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-494rt\" (UniqueName: \"kubernetes.io/projected/b47b62dc-4dff-4898-9fa9-8357efd522c5-kube-api-access-494rt\") pod \"maas-api-78554b866-brp64\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") " pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.146623 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.146488    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b47b62dc-4dff-4898-9fa9-8357efd522c5-openshift-service-ca\") pod \"maas-api-78554b866-brp64\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") " pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.146623 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.146512    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b47b62dc-4dff-4898-9fa9-8357efd522c5-maas-api-tls\") pod \"maas-api-78554b866-brp64\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") " pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.146623 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.146544    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47b62dc-4dff-4898-9fa9-8357efd522c5-metrics-certs\") pod \"maas-api-78554b866-brp64\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") " pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.247425 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.247397    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b47b62dc-4dff-4898-9fa9-8357efd522c5-openshift-service-ca\") pod \"maas-api-78554b866-brp64\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") " pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.247425 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.247428    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b47b62dc-4dff-4898-9fa9-8357efd522c5-maas-api-tls\") pod \"maas-api-78554b866-brp64\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") " pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.247642 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.247461    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47b62dc-4dff-4898-9fa9-8357efd522c5-metrics-certs\") pod \"maas-api-78554b866-brp64\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") " pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.247642 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.247568    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-494rt\" (UniqueName: \"kubernetes.io/projected/b47b62dc-4dff-4898-9fa9-8357efd522c5-kube-api-access-494rt\") pod \"maas-api-78554b866-brp64\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") " pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.248198 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.248175    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b47b62dc-4dff-4898-9fa9-8357efd522c5-openshift-service-ca\") pod \"maas-api-78554b866-brp64\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") " pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.249913 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.249896    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47b62dc-4dff-4898-9fa9-8357efd522c5-metrics-certs\") pod \"maas-api-78554b866-brp64\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") " pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.249976 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.249918    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b47b62dc-4dff-4898-9fa9-8357efd522c5-maas-api-tls\") pod \"maas-api-78554b866-brp64\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") " pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.262469 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.262446    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-494rt\" (UniqueName: \"kubernetes.io/projected/b47b62dc-4dff-4898-9fa9-8357efd522c5-kube-api-access-494rt\") pod \"maas-api-78554b866-brp64\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") " pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.362335 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.362263    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:40.637295 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.637123    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-78554b866-brp64"]
Sep 11 13:30:40.639456 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:30:40.639432    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb47b62dc_4dff_4898_9fa9_8357efd522c5.slice/crio-7a392cb55ad230e4f14e4fc4e94abfaa4a05d6d1fe8b1eabb50ec79e0e84a4ac WatchSource:0}: Error finding container 7a392cb55ad230e4f14e4fc4e94abfaa4a05d6d1fe8b1eabb50ec79e0e84a4ac: Status 404 returned error can't find the container with id 7a392cb55ad230e4f14e4fc4e94abfaa4a05d6d1fe8b1eabb50ec79e0e84a4ac
Sep 11 13:30:40.640800 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.640783    2547 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 13:30:40.940403 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:40.940319    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78554b866-brp64" event={"ID":"b47b62dc-4dff-4898-9fa9-8357efd522c5","Type":"ContainerStarted","Data":"7a392cb55ad230e4f14e4fc4e94abfaa4a05d6d1fe8b1eabb50ec79e0e84a4ac"}
Sep 11 13:30:43.958068 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:43.958031    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78554b866-brp64" event={"ID":"b47b62dc-4dff-4898-9fa9-8357efd522c5","Type":"ContainerStarted","Data":"1bf34ea8ead31e454a4b855eecaa430a8bb1e5cec4f6e1fa2ddc62107cb59a0c"}
Sep 11 13:30:43.958440 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:43.958149    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:43.984052 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:43.984002    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-78554b866-brp64" podStartSLOduration=1.35627794 podStartE2EDuration="3.983985744s" totalImagesPullingTime="2.627707804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:30:43.982000381 +0000 UTC m=+2113.485864767" watchObservedRunningTime="2026-09-11 13:30:43.983985744 +0000 UTC m=+2113.487850138"
Sep 11 13:30:47.713682 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.713652    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-78554b866-brp64"]
Sep 11 13:30:47.714095 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.713847    2547 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-78554b866-brp64" podUID="b47b62dc-4dff-4898-9fa9-8357efd522c5" containerName="maas-api" containerID="cri-o://1bf34ea8ead31e454a4b855eecaa430a8bb1e5cec4f6e1fa2ddc62107cb59a0c" gracePeriod=30
Sep 11 13:30:47.758689 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.758653    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"]
Sep 11 13:30:47.762093 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.762075    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:47.768242 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.768215    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"]
Sep 11 13:30:47.799178 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.799148    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/587da983-a36e-4fff-9f2f-a9f8a0b5c424-openshift-service-ca\") pod \"maas-api-fdd88446b-8xljb\" (UID: \"587da983-a36e-4fff-9f2f-a9f8a0b5c424\") " pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:47.799305 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.799203    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv4dm\" (UniqueName: \"kubernetes.io/projected/587da983-a36e-4fff-9f2f-a9f8a0b5c424-kube-api-access-vv4dm\") pod \"maas-api-fdd88446b-8xljb\" (UID: \"587da983-a36e-4fff-9f2f-a9f8a0b5c424\") " pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:47.799305 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.799223    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/587da983-a36e-4fff-9f2f-a9f8a0b5c424-maas-api-tls\") pod \"maas-api-fdd88446b-8xljb\" (UID: \"587da983-a36e-4fff-9f2f-a9f8a0b5c424\") " pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:47.799305 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.799270    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/587da983-a36e-4fff-9f2f-a9f8a0b5c424-metrics-certs\") pod \"maas-api-fdd88446b-8xljb\" (UID: \"587da983-a36e-4fff-9f2f-a9f8a0b5c424\") " pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:47.900130 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.900092    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv4dm\" (UniqueName: \"kubernetes.io/projected/587da983-a36e-4fff-9f2f-a9f8a0b5c424-kube-api-access-vv4dm\") pod \"maas-api-fdd88446b-8xljb\" (UID: \"587da983-a36e-4fff-9f2f-a9f8a0b5c424\") " pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:47.900130 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.900127    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/587da983-a36e-4fff-9f2f-a9f8a0b5c424-maas-api-tls\") pod \"maas-api-fdd88446b-8xljb\" (UID: \"587da983-a36e-4fff-9f2f-a9f8a0b5c424\") " pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:47.900426 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.900160    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/587da983-a36e-4fff-9f2f-a9f8a0b5c424-metrics-certs\") pod \"maas-api-fdd88446b-8xljb\" (UID: \"587da983-a36e-4fff-9f2f-a9f8a0b5c424\") " pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:47.900426 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.900214    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/587da983-a36e-4fff-9f2f-a9f8a0b5c424-openshift-service-ca\") pod \"maas-api-fdd88446b-8xljb\" (UID: \"587da983-a36e-4fff-9f2f-a9f8a0b5c424\") " pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:47.900913 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.900892    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/587da983-a36e-4fff-9f2f-a9f8a0b5c424-openshift-service-ca\") pod \"maas-api-fdd88446b-8xljb\" (UID: \"587da983-a36e-4fff-9f2f-a9f8a0b5c424\") " pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:47.903057 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.903036    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/587da983-a36e-4fff-9f2f-a9f8a0b5c424-maas-api-tls\") pod \"maas-api-fdd88446b-8xljb\" (UID: \"587da983-a36e-4fff-9f2f-a9f8a0b5c424\") " pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:47.903173 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.903078    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/587da983-a36e-4fff-9f2f-a9f8a0b5c424-metrics-certs\") pod \"maas-api-fdd88446b-8xljb\" (UID: \"587da983-a36e-4fff-9f2f-a9f8a0b5c424\") " pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:47.910354 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.910332    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv4dm\" (UniqueName: \"kubernetes.io/projected/587da983-a36e-4fff-9f2f-a9f8a0b5c424-kube-api-access-vv4dm\") pod \"maas-api-fdd88446b-8xljb\" (UID: \"587da983-a36e-4fff-9f2f-a9f8a0b5c424\") " pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:47.950304 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.950274    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:47.977325 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.977241    2547 generic.go:356] "Generic (PLEG): container finished" podID="b47b62dc-4dff-4898-9fa9-8357efd522c5" containerID="1bf34ea8ead31e454a4b855eecaa430a8bb1e5cec4f6e1fa2ddc62107cb59a0c" exitCode=0
Sep 11 13:30:47.977325 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.977283    2547 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-78554b866-brp64"
Sep 11 13:30:47.977325 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.977317    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78554b866-brp64" event={"ID":"b47b62dc-4dff-4898-9fa9-8357efd522c5","Type":"ContainerDied","Data":"1bf34ea8ead31e454a4b855eecaa430a8bb1e5cec4f6e1fa2ddc62107cb59a0c"}
Sep 11 13:30:47.977628 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.977367    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-78554b866-brp64" event={"ID":"b47b62dc-4dff-4898-9fa9-8357efd522c5","Type":"ContainerDied","Data":"7a392cb55ad230e4f14e4fc4e94abfaa4a05d6d1fe8b1eabb50ec79e0e84a4ac"}
Sep 11 13:30:47.977628 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.977391    2547 scope.go:117] "RemoveContainer" containerID="1bf34ea8ead31e454a4b855eecaa430a8bb1e5cec4f6e1fa2ddc62107cb59a0c"
Sep 11 13:30:47.986574 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.986557    2547 scope.go:117] "RemoveContainer" containerID="1bf34ea8ead31e454a4b855eecaa430a8bb1e5cec4f6e1fa2ddc62107cb59a0c"
Sep 11 13:30:47.986898 ip-10-0-142-110 kubenswrapper[2547]: E0911 13:30:47.986881    2547 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bf34ea8ead31e454a4b855eecaa430a8bb1e5cec4f6e1fa2ddc62107cb59a0c\": container with ID starting with 1bf34ea8ead31e454a4b855eecaa430a8bb1e5cec4f6e1fa2ddc62107cb59a0c not found: ID does not exist" containerID="1bf34ea8ead31e454a4b855eecaa430a8bb1e5cec4f6e1fa2ddc62107cb59a0c"
Sep 11 13:30:47.986968 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:47.986906    2547 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bf34ea8ead31e454a4b855eecaa430a8bb1e5cec4f6e1fa2ddc62107cb59a0c"} err="failed to get container status \"1bf34ea8ead31e454a4b855eecaa430a8bb1e5cec4f6e1fa2ddc62107cb59a0c\": rpc error: code = NotFound desc = could not find container \"1bf34ea8ead31e454a4b855eecaa430a8bb1e5cec4f6e1fa2ddc62107cb59a0c\": container with ID starting with 1bf34ea8ead31e454a4b855eecaa430a8bb1e5cec4f6e1fa2ddc62107cb59a0c not found: ID does not exist"
Sep 11 13:30:48.001270 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.001244    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b47b62dc-4dff-4898-9fa9-8357efd522c5-openshift-service-ca\") pod \"b47b62dc-4dff-4898-9fa9-8357efd522c5\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") "
Sep 11 13:30:48.001375 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.001291    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-494rt\" (UniqueName: \"kubernetes.io/projected/b47b62dc-4dff-4898-9fa9-8357efd522c5-kube-api-access-494rt\") pod \"b47b62dc-4dff-4898-9fa9-8357efd522c5\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") "
Sep 11 13:30:48.001375 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.001322    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b47b62dc-4dff-4898-9fa9-8357efd522c5-maas-api-tls\") pod \"b47b62dc-4dff-4898-9fa9-8357efd522c5\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") "
Sep 11 13:30:48.001626 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.001609    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b47b62dc-4dff-4898-9fa9-8357efd522c5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b47b62dc-4dff-4898-9fa9-8357efd522c5" (UID: "b47b62dc-4dff-4898-9fa9-8357efd522c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 13:30:48.003527 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.003504    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b47b62dc-4dff-4898-9fa9-8357efd522c5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b47b62dc-4dff-4898-9fa9-8357efd522c5" (UID: "b47b62dc-4dff-4898-9fa9-8357efd522c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:30:48.003633 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.003553    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b47b62dc-4dff-4898-9fa9-8357efd522c5-kube-api-access-494rt" (OuterVolumeSpecName: "kube-api-access-494rt") pod "b47b62dc-4dff-4898-9fa9-8357efd522c5" (UID: "b47b62dc-4dff-4898-9fa9-8357efd522c5"). InnerVolumeSpecName "kube-api-access-494rt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 13:30:48.087683 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.087646    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:48.102191 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.102166    2547 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47b62dc-4dff-4898-9fa9-8357efd522c5-metrics-certs\") pod \"b47b62dc-4dff-4898-9fa9-8357efd522c5\" (UID: \"b47b62dc-4dff-4898-9fa9-8357efd522c5\") "
Sep 11 13:30:48.102457 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.102438    2547 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b47b62dc-4dff-4898-9fa9-8357efd522c5-openshift-service-ca\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:30:48.102506 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.102465    2547 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-494rt\" (UniqueName: \"kubernetes.io/projected/b47b62dc-4dff-4898-9fa9-8357efd522c5-kube-api-access-494rt\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:30:48.102506 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.102479    2547 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b47b62dc-4dff-4898-9fa9-8357efd522c5-maas-api-tls\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:30:48.104178 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.104152    2547 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b47b62dc-4dff-4898-9fa9-8357efd522c5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b47b62dc-4dff-4898-9fa9-8357efd522c5" (UID: "b47b62dc-4dff-4898-9fa9-8357efd522c5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 13:30:48.203473 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.203440    2547 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b47b62dc-4dff-4898-9fa9-8357efd522c5-metrics-certs\") on node \"ip-10-0-142-110.ec2.internal\" DevicePath \"\""
Sep 11 13:30:48.300745 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.300701    2547 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-78554b866-brp64"]
Sep 11 13:30:48.305131 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.305107    2547 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-78554b866-brp64"]
Sep 11 13:30:48.318053 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.318028    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:30:48.362272 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.362163    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"]
Sep 11 13:30:48.364358 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:30:48.364332    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod587da983_a36e_4fff_9f2f_a9f8a0b5c424.slice/crio-24608fbb91e2fa10711655650d4a0eb6276205beba632eb0b4bc76330d367db7 WatchSource:0}: Error finding container 24608fbb91e2fa10711655650d4a0eb6276205beba632eb0b4bc76330d367db7: Status 404 returned error can't find the container with id 24608fbb91e2fa10711655650d4a0eb6276205beba632eb0b4bc76330d367db7
Sep 11 13:30:48.985959 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:48.985925    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb" event={"ID":"587da983-a36e-4fff-9f2f-a9f8a0b5c424","Type":"ContainerStarted","Data":"24608fbb91e2fa10711655650d4a0eb6276205beba632eb0b4bc76330d367db7"}
Sep 11 13:30:49.006306 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:49.006271    2547 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b47b62dc-4dff-4898-9fa9-8357efd522c5" path="/var/lib/kubelet/pods/b47b62dc-4dff-4898-9fa9-8357efd522c5/volumes"
Sep 11 13:30:49.992002 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:49.991969    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb" event={"ID":"587da983-a36e-4fff-9f2f-a9f8a0b5c424","Type":"ContainerStarted","Data":"60f2f3e6a943f953d237aab35a926cb36fb849226604e4914dfbda7a3e8b115d"}
Sep 11 13:30:49.992466 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:49.992079    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:50.024896 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:50.024851    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb" podStartSLOduration=2.481278929 podStartE2EDuration="3.024836694s" totalImagesPullingTime="543.557765ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 13:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:30:50.024603046 +0000 UTC m=+2119.528467451" watchObservedRunningTime="2026-09-11 13:30:50.024836694 +0000 UTC m=+2119.528701086"
Sep 11 13:30:56.001862 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:56.001825    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-fdd88446b-8xljb"
Sep 11 13:30:56.228208 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:30:56.228168    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:31:02.132392 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:02.132364    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:31:09.014587 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:09.014551    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nmfp"]
Sep 11 13:31:18.563462 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:18.563431    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f55dc566-hc69g_fdb9935f-3e03-42c2-8262-68302c24e821/copy-manifests/0.log"
Sep 11 13:31:18.582274 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:18.582239    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f55dc566-hc69g_fdb9935f-3e03-42c2-8262-68302c24e821/manager/0.log"
Sep 11 13:31:19.170391 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:19.170337    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-fdd88446b-8xljb_587da983-a36e-4fff-9f2f-a9f8a0b5c424/maas-api/0.log"
Sep 11 13:31:19.285736 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:19.285686    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818875-rh98t_197ff720-87cc-4ee4-aa69-b65a169353b1/cleanup/0.log"
Sep 11 13:31:19.401548 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:19.401515    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29818890-7298j_8934edaa-f925-4ca4-b834-f1dc9ca6ca39/cleanup/0.log"
Sep 11 13:31:20.449397 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:20.449358    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-sj4ss_ed77d2f1-174b-4c21-af69-a67ee7bbb923/manager/0.log"
Sep 11 13:31:20.574281 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:20.574249    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-89v6f_3ef51b41-6453-49d3-89f0-e875a5437ebd/manager/0.log"
Sep 11 13:31:20.976413 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:20.976371    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-5nmfp_3162ee1e-4106-4b20-9bec-f3d88b08ec62/limitador/0.log"
Sep 11 13:31:21.102567 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:21.102535    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-8bjnx_568b55b8-0fa6-4266-a828-789dc1d3dc9a/manager/0.log"
Sep 11 13:31:21.479960 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:21.479930    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm_414a5cda-bfb9-435d-9de8-fa74da97911e/istio-proxy/0.log"
Sep 11 13:31:21.612844 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:21.612815    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mnjl8_5ca6b81e-b43c-40c0-a38f-7a70204db34b/discovery/0.log"
Sep 11 13:31:21.740426 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:21.740328    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d97b946f-dww45_aaf46ce0-2f53-4e2d-a064-6e588568117c/kube-auth-proxy/0.log"
Sep 11 13:31:22.008208 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:22.008117    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nf8zn_05776d44-651e-44ef-b37e-f2a05e9dadd4/istio-proxy/1.log"
Sep 11 13:31:23.230735 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:23.230640    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgvgl5_166347c2-238b-468f-ab57-878b1be5df94/main/0.log"
Sep 11 13:31:31.468386 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:31.468355    2547 scope.go:117] "RemoveContainer" containerID="118fd8ea348158c0aa538d29092c681e1383ef347507088f997f6b17ca1bddd0"
Sep 11 13:31:32.584913 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:32.584880    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m2zq6_12361050-54a2-4987-83d0-263ddf62cd5a/global-pull-secret-syncer/0.log"
Sep 11 13:31:32.754335 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:32.754301    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8m4bg_c28a5600-c2c4-489a-b372-ee3d2e46f324/konnectivity-agent/0.log"
Sep 11 13:31:32.960886 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:32.960805    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-110.ec2.internal_b2c1a40351559e9ec3453a089b9e818c/haproxy/0.log"
Sep 11 13:31:37.129314 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:37.129282    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-sj4ss_ed77d2f1-174b-4c21-af69-a67ee7bbb923/manager/0.log"
Sep 11 13:31:37.164752 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:37.164698    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-89v6f_3ef51b41-6453-49d3-89f0-e875a5437ebd/manager/0.log"
Sep 11 13:31:37.290425 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:37.290392    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-5nmfp_3162ee1e-4106-4b20-9bec-f3d88b08ec62/limitador/0.log"
Sep 11 13:31:37.377594 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:37.377564    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-8bjnx_568b55b8-0fa6-4266-a828-789dc1d3dc9a/manager/0.log"
Sep 11 13:31:39.487443 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:39.487394    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zn57h_fb5143b0-e3db-4bab-8521-4302149bbd7b/node-exporter/0.log"
Sep 11 13:31:39.516893 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:39.516865    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zn57h_fb5143b0-e3db-4bab-8521-4302149bbd7b/kube-rbac-proxy/0.log"
Sep 11 13:31:39.539097 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:39.539076    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zn57h_fb5143b0-e3db-4bab-8521-4302149bbd7b/init-textfile/0.log"
Sep 11 13:31:40.003665 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:40.003636    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f87d46645-2h8nx_4c1500d6-9330-416e-b162-b22a6039e0db/telemeter-client/0.log"
Sep 11 13:31:40.029446 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:40.029419    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f87d46645-2h8nx_4c1500d6-9330-416e-b162-b22a6039e0db/reload/0.log"
Sep 11 13:31:40.061231 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:40.061144    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f87d46645-2h8nx_4c1500d6-9330-416e-b162-b22a6039e0db/kube-rbac-proxy/0.log"
Sep 11 13:31:42.742881 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.742842    2547 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"]
Sep 11 13:31:42.743307 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.743162    2547 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b47b62dc-4dff-4898-9fa9-8357efd522c5" containerName="maas-api"
Sep 11 13:31:42.743307 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.743173    2547 state_mem.go:107] "Deleted CPUSet assignment" podUID="b47b62dc-4dff-4898-9fa9-8357efd522c5" containerName="maas-api"
Sep 11 13:31:42.743307 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.743234    2547 memory_manager.go:368] "RemoveStaleState removing state" podUID="b47b62dc-4dff-4898-9fa9-8357efd522c5" containerName="maas-api"
Sep 11 13:31:42.746068 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.746048    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.748375 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.748356    2547 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ljsx5\"/\"default-dockercfg-cht8v\""
Sep 11 13:31:42.748478 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.748369    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ljsx5\"/\"kube-root-ca.crt\""
Sep 11 13:31:42.748478 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.748380    2547 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ljsx5\"/\"openshift-service-ca.crt\""
Sep 11 13:31:42.755969 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.755946    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"]
Sep 11 13:31:42.852884 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.852843    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/909ea1f8-9988-4834-928d-ba158fd494bc-proc\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.853062 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.852910    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whckt\" (UniqueName: \"kubernetes.io/projected/909ea1f8-9988-4834-928d-ba158fd494bc-kube-api-access-whckt\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.853062 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.852996    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/909ea1f8-9988-4834-928d-ba158fd494bc-sys\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.853062 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.853021    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/909ea1f8-9988-4834-928d-ba158fd494bc-lib-modules\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.853220 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.853125    2547 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/909ea1f8-9988-4834-928d-ba158fd494bc-podres\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.954198 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.954164    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/909ea1f8-9988-4834-928d-ba158fd494bc-lib-modules\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.954384 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.954211    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/909ea1f8-9988-4834-928d-ba158fd494bc-podres\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.954384 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.954253    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/909ea1f8-9988-4834-928d-ba158fd494bc-proc\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.954384 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.954280    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whckt\" (UniqueName: \"kubernetes.io/projected/909ea1f8-9988-4834-928d-ba158fd494bc-kube-api-access-whckt\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.954384 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.954300    2547 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/909ea1f8-9988-4834-928d-ba158fd494bc-sys\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.954384 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.954355    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/909ea1f8-9988-4834-928d-ba158fd494bc-lib-modules\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.954384 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.954365    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/909ea1f8-9988-4834-928d-ba158fd494bc-sys\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.954384 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.954368    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/909ea1f8-9988-4834-928d-ba158fd494bc-proc\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.954764 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.954402    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/909ea1f8-9988-4834-928d-ba158fd494bc-podres\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:42.962844 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:42.962822    2547 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whckt\" (UniqueName: \"kubernetes.io/projected/909ea1f8-9988-4834-928d-ba158fd494bc-kube-api-access-whckt\") pod \"perf-node-gather-daemonset-mnd5d\" (UID: \"909ea1f8-9988-4834-928d-ba158fd494bc\") " pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:43.056359 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:43.056331    2547 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:43.334983 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:43.334958    2547 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"]
Sep 11 13:31:43.337314 ip-10-0-142-110 kubenswrapper[2547]: W0911 13:31:43.337288    2547 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod909ea1f8_9988_4834_928d_ba158fd494bc.slice/crio-43b8d1a6276b7a4465a5368e3a3d132409672cbae83b9b7154bd3077d8ffdb90 WatchSource:0}: Error finding container 43b8d1a6276b7a4465a5368e3a3d132409672cbae83b9b7154bd3077d8ffdb90: Status 404 returned error can't find the container with id 43b8d1a6276b7a4465a5368e3a3d132409672cbae83b9b7154bd3077d8ffdb90
Sep 11 13:31:44.233690 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:44.233656    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d" event={"ID":"909ea1f8-9988-4834-928d-ba158fd494bc","Type":"ContainerStarted","Data":"fe67f44d2a79ba4e95db6de6bf96fc87973090592201a21f632352ba94c3ae49"}
Sep 11 13:31:44.234094 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:44.233731    2547 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d" event={"ID":"909ea1f8-9988-4834-928d-ba158fd494bc","Type":"ContainerStarted","Data":"43b8d1a6276b7a4465a5368e3a3d132409672cbae83b9b7154bd3077d8ffdb90"}
Sep 11 13:31:44.234094 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:44.233791    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:44.270693 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:44.270649    2547 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d" podStartSLOduration=2.2706354810000002 podStartE2EDuration="2.270635481s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 13:31:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 13:31:44.270030981 +0000 UTC m=+2173.773895374" watchObservedRunningTime="2026-09-11 13:31:44.270635481 +0000 UTC m=+2173.774499874"
Sep 11 13:31:45.456989 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:45.456955    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-68ddt_05866b42-18a5-4beb-8cf6-9a7ea50083e6/dns/0.log"
Sep 11 13:31:45.484565 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:45.484540    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-68ddt_05866b42-18a5-4beb-8cf6-9a7ea50083e6/kube-rbac-proxy/0.log"
Sep 11 13:31:45.751780 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:45.751678    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bvm24_72410b07-acd7-4753-8fee-61e094f12b5f/dns-node-resolver/0.log"
Sep 11 13:31:46.387430 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:46.387400    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-cb8qd_125564ba-2933-414e-843b-5e36e5a55ebe/node-ca/0.log"
Sep 11 13:31:47.537300 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:47.537269    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm_414a5cda-bfb9-435d-9de8-fa74da97911e/istio-proxy/0.log"
Sep 11 13:31:48.138900 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:48.138871    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mnjl8_5ca6b81e-b43c-40c0-a38f-7a70204db34b/discovery/0.log"
Sep 11 13:31:48.204423 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:48.204400    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d97b946f-dww45_aaf46ce0-2f53-4e2d-a064-6e588568117c/kube-auth-proxy/0.log"
Sep 11 13:31:48.344360 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:48.344334    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nf8zn_05776d44-651e-44ef-b37e-f2a05e9dadd4/istio-proxy/0.log"
Sep 11 13:31:48.360389 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:48.360360    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nf8zn_05776d44-651e-44ef-b37e-f2a05e9dadd4/istio-proxy/1.log"
Sep 11 13:31:49.631101 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:49.631073    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-f59v4_049cc9ba-127f-4cde-9961-856217c1a61a/serve-healthcheck-canary/0.log"
Sep 11 13:31:50.204308 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:50.204282    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-74tx7_c6441d0e-9963-4fc5-96ed-639510ad48cc/kube-rbac-proxy/0.log"
Sep 11 13:31:50.229681 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:50.229662    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-74tx7_c6441d0e-9963-4fc5-96ed-639510ad48cc/exporter/0.log"
Sep 11 13:31:50.248251 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:50.248233    2547 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ljsx5/perf-node-gather-daemonset-mnd5d"
Sep 11 13:31:50.257249 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:50.257231    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-74tx7_c6441d0e-9963-4fc5-96ed-639510ad48cc/extractor/0.log"
Sep 11 13:31:53.758548 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:53.758510    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f55dc566-hc69g_fdb9935f-3e03-42c2-8262-68302c24e821/manager/0.log"
Sep 11 13:31:53.771040 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:53.771012    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm_414a5cda-bfb9-435d-9de8-fa74da97911e/istio-proxy/0.log"
Sep 11 13:31:53.805366 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:53.805336    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f55dc566-hc69g_fdb9935f-3e03-42c2-8262-68302c24e821/copy-manifests/0.log"
Sep 11 13:31:54.387441 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:54.387393    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mnjl8_5ca6b81e-b43c-40c0-a38f-7a70204db34b/discovery/0.log"
Sep 11 13:31:54.397952 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:54.397930    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d97b946f-dww45_aaf46ce0-2f53-4e2d-a064-6e588568117c/kube-auth-proxy/0.log"
Sep 11 13:31:54.447212 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:54.447184    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nf8zn_05776d44-651e-44ef-b37e-f2a05e9dadd4/istio-proxy/0.log"
Sep 11 13:31:54.463916 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:54.463891    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nf8zn_05776d44-651e-44ef-b37e-f2a05e9dadd4/istio-proxy/1.log"
Sep 11 13:31:55.984543 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:55.984516    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-l8mmm_414a5cda-bfb9-435d-9de8-fa74da97911e/istio-proxy/0.log"
Sep 11 13:31:56.598545 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:56.598514    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-mnjl8_5ca6b81e-b43c-40c0-a38f-7a70204db34b/discovery/0.log"
Sep 11 13:31:56.726156 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:56.726133    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d97b946f-dww45_aaf46ce0-2f53-4e2d-a064-6e588568117c/kube-auth-proxy/0.log"
Sep 11 13:31:56.774794 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:56.774769    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nf8zn_05776d44-651e-44ef-b37e-f2a05e9dadd4/istio-proxy/0.log"
Sep 11 13:31:56.790296 ip-10-0-142-110 kubenswrapper[2547]: I0911 13:31:56.790270    2547 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-nf8zn_05776d44-651e-44ef-b37e-f2a05e9dadd4/istio-proxy/1.log"